New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

有个弊端把start_urls里面的链接也给去重了 #9

Open

dahuangfeng123 opened this issue Jun 9, 2022 · 0 comments

dahuangfeng123 commented Jun 9, 2022

起始链接被去重后面就没法抓取了，望改进

dahuangfeng123 changed the title ~~有个弊端把start_url里面的链接也给去重了，这可是起始链接~~ 有个弊端把start_urls里面的链接也给去重了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment