Skip to content

Issues: yujiosaka/headless-chrome-crawler

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

29 Open 106 Closed
29 Open 106 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Proxy not working --proxy-server
#386 opened Jun 30, 2022 by byposeidon
How can i make customCrawl click on specific elements?
#384 opened Feb 21, 2022 by michaelpapesch
1
i get a JSHandle@node string instead of a ElementHandle object
#382 opened Feb 3, 2022 by jriffs
subdomain crawl with "allowedDomains" parameter crawls top domain, too
#381 opened Nov 29, 2021 by michaelpapesch
Provide auth to page when using proxy
#378 opened Mar 12, 2021 by tsrdatatech
Is there a way to scroll?
#377 opened Jan 13, 2021 by wemow
4
Crawling site with maxDepth > 2 causes hang
#376 opened Dec 18, 2020 by TheTFo
3
Are links with empty href ignored? (button links handled by page js)
#373 opened Oct 16, 2020 by YuriGor
1
Get current URL in customCrawl() feature
#364 opened Apr 27, 2020 by popstas
3
preRequest function cuts the entire branch instead of a single page
#357 opened Nov 5, 2019 by AleksandrBorkun
Question: Handling of pdf files bug
#355 opened Sep 21, 2019 by eladbitton
1
WebSocket is not open when 'maxrequestreached' event is reached bug
#349 opened Jun 5, 2019 by LeMoussel
1
Error: Protocol error (Target.closeTarget): Target closed. bug
#344 opened Mar 28, 2019 by yeekit-jewel
3
Pages with 403 errors not throwing errors feature
#343 opened Mar 18, 2019 by mrispoli24
1
Crawl stops on non-www URLs bug
#338 opened Jan 9, 2019 by cosmiXs
5
How to handle the timeout error? feature
#336 opened Dec 25, 2018 by gajus
2
Stuck for no reason? bug
#314 opened Aug 31, 2018 by crapthings
6
duplicated url are crawled twice bug
#302 opened Jul 31, 2018 by Minyar2004
6
crawler listening new request url feature
#301 opened Jul 30, 2018 by Minyar2004
1
What is the intended method for re-enabling the Content-Security-Policy header? feature
#298 opened Jul 23, 2018 by jamieweb
1
Queueing same url on multiple workers in cluster with Redis cache results in duplicates
#293 opened Jul 12, 2018 by lioreshai
4
Suggestion: robots.txt shouldn't be reparsed every time feature
#198 opened Apr 4, 2018 by panthony
Crawler should honor the Crawl-Delay if obeyRobotsTxt:true feature
#194 opened Apr 3, 2018 by panthony
2
You should be able to provides the robots.txt feature
#192 opened Apr 2, 2018 by panthony
Suggestion: Collect links should be extendable and/or have more infos than their URL feature
#191 opened Mar 31, 2018 by panthony
1
ProTip! no:milestone will show everything without a milestone.