Skip to content

Closed - #33

Closed
StefanoGuerrini wants to merge 3 commits into
mainfrom
feat/crawl
Closed

StefanoGuerrini wants to merge 3 commits into
mainfrom
feat/crawl

Conversation

@StefanoGuerrini

@StefanoGuerrini StefanoGuerrini commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

Closed.

StefanoGuerrini and others added 3 commits October 8, 2026 16:32
ZenRowsCrawlClient covers the Crawl API: create, get, list, iterCrawls,
iterResults, stop, getContent, download (parsed NDJSON) and wait. It
reuses the Batch transport (X-API-Key, retries, problem+json) with its
own ZenRowsCrawlError, which carries retryAfter and names REQS008 as
"Crawl is not enabled for this account". The transport takes an
optional error factory; Batch's behavior is unchanged.

Adds unit tests with msw, an opt-in e2e test against a live API
(`pnpm test:e2e`, skipped unless ZENROWS_API_KEY and
ZENROWS_CRAWL_BASE_URL are set), and README docs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@StefanoGuerrini StefanoGuerrini changed the title feat(crawl): add the Crawl client, exposed as client.crawl Closed Oct 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant