Skip to content

fix: list Extract in the PyPI summary and keywords - #40

Closed
jonathan-zenrows wants to merge 2 commits into
mainfrom
fix/extract-pypi-metadata-mag-512
Closed

jonathan-zenrows wants to merge 2 commits into
mainfrom
fix/extract-pypi-metadata-mag-512

Conversation

@jonathan-zenrows

@jonathan-zenrows jonathan-zenrows commented Oct 13, 2026 •

Copy link
Copy Markdown

What

  • PyPI summary: "ZenRows Python SDK — synchronous scraping + Batch (async job) API" becomes "Zenrows Python SDK — Fetch, Extract (structured data), Batch and Crawl APIs".
  • Keywords: add extract, structured-data, web-scraping, crawl.
  • The extract() docstring and its tests no longer call mode="auto" a "domain-gated open beta". The docstring now documents 403 REQS007 for a domain that isn't prepared yet, and how to prepare one.
  • The README's Extract link points at the Extract docs instead of the docs home.

Why

The 1.6.0 page on PyPI undersells the package: the summary and keywords leave Extract out, and the docstring describes a gate that no longer exists.

Testing

  • pytest tests/test_fetch_extract.py: 27 pass
  • uv build sdist PKG-INFO shows the new Summary and Keywords

After merge

Cut a release (make release PART=patch) so PyPI shows the new metadata.

🤖 Generated with Claude Code

The PyPI summary still read "synchronous scraping + Batch (async job) API"
and the keywords left Extract out, so the package page undersold what 1.6.0
ships. Name Fetch, Extract, Batch and Crawl in the summary and add extract,
structured-data, web-scraping and crawl to the keywords.

Drop "domain-gated open beta" from the extract() docstring and its tests:
Extract has worked on any prepared domain with any active key since the
gate was removed. Point the README's Extract link at the Extract docs.

The new metadata reaches PyPI on the next release.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@linear

linear Bot commented Oct 13, 2026

Copy link
Copy Markdown

MAG-512

@jonathan-zenrows
jonathan-zenrows force-pushed the fix/extract-pypi-metadata-mag-512 branch from e8c7cd9 to 84f123e Compare October 13, 2026 14:40
@jonathan-zenrows
jonathan-zenrows deleted the fix/extract-pypi-metadata-mag-512 branch October 13, 2026 14:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants