Code

v0.2.9#25

Code

Merged

D4Vinci merged 46 commits intomainD4Vinci/Scrapling:mainfrom devD4Vinci/Scrapling:devCopy head branch name to clipboardDec 16, 2024

+1,773-856

Commits

Commits on Dec 4, 2024

• Make standard string methods return TextHandler again instead of str

  D4Vinci

  committed
  31e838c

  Copy full SHA for 31e838c

• Adding empty methods (get/get_all/extract/extract_all)

  Show description for 45e86f5
  D4Vinci

  committed
  45e86f5

  Copy full SHA for 45e86f5

• fix: Enable WebGL by default

  D4Vinci

  committed
  d0f1895

  Copy full SHA for d0f1895

Commits on Dec 10, 2024

• Adding urljoin method to Adaptors and Responses

  D4Vinci

  committed
  5f9c398

  Copy full SHA for 5f9c398

• Adding keep_cdata argument for Adaptor and Response classes

  Show description for b4f9061
  D4Vinci

  committed
  b4f9061

  Copy full SHA for b4f9061

• Bumping up the libraries versions for better stealth and speed!

  D4Vinci

  committed
  93ed768

  Copy full SHA for 93ed768

• Python 3.8 is not supported anymore

  Show description for e60a57c
  D4Vinci

  committed
  e60a57c

  Copy full SHA for e60a57c

• Preparing to release 0.2.9 soon

  D4Vinci

  committed
  ba11c43

  Copy full SHA for ba11c43

• Update tox.ini

  D4Vinci

  committed
  70b5424

  Copy full SHA for 70b5424

• Update tests.yml

  D4Vinci

  committed
  e332444

  Copy full SHA for e332444

Commits on Dec 11, 2024

• feat: logging for response status

  D4Vinci

  committed
  9f0001a

  Copy full SHA for 9f0001a

• fix: Adaptor.body returns raw HTML without processing

  Show description for dcf5187
  D4Vinci

  committed
  dcf5187

  Copy full SHA for dcf5187

• build: disable the 404 error test for playwright

  D4Vinci

  committed
  f30eb6a

  Copy full SHA for f30eb6a

• refactor(api)!: Unifying log under 1 logger and removing debug parameter

  Show description for 193827e
  D4Vinci

  committed
  193827e

  Copy full SHA for 193827e

• fix: forgot to stage it with last commit

  D4Vinci

  committed
  e254341

  Copy full SHA for e254341

• build: disable the 501 error test for playwright

  D4Vinci

  committed
  6f87420

  Copy full SHA for 6f87420

Commits on Dec 12, 2024

• feat: adding geoip parameter to the StealthyFetcher

  D4Vinci

  committed
  bfe9063

  Copy full SHA for bfe9063

• build: Pumping up camoufox version to solve browserforge issue

  Show description for f9bee4c
  D4Vinci

  committed
  f9bee4c

  Copy full SHA for f9bee4c

Commits on Dec 13, 2024

• build: pumping up camoufox

  Show description for 838dd62
  D4Vinci

  committed
  838dd62

  Copy full SHA for 838dd62

Commits on Dec 15, 2024

• feat: adding the retries argument for all methods of Fetcher class

  D4Vinci

  committed
  299793a

  Copy full SHA for 299793a

• perf: Give repeated usage of Fetcher a slight performance increase

  Show description for 445af3c
  D4Vinci

  committed
  445af3c

  Copy full SHA for 445af3c

• style: moving repeated arguments from inside the functions to __init__

  Show description for faf728a
  D4Vinci

  committed
  faf728a

  Copy full SHA for faf728a

• feat: Adding AsyncFetcher class version of Fetcher

  Show description for b10cfd3
  D4Vinci

  committed
  b10cfd3

  Copy full SHA for b10cfd3

• build: adding tests for AsyncFetcher class

  D4Vinci

  committed
  a90192d

  Copy full SHA for a90192d

• style: using better data structures for constants

  Show description for 6c17bd8
  D4Vinci

  committed
  6c17bd8

  Copy full SHA for 6c17bd8

• refactor(Playwright Engine): Separate what we can for cleaner code and the async function later

  Show description for 889c111
  D4Vinci

  committed
  889c111

  Copy full SHA for 889c111

• feat(PlaywrightFetcher): Add async support for PlaywrightFetcher

  D4Vinci

  committed
  af4f2c0

  Copy full SHA for af4f2c0

• test: add test for PlaywrightFetcher Async support

  D4Vinci

  committed
  aac77e4

  Copy full SHA for aac77e4

• chore: Restructuring fetchers into cleaner structure

  D4Vinci

  committed
  de015f2

  Copy full SHA for de015f2

• test: adding pytest-asyncio plugin to tests requirements file

  D4Vinci

  committed
  361ee44

  Copy full SHA for 361ee44

• style: Rewrite asyncFetcher tests to a cleaner version

  D4Vinci

  committed
  efb3270

  Copy full SHA for efb3270

• feat(StealthyFetcher): Add async fetch support

  D4Vinci

  committed
  79a911e

  Copy full SHA for 79a911e

• test: add tests for StealthyFetcher async fetch

  D4Vinci

  committed
  448587f

  Copy full SHA for 448587f

• test: clearer naming for async tests

  D4Vinci

  committed
  2606f7a

  Copy full SHA for 2606f7a

• style: Rewrite sync Fetchers tests to a cleaner version

  D4Vinci

  committed
  3ecffcb

  Copy full SHA for 3ecffcb

Commits on Dec 16, 2024

• fix(Fetchers/page_action): Fixing logic

  D4Vinci

  committed
  eceef48

  Copy full SHA for eceef48

• fix(Fetchers/disable_resources): Fixing the logic for intercepting resources

  D4Vinci

  committed
  d66ebc1

  Copy full SHA for d66ebc1

• fix: add AsyncFetcher to top-level shortcuts

  D4Vinci

  committed
  05c6eeb

  Copy full SHA for 05c6eeb

• docs: Adding async examples and fixing some typos

  D4Vinci

  committed
  6cf5ce9

  Copy full SHA for 6cf5ce9

• docs: fix TOC header

  D4Vinci

  committed
  43b41b3

  Copy full SHA for 43b41b3

• chore: Delete former-sponsor banner

  D4Vinci

  committed
  3ff0d55

  Copy full SHA for 3ff0d55

• test: Rewrite parser tests to a cleaner version and adding more tests

  D4Vinci

  committed
  69e3161

  Copy full SHA for 69e3161

• test: Rewrite automatch tests to a cleaner version and adding async test

  D4Vinci

  committed
  20ef453

  Copy full SHA for 20ef453

• docs: add an example that uses page.urljoin

  D4Vinci

  committed
  ac95600

  Copy full SHA for ac95600

• fix: Stopped the log spamming that happens with multiple instances creation

  D4Vinci

  committed
  c282cb3

  Copy full SHA for c282cb3

• style: fixing a typo in logging

  D4Vinci

  committed
  838b8b1

  Copy full SHA for 838b8b1