Skip to content

1.10.0

Compare
Choose a tag to compare
@rudolfix rudolfix released this 22 Apr 18:15
· 196 commits to master since this release
3b332a3

Core Library

  • feat(paginator): enhance JSONResponseCursorPaginator to support cursor placement in request JSON body by @kang8 in #2446
  • fix: better import exception for numpy by @zilto in #2397
  • Fix read parquet chunk size by @diwu-sf in #2456
  • rest_api: enhance placeholder expansion to preserve value types by @burnash in #2462
  • list-destination flag added by @zilto in #2441
  • Fixes bigquery, ibis tests by @anuunchin in #2470
  • add ignore_unknown_values option to BigQuery destination by @xxntti3n in #2455
  • Fix: insert-from-staging replace strategy incorrectly using staging-optimized pattern by @anuunchin in #2435
  • fix: index invariant add_row_hash_to_table by @hagelborn in #2491
  • adds condition to check XDG_DATA_HOME to set global_dir value by @goosethedev in #2361
  • removes location tag from athena iceberg, fixes catalog name, allows for additional props @rudolfix in #2478
  • adds default dataset/schema to ibis expressions, support for athena and databricks backends @rudolfix in #2478
  • 2457-refactors iceberg and duckdb cache support by @rudolfix in #2430
  • fixes wrong resolve for WithLocalFiles configuration by @rudolfix in #2430
  • converts Iceberg fileio into dlt credentials by @rudolfix in #2430
  • bumps and simplifies deltalake, enables streaming appends and upserts by @rudolfix in #2430
  • fixes nullability warning on duckdb ALTER by @rudolfix in #2430
  • adds replace strategy selector, internal x-replace-strategy hint, removes sql_params by @rudolfix in #2430
  • borrows and returns sqlalchemy connections in destination and several other critical fixes to sqllite, connection management, merge operations by @rudolfix in #2430
  • executes all sql jobs (replace, copy, merge) in a transaction on all destinations by @rudolfix in #2430
  • shows info on locations for config providers when displaying exceptions, hides warnings when project context is present by @rudolfix in #2430
  • Fix/add s3 region for redshift staging destination related to 2349 by @yannik207 in #2389
  • Fix: sqlalchemy table names of type sqlalchemy.sql.elements.quoted_name causing deserialization error by @anuunchin in
    #2496
  • Preserve type of emtpy lists in incremental to allow to materialize empty resources by @sh-rp in #2511
  • Fix clickhouse sql syntax for sentinel table creation by @sh-rp in #2510
  • cli: dlt ai setup $IDE add cursor rules to REST API source to your dlt project (and more) @zilto in #2503
  • "model" item_format: support for lazily evaluated tables/data frames by @anuunchin in #2423
  • adds arrow ipc nested type encoding to json type by @rudolfix in #2519
  • [chore] imports addon function when generating destination test cases to extend implemented destinations and test cases. allows for followup job in job client tests by @rudolfix in #2519
  • allows iceberg to infer unified schema, allows csv files, uses explicit select list in sql_client filesystem by @rudolfix in #2519
  • allows to use context manager on dataset to keep internal connection open + lifecycle tests by @rudolfix in #2519
  • uses union by name when reading parquet via duckdb to see all columns when schema evolves by @rudolfix in #2519
  • makes vault provider to check known toml fragments also for non-secrets by @rudolfix in #2519
  • handles non existing iceberg tables in sql client and during registration by @rudolfix in #2519
  • refactors how deterministic 'temp' tables are named for destinations that do not support temp tables by @rudolfix in #2519
  • fixes open cursor not closed in mssql and athena sql_client by @rudolfix in #2519

Docs

Verified Sources (and rules)

We support dlt ai command via https://github.com/dlt-hub/verified-sources/tree/master/ai

New Contributors

Full Changelog: 1.9.0...1.10.0