v0.7.0

What's Changed

• Bump tokio from 1.45.1 to 1.46.1 by @dependabot[bot] in #393
• Upgrade datafusion to version 49, datafusion-federation to version 0.4.7 by @nuno-faria in #407

Full Changelog: v0.6.3...v0.7.0

v0.6.3

What's Changed

• feat: Add temporary option to CreateTableBuilder by @nuno-faria in #398
• Bump datafusion-federation to 0.4.6 by @nuno-faria in #401

Full Changelog: v0.6.2...v0.6.3

v0.6.2

What's Changed

• Clickhouse: Remove unused AstAnalyzer from executor by @trueleo in #373
• Clickhouse: Remove pub visibility from two unused modules by @trueleo in #376
• Bump arrow-array from 55.1.0 to 55.2.0 by @dependabot[bot] in #381
• Bump test-log from 0.2.17 to 0.2.18 by @dependabot[bot] in #380
• Bump reqwest from 0.12.20 to 0.12.21 by @dependabot[bot] in #379
• Bump arrow-schema from 55.1.0 to 55.2.0 by @dependabot[bot] in #378
• Build on docs.rs with all features enabled by @trueleo in #375
• Bump datafusion-federation to 0.4.5 by @nuno-faria in #383

Full Changelog: v0.6.1...v0.6.2

v0.6.1

What's Changed

• Clickhouse: Add read only table provider for clickhouse by @trueleo in #369
• Set ClickHouse version to 0.13.3 by @trueleo in #371
• Bump prost from 0.14.0 to 0.14.1 by @dependabot in #372

Full Changelog: v0.6.0...v0.6.1

v0.6.0

What's Changed

• Bump prost from 0.13.5 to 0.14.0 by @dependabot in #367
• Bump bollard from 0.19.0 to 0.19.1 by @dependabot in #366
• Bump reqwest from 0.12.19 to 0.12.20 by @dependabot in #365
• Update Datafusion to 48, datafusion-federation to 0.4.3 by @askarbozcan in #370

New Contributors

• @askarbozcan made their first contribution in #370

Full Changelog: v0.5.0...v0.6.0

v0.5.0

What's Changed

• Bump crossbeam-channel from 0.5.14 to 0.5.15 in the cargo group by @dependabot in #312
• Bump anyhow from 1.0.97 to 1.0.98 by @dependabot in #314
• Bump odbc-api from 12.0.0 to 12.0.1 by @dependabot in #313
• Fix schema for projection with no columns by @phillipleblanc in #315
• Postgres: Make json/jsonb schema type and record types consistent (Utf8) by @sgrebnov in #318
• Bump arrow-odbc from 16.0.0 to 16.0.1 by @dependabot in #321
• Fix unused warnings by @trueleo in #325
• Bump sea-query from 0.32.3 to 0.32.4 by @dependabot in #323
• Bump rand from 0.9.0 to 0.9.1 by @dependabot in #322
• feat: Create Python integration testing by @crystalxyz in #320
• Bump odbc-api from 12.0.1 to 12.0.2 by @dependabot in #326
• Bump insta from 1.42.2 to 1.43.1 by @dependabot in #331
• Bump sha2 from 0.10.8 to 0.10.9 by @dependabot in #332
• Bump chrono from 0.4.40 to 0.4.41 by @dependabot in #330
• Bump mysql_async from 0.35.1 to 0.36.0 by @dependabot in #327
• Python feature flags by @ccciudatu in #337
• Bump sea-query from 0.32.4 to 0.32.5 by @dependabot in #338
• Bump tokio from 1.44.2 to 1.45.0 by @dependabot in #339
• Bump tempfile from 3.19.1 to 3.20.0 by @dependabot in #342
• Upgrade datafusion to 47 and datafusion-federation to 0.4.2 by @nuno-faria in #324
• Upgrade dependencies by @phillipleblanc in #363
• Merge spiceai changes since 0.4: Custom DuckDB settings, more robust DuckDB attachment logic, broader type support for DuckDB tables by @phillipleblanc in #364
• Don't pushdown filters with subqueries by @phillipleblanc in #316

New Contributors

• @trueleo made their first contribution in #325

Full Changelog: v0.4.0...v0.5.0

v0.4.0

What's Changed

• Revert "Revert "Bump secrecy version"" by @sgrebnov in #254
• Upgrade secrecy crate by @phillipleblanc in #256
• Upgrade Duckdb to 1.2.1 by @phillipleblanc in #257
• Upgrade datafusion-federation by @phillipleblanc in #258
• Upgrade federation by @phillipleblanc in #259
• Add primary keys mismatch verification for DuckDB table creation by @sgrebnov in #260
• Add indexes mismatch detection for DuckDB table creation by @sgrebnov in #261
• Add test for DuckDB memory_limit param by @sgrebnov in #263
• Use quote_identifier for table name when fetching existing primary keys by @sgrebnov in #265
• Bump tokio from 1.44.0 to 1.44.1 by @dependabot in #270
• Bump async-trait from 0.1.87 to 0.1.88 by @dependabot in #269
• Add test for DuckDB memory_limit option (#263) by @sgrebnov in #273
• Add indexes and primary keys mismatch detection for DuckDB by @sgrebnov in #272
• feat: Add python FFI interface and expose sqlite and duckdb table providers by @crystalxyz in #264
• Defer index/constraint creation until after the initial data load. by @phillipleblanc in #280
• Bump reqwest from 0.12.12 to 0.12.15 by @dependabot in #286
• Bump geo-types from 0.7.15 to 0.7.16 by @dependabot in #285
• Bump rstest from 0.24.0 to 0.25.0 by @dependabot in #284
• Bump uuid from 1.15.1 to 1.16.0 by @dependabot in #283
• refactor: New TableManager interfaces for DuckDB by @peasee in #287
• Bump time from 0.3.39 to 0.3.41 by @dependabot in #282
• fix: Make an initial table during TableProviderFactory::create() for DuckDB by @peasee in #290
• Fixes a warning about missing indexes that shouldn't show up for newly created tables. by @phillipleblanc in #292
• De-duplicate attachments in DuckDBAttachments by @phillipleblanc in #294
• Allow connection pool size configuration for duckdb connection pool by @Sevenannn in #275
• Bump sea-query from 0.32.2 to 0.32.3 by @dependabot in #295
• Add DuckDB setting 'preserve_insertion_order` by @phillipleblanc in #298
• Update the PostgreSQL query to support inferring the schema from materialized views by @ewgenius in #300
• Upgrade mysql_async, expose metrics and remove unnecessary type parameters by @phillipleblanc in #302
• Expose the connection pool metrics via the table factory by @phillipleblanc in #304
• Support the pool_min and pool_max MySQL connection parameters by @phillipleblanc in #305
• Upgrade to DataFusion 46 by @phillipleblanc in #309
• Bump bigdecimal from 0.4.7 to 0.4.8 by @dependabot in #306
• Bump openssl from 0.10.71 to 0.10.72 in the cargo group by @dependabot in #303
• Bump tokio from 1.44.1 to 1.44.2 by @dependabot in #307
• Bump odbc-api from 11.1.1 to 12.0.0 by @dependabot in #308
• Improve DuckDB insert performance; support Postgres materialized views; MySQL connection metrics by @phillipleblanc in #311
• feat: Implement Python ODBC, MySQL, Postgres, Flight table providers by @crystalxyz in #281

New Contributors

• @crystalxyz made their first contribution in #264

Full Changelog: v0.3.0...v0.4.0

v0.3.0

What's Changed

• Update spiceai branch with latest changes by @phillipleblanc in #83
• DuckDB streaming by @y-f-u in #41
• fix: Disable federation in memory mode by @peasee in #86
• Add feature flag to disable postgres federation by @Sevenannn in #87
• SQLite: Validate expected indexes when attaching local datasets by @sgrebnov in #88
• SQLite: Validate expected primary keys when attaching local datasets by @sgrebnov in #89
• Change to use Spice AI fork of sea_query for SQLite decimal support by @phillipleblanc in #90
• fix: Don't silence blocking task errors by @peasee in #91
• fix: Re-attach databases on each DuckDB query by @peasee in #92
• Correctly handle mysql timestamp() and datetime() types by @Sevenannn in #96
• Postgres enum support by @Sevenannn in #100
• Fix SQLite Invalid column type Real error by @sgrebnov in #98
• Prevent SQLite from writing incomplete data on transition errors by @sgrebnov in #101
• DuckDBTableProviderFactory keeps track of opened instances by @phillipleblanc in #105
• Ignore CHECKPOINT errors for DuckDB by @phillipleblanc in #107
• Don't attempt to CHECKPOINT after writing to DuckDB by @phillipleblanc in #108
• SqliteTableProviderFactory keeps track of opened instances by @phillipleblanc in #109
• Support all time() types in MySQL by @Sevenannn in #97
• Upgrade to Arrow 53, DataFusion 42 and DuckDB 1.1 by @phillipleblanc in #111
• Handle inconsistent scale in Postgres Numeric Type data by @Sevenannn in #110
• Verify MySQL parameters and connections before creating connection pool by @Sevenannn in #113
• Propagate MySQL wrong table error by @Sevenannn in #114
• Fix MySQL timestamp type by @Sevenannn in #116
• Postgres should respect target decimal precision and scale by @sgrebnov in #120
• Update row -> arrow conversion for all MYSQL_TYPE_VAR_STRING and MYSQL_TYPE_STRING types by @Sevenannn in #118
• Use Decimal256 / Decimal128 for MySQL decimal type by @Sevenannn in #115
• Fix mysql blob & text types by @Sevenannn in #117
• Add sqlite_busytimeout parameter as user configurable param by @Sevenannn in #121
• Use arrow dictionary type for mysql enum type by @Sevenannn in #119
• Remove prefix for sqlite busy timeout param by @Sevenannn in #123
• Support parsing sqlite busy_timeout durations with units by @Sevenannn in #124
• Support retries when writing data to SQLite by @sgrebnov in #125
• Implement write retry for DuckDB by @Sevenannn in #128
• Preserve records batch order (update datafusion-federation) by @sgrebnov in #130
• fix: add ast analyzer for mysql rank by @peasee in #131
• fix: Remove NULLS FIRST/LAST in more MySQL Window functions by @peasee in #133
• Update datafusion-federation crate to include unnest support by @sgrebnov in #136
• Update datafusion-federation to the latest by @sgrebnov in #137
• Update datafusion-federation (improve filters pushdown) by @sgrebnov in #149
• tests: Ensure all tests run on PRs, try to fix flaky DuckDB test (#150) by @peasee in #152
• Implement native schema inference for PostgreSQL by @phillipleblanc in #151
• Fix DuckDB error messages by @phillipleblanc in #154
• SQLite: use projected schema when converting records by @sgrebnov in #158
• feat: Enable in-memory federation by @peasee in #159
• Always read TimezoneTZ from PostgreSQL as UTC by @phillipleblanc in #161
• fix: Prevent absolute sequences in file paths by @peasee in #160
• Remove restriction on file being in working directory by @phillipleblanc in #163
• Include unnecessary columns pruning step during federated plan creation by @sgrebnov in #162
• feat: add duckdb checks for unsupported column types by @peasee in #164
• fix: DuckDB boolean list support by @peasee in #169
• Upgrade to DataFusion 43 by @phillipleblanc in #167
• Use DuckDB Dialect and update Datafusion patch by @Sevenannn in #170
• Free up disk space for integration test by @Sevenannn in #171
• Fix MySQLConnection::get_schema for uppercase TableReference by @Jeadie in #166
• Fix MySQL timestamp conversion when running via MySQLSQLExec by @sgrebnov in #173
• Handle all MySQL Timestamp types as UTC time by @Sevenannn in #174
• Fix MySQL test by @Sevenannn in #181
• Fix MySQL errors by @Sevenannn in #180
• Further improve MySQL error to be concise and specific by @Sevenannn in #184
• Update DuckDB Error messages by @Sevenannn in #182
• Improve Postgres errors by @Sevenannn in #183
• Separate MySQL error source to separate line by @Sevenannn in #185
• refactor: update dbconnection errors by @peasee in #188
• Handle invalid data types for Postgres by @phillipleblanc in #191
• Fix writing to a Postgres table with a schema by @sgrebnov in #195
• Fix insert statement when all columns are constraint columns by @phillipleblanc in #196
• Fix writing to a Postgres table with a schema by @sgrebnov in #197
• Allow overriding the default DuckDB dialect by @sgrebnov in #201
• Fix DuckDBDialect creation according to DataFusion DuckDBDialect update by @sgrebnov in #202
• DuckDB: support for nested types in Lists (Struct, List, FixedSizeList) by @sgrebnov in #203
• Fix datafusion federation by @Sevenannn in...

v0.2.4

Major Features

• Added native schema inference support for PostgreSQL, allow empty tables to still be registered with their proper schema
• Introduced MySQL write support
• Added ODBC support with documentation in README
• Enhanced Flight protocol customization options
• Implemented Database Catalog Provider functionality

Database Improvements

PostgreSQL

• Added support for OID and NAME data types
• Expanded supported types from pg_catalog
• Implemented native schema inference

MySQL

• Added write support functionality
• Fixed Docker image configuration for PR tests

Dependencies

• Upgraded DataFusion to version 44.0.0

Testing & Stability

• Improved test infrastructure to ensure all tests run on PRs
• Addressed flaky test cases in DuckDB integration
• Optimized disk space usage for integration tests
• Enhanced PR test reliability by fixing MySQL Docker image configuration

Documentation

• Added ODBC usage documentation to README
• Simplified dependency management documentation

What's Changed

• Update geozero requirement from 0.13.0 to 0.14.0 by @dependabot in #140
• Update bollard requirement from 0.16.1 to 0.17.1 by @dependabot in #142
• tests: Ensure all tests run on PRs, try to fix flaky DuckDB test by @peasee in #150
• Implement native schema inference for PostgreSQL by @phillipleblanc in #153
• [flight] Enhanced customizability by @ccciudatu in #168
• Add DB CatalogProvider by @holicc in #175
• Update rstest requirement from 0.22.0 to 0.23.0 by @dependabot in #156
• Upgrade dafafusion to 43.0.0 by @holicc in #176
• Remove a flaky test case. by @holicc in #178
• Free up disk space for integration test by @phillipleblanc in #179
• feat: preliminary support odbc by @xhwhis in #177
• Add MySQL write support by @gengteng in #134
• add ODBC usage to README & simplify dependency management by @xhwhis in #189
• feat: support oid & name type for postgres by @xhwhis in #204
• feat: add some types from pg_catalog by @xhwhis in #216
• Fix MySQL docker image for PR tests by @phillipleblanc in #225
• chore: upgrade datafusion and and some other crates by @xhwhis in #219

New Contributors

• @dependabot made their first contribution in #140
• @holicc made their first contribution in #175
• @gengteng made their first contribution in #134

Full Changelog: v0.2.3...v0.2.4

v0.2.3

What's Changed

• Add note on federation in the README by @phillipleblanc in #132
• Create dependabot.yml by @lukekim in #135
• [Flight] Enable TLS for tonic 0.12 and make gRPC size limits configurable by @ccciudatu in #138
• fix tests by @ccciudatu in #144
• make the datafusion-federation dependency optional by @ccciudatu in #145
• [flight] make the enforce_schema function public by @ccciudatu in #147
• Implement Debug for SqlTable by @ccciudatu in #146
• [build] Add PR validation for flight by @ccciudatu in #148

New Contributors

• @lukekim made their first contribution in #135

Full Changelog: v0.2.2...v0.2.3