v0.37.0

v0.37.0 (2024-04-29)

Highlights

• You can reference your streams with glob patterns in stream map configuration:

  stream_maps:
    # This will affect all streams with names starting with 'my_prefix_'
    "my_prefix_*":
      id: id
      first_name: first_name
      email:     # drop the PII field from RECORD and SCHEMA messages
      email_domain: email.split('@')[-1]
      email_hash: md5(config['hash_seed'] + email)
      __else__: null

✨ New

• #2389 JSON schema keyword allOf is now supported
• #1888 Added support for glob patterns in source stream names -- Thanks @DouweM!
• #2345 PropertiesList can now behave as an iterable -- Thanks @ReubenFrankel!

🐛 Fixes

• #2352 Removed unnecessary and problematic column caching -- Thanks @raulbonet!
• #2375 Added sensitive: true to password settings in templates
• #2301 Unmapped sub-fields in object-type fields are now no longer dropped when the field declares additionalProperties
• #2348 Added a condition to the No schema for record field warning -- Thanks @tobiascadee!
• #2342 Avoid failing if VSCode IDE config is not requested for target and mapper cookiecutter templates -- Thanks @ReubenFrankel!
• #2331 Allow importlib-resources >=6.3.2

⚙️ Under the Hood

• #2205 Added a jwt package extra, but the cryptography and jwt dependencies are still installed by default for now

📚 Documentation Improvements

• #2326 Documented BATCH as a default plugin capability -- Thanks @ReubenFrankel!