Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tracking ticket for data format validation in tremor #2131

Open
darach opened this issue Dec 13, 2022 · 3 comments
Open

Tracking ticket for data format validation in tremor #2131

darach opened this issue Dec 13, 2022 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@darach
Copy link
Member

darach commented Dec 13, 2022

Describe the problem you are trying to solve

As tremor is data format agnostic we currently do not have features that support validation
against a particular external format outside of builtin support in serialization and deserialization
libraries.

So data that is parsable or well formed can be transported by tremor.

For some environments validation support would be preferable:

  • A connector receiving json data wishes to conform to avro or json-schema
  • A json codec that only accepts valid data given a schema of some description
  • Functions/operators in tremor's processing DSL that support validation

This ticket is a tracking ticket to gauge interest and what kind of support would
be desirable in tremor - for what use case - and for what purpose.

Describe the solution you'd like
Please add your use case and preferred solution here dear readers!

Notes

This is a tracking ticket to capture interest in possible future enhancements to tremor. If you found this
ticket and would like data format validation support, please comment accordingly so we have a record of interest!

@darach darach added the enhancement New feature or request label Dec 13, 2022
@scudellari
Copy link

I'll take a stab at this

@darach
Copy link
Member Author

darach commented Feb 9, 2023

Let us know if you need any help on the discord 🥳

@Licenser
Copy link
Member

Licenser commented Oct 9, 2023

#2351 will ave avro and integration with the kafka schema registry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants