Releases: aml-org/amf
5.7.0
Java 21 support
Dependency Changes
- Moved to Scala 2.12.20
- Moved to SBT 1.10.4
- ScalaJS 1.17.0
Behavior Changes
- Unified REGEX validation between JVM and JS: now ScalaJS exports the Java Regex library. JS Regex works the same as Java ones.
What's Changed
- W-10548463: [OAS 3.1] add ref summary and description by @arielmirra in #2072
- W-17016391: Update sonarQube credentials for sfdc sonar by @damianpedra in #2073
- W-17142856 - parameter validation missing range by @leochalub in #2074
- W-14887298: fix domain extensions component id encoding by @arielmirra in #2075
- W-10548497 - LicenseObject - New facet 'identifier' and exclusive fields validation by @leochalub in #2076
- W-10548498 - InfoObject - New facet summary by @leochalub in #2077
- W-14661042 - Java21 support related changes by @looseale in #2078
- W-14661042 - Commenting NexusIQ step after Java21 bump. Pending to fix by @looseale in #2079
Full Changelog: 5.6.4...5.7.0
5.6.4
What's Changed
- W-16343554: make avro record fields required + insert unresolved shapes in invalid avro types by @arielmirra in #2059
- W-16899246 - ES Type extensions by @looseale in #2060
- W-17005476 - Fix cache pipelines with wrong id by @looseale in #2061
- W-10548506: add OAS 3.1 basic support by @arielmirra in #2062
- W-16993090: fix OAS component $ref parsing by @arielmirra in #2063
- W-10548506: add Oas31 to oas matchers in configurations and tests by @arielmirra in #2064
- W-10548504: WebAPI - New facet webhooks by @leochalub in #2065
- W-10548462: add annotations support in OAS3.1 discriminator by @arielmirra in #2067
New Contributors
- @leochalub made their first contribution in #2065
Full Changelog: 5.6.3...5.6.4
5.6.3
What's Changed
- W-16847560: use the same json schema version mapping in raml and oas by @arielmirra in #2052
- W-16712475 - Added parsing option allowing to parse extensions in eve… by @looseale in #2053
- W-16930843 - Some dependency bumps by @looseale in #2054
- W-16888404: change parameter description parsing and bump model by @arielmirra in #2055
Full Changelog: 5.6.2...5.6.3
5.6.2
Bug fixing
- Fixed bug in avro validation related with inner union schemas with default values
What's Changed
- Release 5.6.1 to develop by @looseale in #2046
- W-16772136 - Minor changes in Avro ADR due last library changes (naming) by @looseale in #2047
- W-16837997 - Avro union fixes by @looseale in #2048
- Publish 5.6.2 by @looseale in #2049
Full Changelog: 5.6.1...5.6.2
What's new in AMF 5.6.1
AVRO Support in AMF
We're happy to announce we've added support for AVRO Schema 1.9.0 in AMF:
- as a standalone document
- inside Async APIs
an AVRO Schema has the following properties:
- It's defined in a
.json
or.avsc
file - It doesn't have a special key that indicates it's an AVRO Schema, nor it's version (like JSON Schema does with it's
$schema
)
Where we support and DON'T support AVRO Schemas
We Support AVRO Schemas (inline or inside a $ref
):
- as a standalone document or file
- we encourage users to use the
.avsc
file type to indicate that's an avro file - must use the specific
AvroConfiguration
- we encourage users to use the
- inside a message payload in an AsyncAPI
- the key
schemaFormat
MUST be declared and specify it's an AVRO payload
- the key
- an
AvroSchemaDocument
can only be parsed with the specificAvroConfiguration
We don't support AVRO Schemas:
- inside components --> schemas in an AsyncAPI
- because we can't determine if it's an AVRO Schema or any other schema
Known AVRO Validation limitations
We're using the Apache official libraries for JVM and JS. The validation libraries differ in interfaces and implementations, and each has some known constraints:
JVM avro validation constraints
- validation per se is not supported, we try to parse an avro schema and throw parsing results if there are any
- this means it's difficult to have location of where the error is thrown, we may give an approximate location from our end post-validation
- when a validation is thrown, the rest of the file is not being searched for more validations
- this is particularly important in large avro schemas, where many errors can be found but only one is shown
Both JVM & JS validation constraints
"default"
values are not being validated when the type isbytes
,map
, orarray
- the validator treats as invalid an empty array as the default value for arrays (
"default": []
) even though the Avro Schema Specification has some examples with it - if an avro record has a field that is a union that includes the root record itself (recursive reference) we fail to validate it correctly because we treat that shape as an unresolved/undefined shape. This only applies to the field inside the record, when validating the complete record the library validates correctly. In the future we'll try to ignore the cases that we are now failing and/or show a warning instead
More information here
for more information on how to use AVRO in amf check the adrs/0014-avro-support.md
file.
Full Changelog: 5.5.4...5.6.1
What's new in AMF 5.6.0
AVRO Support in AMF
We're happy to announce we've added support for AVRO Schema 1.9.0 in AMF:
- as a standalone document
- inside Async APIs
an AVRO Schema has the following properties:
- It's defined in a
.json
or.avsc
file - It doesn't have a special key that indicates it's an AVRO Schema, nor it's version (like JSON Schema does with it's
$schema
)
Where we support and DON'T support AVRO Schemas
We Support AVRO Schemas (inline or inside a $ref
):
- as a standalone document or file
- we encourage users to use the
.avsc
file type to indicate that's an avro file - must use the specific
AvroConfiguration
- we encourage users to use the
- inside a message payload in an AsyncAPI
- the key
schemaFormat
MUST be declared and specify it's an AVRO payload
- the key
- an
AvroSchemaDocument
can only be parsed with the specificAvroConfiguration
We don't support AVRO Schemas:
- inside components --> schemas in an AsyncAPI
- because we can't determine if it's an AVRO Schema or any other schema
Known AVRO Validation limitations
We're using the Apache official libraries for JVM and JS. The validation libraries differ in interfaces and implementations, and each has some known constraints:
JVM avro validation constraints
- validation per se is not supported, we try to parse an avro schema and throw parsing results if there are any
- this means it's difficult to have location of where the error is thrown, we may give an approximate location from our end post-validation
- when a validation is thrown, the rest of the file is not being searched for more validations
- this is particularly important in large avro schemas, where many errors can be found but only one is shown
Both JVM & JS validation constraints
"default"
values are not being validated when the type isbytes
,map
, orarray
- the validator treats as invalid an empty array as the default value for arrays (
"default": []
) even though the Avro Schema Specification has some examples with it - if an avro record has a field that is a union that includes the root record itself (recursive reference) we fail to validate it correctly because we treat that shape as an unresolved/undefined shape. This only applies to the field inside the record, when validating the complete record the library validates correctly. In the future we'll try to ignore the cases that we are now failing and/or show a warning instead
More information here
for more information on how to use AVRO in amf check the adrs/0014-avro-support.md
file.
Full Changelog: 5.5.4...5.6.0
5.5.4
AVRO transformation and rendering support (ALPHA)
In the previous release we added support for AVRO parsing, which means creating an AvroConfiguration
with an AvroParsePlugin
and with that create a BaseUnitClient
that has the parse()
method that parses an AVRO Schema and returns an AvroSchemaDocument
.
This release, we've added support for the transform()
and render()
methods, letting the user resolve the model and export it to .jsonld
or to .json
again.
To do this, we've created the AvroRenderPlugin
and added it to the AvroConfiguration
as well as the necessary transformation pipelines. Now the AVRO Configuration is much more complete and looks like this:
object AvroConfiguration extends APIConfigurationBuilder {
def Avro(): AMFConfiguration = {
common()
.withPlugins(List(AvroParsePlugin, AvroRenderPlugin))
.withTransformationPipelines(
List(
AvroSchemaTransformationPipeline(),
AvroSchemaEditingPipeline(),
AvroSchemaCachePipeline()
)
)
}
}
We're expecting to continue this growth and launch AVRO Validation in the next release, will keep you updated.
For more information about transformation and rendering check the following documentation:
What's Changed
- W-16124325 -Avro interfaces by @looseale in #2015
- release/5.5.3 to develop by @looseale in #2018
- W-16006973: add AVRO ADR by @arielmirra in #2019
- W-16006973: add avro-schema annotation on collections (items/values) parsing by @arielmirra in #2020
- W-16006973: add avro annotations by @arielmirra in #2021
- W-16246407 - Fix handle of method string kind by @looseale in #2022
- W-15633231: add AVRO basic resolution pipelines by @arielmirra in #2023
- W-15633198: add AVRO emission by @arielmirra in #2024
- W-15633239 - AvroSchemaDocument ref handle by @looseale in #2025
- W-15633231: add avro transformation pipelines and tests by @arielmirra in #2026
- W-16346159: fix parsing avro record field without a type defined by @arielmirra in #2027
- W-16346159: AVRO fixes by @arielmirra in #2028
Full Changelog: 5.5.3...5.5.4
5.5.3
AVRO Support (ALPHA)
AVRO Schema Support in Async
Added support to parsing of AVRO Schemas in Async 2.x payload definitions (inlined or referencing to an external file).
This support is currently limited, only for parsing, not for validation or emission.
AVRO Schema Fragment
Added support to parsing of AVRO Schemas as a fragment using the new AvroConfiguration
, returning an AvroSchemaDocument
. This is only for AVRO Schema files parsed using this specific configuration, files referenced from an Async 2.x API will be processed as ExternalFragment
as usual.
This support is currently limited, only for parsing, not for validation or emission.
What's Changed
- W-15770660 Publish 5.5.2 dev by @damianpedra in #2004
- W-15847817. Minor performance improvements by @jisoldi in #2001
- W-15847817. Golden files regenerated after some order changes in annotations. by @jisoldi in #2005
- W-15904614 - Some Lexical fixes by @looseale in #2008
- W-15633176: add initial AVRO Schema parsing by @arielmirra in #2009
- W-15633176: fix record fields parsing by @arielmirra in #2011
- W-15633213: Add TCK for avro schemas by @damianpedra in #2013
- W-16124325 - Avro interfaces by @looseale in #2014
- W-16124325 - Publish 5.5.3 by @looseale in #2016
- W-16124325 - Publish 5.5.3 by @looseale in #2017
Full Changelog: 5.5.2...5.5.3
5.5.2
What's Changed
This release finished the support for multiple binding versions, enhancing the flexibility and compatibility of our platform. The new bindings include updates for Solace, Kafka, AMQP, HTTP.
In the spec, by default if not present, the version of the binding is the latest. We chosen to ignore this behavior, because it could lead to a broken AsyncAPI contract when a new version of the binding is introduced. Instead of that. This approach prevents breaking changes for users relying on the latest versions. By defaulting to these versions, we maintain consistency and ensure that essential fields are supported without introducing unexpected incompatibilities.
Default Binding Versions
The default binding versions have been selected to ensure stability:
-
Solace:
- async 2.0 to async 2.6 default version is 0.3.0
-
AMQP:
- async 2.0 to async 2.6 default version is 0.2.0
-
HTTP and GooglePubSub:
- async 2.0 to async 2.6 default version is 0.1.0
-
MQTT:
- async 2.0 to async 2.6 default version is 0.1.0
-
AnypointMQ:
- async 2.0 to async 2.6 default version is 0.0.1
-
Kafka Bindings version:
- KafkaOperationBinding and KafkaMessageBinding
- Async 2.0 default version is 0.1.0
- KafkaOperationBinding and KafkaMessageBinding
- Async 2.1 to 2.6 the default version is 0.3.0
- KafkaServerBinding and KafkaChannelBinding
- Async 2.1 to 2.6 the default version is 0.3.0
- KafkaOperationBinding and KafkaMessageBinding
-
Pulsar:
- Async 2.0 to async 2.6 default version is 0.1.0
-
Mercure:
- Async 2.0 to async 2.6 default version is 0.1.0
-
W-15425041: release-fix: remove '.' in fields id and displayNames by @arielmirra in #1983
-
W-15696514: change amqp binding default version to 0.2.0 by @arielmirra in #1990
-
W-15570769: fix oas components unresolved ref violations by @arielmirra in #1988
-
W-15425041: support HTTP binding versions 0.1.0, 0.2.0, and 0.3.0 by @arielmirra in #1987
-
W-15425034: add google binding version 010 & 020 by @arielmirra in #1996
-
W-15425058: add mqtt version 010 & 020 by @arielmirra in #1997
-
W-15425062: Add support for Solace Binding Versioning by @damianpedra in #1982
-
W-15425058: fix solace operation topic by @arielmirra in #1998
-
W-15845362 - Fixed some missing matches with new Async 2.x Specs by @looseale in #1999
-
W-15643510-fix default version fon bindings by @damianpedra in #2000
Full Changelog: 5.5.1...5.5.2
5.5.1
What's Changed
- W-14931280: add complete asyncApi for 2.1 and 2.2 fixing syntax by @damianpedra in #1957
- W-14931493: Fix from Spec by @looseale in #1959
- W-14931280: Add Reolution test for new stages by @damianpedra in #1960
- W-15092041: Bump model version to 3.9.0 by @looseale in #1963
- W-15092041: Adding typings related to Async 2.x by @looseale in #1965
- W-15092041: fix ibmmq validations false negatives by @arielmirra in #1968
- W-15510077: Some fixes detected in async 2.x by @looseale in #1973
- W-15053193: Simple modification of methods AmfUpdaterIterator.hasNext and AmfUpdaterIterator.next to be tailrecursive. by @jisoldi in #1975
- W-15425021: Amqp binding versioning 0.1.0-0.3.0 by @arielmirra in #1974
- W-15520216: Fix asyncApi-2.x-all examples by @looseale in #1976
- W-15425021: Add AnypointMQ Binding to support references by @damianpedra in #1978
- W-15425051: support kafka 0.1.0, 0.2.0 and 0.3.0 by @arielmirra in #1979
- W-15555945: Fix SYAML conversion using casting with handling by @looseale in #1980
- W-15425051: support kafka binding 0.5.0 by @arielmirra in #1981
- W-15378866: remove '.' in fields id and displayNames by @damianpedra in #1984
Full Changelog: 5.5.0...5.5.1