v0.14.1: Dependencies update

This is a dependency-updates-only release.

Changed

• Dependencies updated, notables:
  • Circe 0.10.x -> 0.11.x
  • scala-logging 3.8.x -> 3.9.x
  • JUnit 4.12 -> 4.13.x
  • SBT 1.6.x -> 1.7.x
  • sbt-assembly 0.14.x -> 0.15.x
  • sbt-buildinfo 0.9.x -> 0.11.x

v0.14.0: Spark DataFrameReader Fluent API support

Added

• ⭐ Spark DataFrameReader Fluent API support - you can define a "table" that will use spark.read.format(something).options(optionsMap).load(path) to load a DataFrame
• Documentation for Config Check functionality
• devex: You can generate test data with sbt generateTestData
• devex: Environment Setup instructions
• devex: Makefile with common tasks
• devex: We're actually using scalafmt now
• devex: We provide a Brewfile for consistent OS packages, Homebrew is the official source for OS packages for DV
• repo: We've got templates for feature requests and bug reports now

Changed

• Improved option parser
• Dependencies updated: Spark 2.3.1 -> 2.3.4, Circe YAML 0.9.x -> 0.10.x
• dev: We're now fully moved to GitHub Actions for build and release CI
  • dev: Dependabot will update our GitHub Actions
  • dev: Scala Steward will now ~automate our dependency updates

v0.13.2

This is another build system-focused release.

What's Changed

• Removes Artifactory configuration, explicitly publish to GHP by @colindean in #74

Full Changelog: v0.13.1...v0.13.2

v0.13.1

This is a build system-focused release as DV preps to ship binaries via GitHub Packages. This will be the first version released so.

What's Changed

• Updates sbt to 1.5.x by @colindean in #64
• Creates GitHub Actions CI configuration by @colindean in #65
• Use GHA release.published action instead of push.tags by @colindean in #73

Full Changelog: v0.13.0...v0.13.1

v0.13.0

Adds support for variable substitution for the minNumRows argument of the rowCount validator.

v0.12.1

Fix for #53

v0.12.0

Adds basic column statistics for numeric columns to JSON output:

• count
• min
• max
• mean
• std dev
• equi-width histogram

v0.11.1

see #43

columnSumCheck

Introduces columnSumCheck, see: https://github.com/target/data-validator/tree/master#columnsumcheck

stringRegexCheck

Introduces stringRegexCheck, see: https://github.com/target/data-validator#stringregexcheck and updates documentation.