sync with open source how #118
Draft
+702,461
−204,063
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Updated the python dependencies * skip pd.array checks * minor updates * remove the skip and it seems flaky
A dynamic race condition detector correct identifies an unsynchronized read-after-write between the field initializer and the first call of onNext. Additionally a minor refactor to make more clear what the increment/boundary conditions are here.
* replace Optional.nullable with if check * ActiveWorkState: Replace AtomicReference with mutex, critical path accessing activeGetWorkBudget is already under mutex * WindmillTimerInternals: Remove ExposedByteArrayOutputStream from timerTag() * Override hashcode() in ShardingKey * Override hashcode() in WindmillComputationKey
* Prevent setup python environment for java:container:distroless * Revert workflow changes * Fix defaultDockerImageName * Remove sdks:java:container basis
* small iceberg improvements * remove duplicate cache query
Co-authored-by: lostluck <[email protected]>
Transforms defined in a provider in YAML are now expanded in context, which means in particular that they can reference other transforms (including themselves) that have been exported.
…o reduce contention between harness threads (#33731)
Multiple assignments can be racily collapsed causing the verification to block.
* [Release] Add 2.63.0 to Beam Website * add lineage metrics fix * correct date on blog post * fix 2.62.0 download links
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.17.61 to 1.17.62. - [Release notes](https://github.com/aws/aws-sdk-go-v2/releases) - [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/changelog-template.json) - [Commits](aws/aws-sdk-go-v2@feature/s3/manager/v1.17.61...feature/s3/manager/v1.17.62) --- updated-dependencies: - dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.220.0 to 0.221.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](googleapis/google-api-go-client@v0.220.0...v0.221.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [github.com/nats-io/nats.go](https://github.com/nats-io/nats.go) from 1.38.0 to 1.39.0. - [Release notes](https://github.com/nats-io/nats.go/releases) - [Commits](nats-io/nats.go@v1.38.0...v1.39.0) --- updated-dependencies: - dependency-name: github.com/nats-io/nats.go dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Change prediction in AnomalyResult to predictions which is now an iterable of AnomalyPrediction. * Add mean, stdev and quantile trackers with tests. * Add docstrings * Fix lints * Make trackers specifiable. Also includes minor fixes on Specifiable and univariate perf tests. * Adjust class structures in trackers. Minor fix per feedback.
Bumps [github.com/spf13/cobra](https://github.com/spf13/cobra) from 1.8.1 to 1.9.1. - [Release notes](https://github.com/spf13/cobra/releases) - [Commits](spf13/cobra@v1.8.1...v1.9.1) --- updated-dependencies: - dependency-name: github.com/spf13/cobra dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…underlying type instead of types.Alias (#33868)
* add endpoint type to WorkerMetadataResponse proto * add default value to endpoint_type
* Add UUID support in Spanner Schema * Add test
… control window (#34035)
* Add histogram parsing in runner v2 * address comments --------- Co-authored-by: Naireen <[email protected]>
* Refactor to use a immutablemap for fast mapping
* sdks/go: require type registration in BigQueryIO * sdks/go: test type register is required BigQueryIO * sdks/go: panic with clear err msg if already init * sdks/go: panic only if type not registered Co-authored-by: Danny McCormick <[email protected]>"
* Fix Spotless PreCommit * Fix existing spotless
* Refactor mobilegaming groovy scripts * Add retry policy
* Update slf4j version * Remove slf4j from arrow dependency exclusion. * Fix two test failures due to upgrade slf4j-jdk14 to 2.x The class path of slf4j has been changed from org/slf4j/impl to org/slf4j/jul. Two failed tests: - :runners:google-cloud-dataflow-java:worker:validateShadedJarContainsSlf4jJdk14 - :runners:google-cloud-dataflow-java:worker:validateShadedJarDoesntLeakNonProjectClasses * Fixed another four failed tests. The failed tests are under org.apache.beam.runners.dataflow.worker.HotKeyLoggerTest * Bump the default spark version from 3.2.2 to 3.5.0. The previous version has a compile dependency on slf4j 1.x binding, which would no longer work with slf4j 2.x. * Add used but not declared deps for spark 3.5.0 * Temporary modify spark version to 3.x in sparkreceiver. * Fix failed spark tests. * A better workaround for Spark 3.2.x * Take out the add-opens for tests as they were only run in java 8 and 11. * Mention changes in CHANGES.md * Update comments * Move sparkReceiver/2 to sparkreceiver/3 that supports Spark 3.x. * Minor fix on cdap spark dependency
* Fix Java GCP-IO Direct job * Created constants for fixed numbers * Fix comments and constants * Changed Log type * add more flaky test fixes * changes
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please add a meaningful description for your change here
Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:
addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, commentfixes #<ISSUE NUMBER>instead.CHANGES.mdwith noteworthy changes.See the Contributor Guide for more tips on how to make review process smoother.
To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md
GitHub Actions Tests Status (on master branch)
See CI.md for more information about GitHub Actions CI.