Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
func: Limit number of columns in csv_extract (#23044)
This PR limits the absolute number of columns that can be extracted with `csv_extract` to 8192. Given the [maximum number of columns Postgres supports is 1600](https://www.postgresql.org/docs/current/limits.html), 8192 seems like a good limit. Currently we do limit the number of columns to just how much memory we can allocate, but this leads to issues like https://github.com/MaterializeInc/materialize/issues/22735, and realistically we should restrict the number of columns much more than just the number of column names we can fit in memory. ### Motivation Fixes https://github.com/MaterializeInc/materialize/issues/22735 ### Checklist - [ ] This PR has adequate test coverage / QA involvement has been duly considered. - [ ] This PR has an associated up-to-date [design doc](https://github.com/MaterializeInc/materialize/blob/main/doc/developer/design/README.md), is a design doc ([template](https://github.com/MaterializeInc/materialize/blob/main/doc/developer/design/00000000_template.md)), or is sufficiently small to not require a design. <!-- Reference the design in the description. --> - [ ] If this PR evolves [an existing `$T ⇔ Proto$T` mapping](https://github.com/MaterializeInc/materialize/blob/main/doc/developer/command-and-response-binary-encoding.md) (possibly in a backwards-incompatible way), then it is tagged with a `T-proto` label. - [ ] If this PR will require changes to cloud orchestration or tests, there is a companion cloud PR to account for those changes that is tagged with the release-blocker label ([example](MaterializeInc/cloud#5021)). <!-- Ask in #team-cloud on Slack if you need help preparing the cloud PR. --> - [x] This PR includes the following [user-facing behavior changes](https://github.com/MaterializeInc/materialize/blob/main/doc/developer/guide-changes.md#what-changes-require-a-release-note): - N/a
- Loading branch information