Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adds Support for COPY TO/FROM Google Cloud Storage #61

Open
wants to merge 25 commits into
base: main
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
8553677
Adds support for COPY TO/FROM Azure Blob Storage
aykut-bozkurt Oct 23, 2024
f187bc4
Adds support for COPY TO/FROM Google Cloud Storage
aykut-bozkurt Oct 23, 2024
7664102
Merge branch 'main' into aykut/azure-blob-storage
aykut-bozkurt Dec 16, 2024
f1b7114
configure test endpoint via env var
aykut-bozkurt Dec 16, 2024
31f6701
merge
aykut-bozkurt Dec 16, 2024
4cb8eb1
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Dec 16, 2024
f3a31d0
no curl in fake-gcs
aykut-bozkurt Dec 16, 2024
0c65a3b
ci uri fix
aykut-bozkurt Dec 16, 2024
d76bf55
ci uri fix
aykut-bozkurt Dec 16, 2024
74df5b2
update readme
aykut-bozkurt Dec 16, 2024
841f5ec
Merge branch 'main' into aykut/azure-blob-storage
aykut-bozkurt Dec 24, 2024
a8df29d
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Dec 24, 2024
6102ba9
improve coverage
aykut-bozkurt Jan 3, 2025
3af0a78
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Jan 3, 2025
24ff523
support connection string
aykut-bozkurt Jan 6, 2025
5f19d59
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Jan 6, 2025
e0df256
support connection string
aykut-bozkurt Jan 6, 2025
dc181dd
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Jan 6, 2025
e9d0cdd
support connection string
aykut-bozkurt Jan 6, 2025
88080dd
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Jan 6, 2025
d5f5ef2
- support azure bearer token via client secret
aykut-bozkurt Jan 10, 2025
0016a3f
Merge branch 'aykut/azure-blob-storage' into aykut/google-cloud-storage
aykut-bozkurt Jan 10, 2025
5955d57
google config to pass to object store
aykut-bozkurt Jan 10, 2025
60103e7
Merge branch 'main' into aykut/google-cloud-storage
aykut-bozkurt Jan 10, 2025
dd3d157
fix ci for fake google storage server
aykut-bozkurt Jan 10, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
update readme
aykut-bozkurt committed Dec 16, 2024

Verified

This commit was signed with the committer’s verified signature.
steventux Steve Laing
commit 74df5b2f71305e45ac134b830c69d401cdd33513
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -156,7 +156,7 @@ SELECT uri, encode(key, 'escape') as key, encode(value, 'escape') as value FROM
```

## Object Store Support
`pg_parquet` supports reading and writing Parquet files from/to `S3` and `Azure Blob Storage` object stores.
`pg_parquet` supports reading and writing Parquet files from/to `S3`, `Azure Blob Storage` and `Google Cloud Service` object stores.

> [!NOTE]
> To be able to write into a object store location, you need to grant `parquet_object_store_write` role to your current postgres user.