forked from trinodb/trino
-
Notifications
You must be signed in to change notification settings - Fork 8
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'snowflake' into bloomberg-snowflake
- Loading branch information
Showing
114 changed files
with
164 additions
and
3 deletions.
There are no files selected for viewing
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
Empty file.
Empty file.
Empty file.
Empty file modified
0
core/trino-main/src/main/resources/webapp/vendor/bootstrap/config.json
100755 → 100644
Empty file.
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,47 @@ | ||
********** | ||
Connectors | ||
********** | ||
|
||
This chapter describes the connectors available in Trino to access data | ||
from different data sources. | ||
|
||
.. toctree:: | ||
:maxdepth: 1 | ||
|
||
Accumulo <connector/accumulo> | ||
Atop <connector/atop> | ||
BigQuery <connector/bigquery> | ||
Black Hole <connector/blackhole> | ||
Cassandra <connector/cassandra> | ||
ClickHouse <connector/clickhouse> | ||
Delta Lake <connector/delta-lake> | ||
Druid <connector/druid> | ||
Elasticsearch <connector/elasticsearch> | ||
Google Sheets <connector/googlesheets> | ||
Hive <connector/hive> | ||
Hudi <connector/hudi> | ||
Iceberg <connector/iceberg> | ||
Ignite <connector/ignite> | ||
JMX <connector/jmx> | ||
Kafka <connector/kafka> | ||
Kinesis <connector/kinesis> | ||
Kudu <connector/kudu> | ||
Local File <connector/localfile> | ||
MariaDB <connector/mariadb> | ||
Memory <connector/memory> | ||
MongoDB <connector/mongodb> | ||
MySQL <connector/mysql> | ||
Oracle <connector/oracle> | ||
Phoenix <connector/phoenix> | ||
Pinot <connector/pinot> | ||
PostgreSQL <connector/postgresql> | ||
Prometheus <connector/prometheus> | ||
Redis <connector/redis> | ||
Redshift <connector/redshift> | ||
SingleStore <connector/memsql> | ||
Snowflake <connector/snowflake> | ||
SQL Server <connector/sqlserver> | ||
System <connector/system> | ||
Thrift <connector/thrift> | ||
TPCDS <connector/tpcds> | ||
TPCH <connector/tpch> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,107 @@ | ||
=================== | ||
Snowflake connector | ||
=================== | ||
|
||
.. raw:: html | ||
|
||
<img src="../_static/img/snowflake.png" class="connector-logo"> | ||
|
||
The Snowflake connector allows querying and creating tables in an | ||
external `Snowflake <https://www.snowflake.com/>`_ account. This can be used to join data between | ||
different systems like Snowflake and Hive, or between two different | ||
Snowflake accounts. | ||
|
||
Configuration | ||
------------- | ||
|
||
To configure the Snowflake connector, create a catalog properties file | ||
in ``etc/catalog`` named, for example, ``example.properties``, to | ||
mount the Snowflake connector as the ``snowflake`` catalog. | ||
Create the file with the following contents, replacing the | ||
connection properties as appropriate for your setup: | ||
|
||
.. code-block:: none | ||
connector.name=snowflake | ||
connection-url=jdbc:snowflake://<account>.snowflakecomputing.com | ||
connection-user=root | ||
connection-password=secret | ||
snowflake.account=account | ||
snowflake.database=database | ||
snowflake.role=role | ||
snowflake.warehouse=warehouse | ||
Arrow serialization support | ||
^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
|
||
This is an experimental feature which introduces support for using Apache Arrow | ||
as the serialization format when reading from Snowflake. Please note there are | ||
a few caveats: | ||
|
||
* Using Apache Arrow serialization is disabled by default. In order to enable | ||
it, add ``--add-opens=java.base/java.nio=ALL-UNNAMED`` to the Trino | ||
:ref:`jvm-config`. | ||
|
||
|
||
Multiple Snowflake databases or accounts | ||
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
|
||
The Snowflake connector can only access a single database within | ||
a Snowflake account. Thus, if you have multiple Snowflake databases, | ||
or want to connect to multiple Snowflake accounts, you must configure | ||
multiple instances of the Snowflake connector. | ||
|
||
.. snowflake-type-mapping: | ||
Type mapping | ||
------------ | ||
|
||
Trino supports the following Snowflake data types: | ||
|
||
================================== =============================== | ||
Snowflake Type Trino Type | ||
================================== =============================== | ||
``boolean`` ``boolean`` | ||
``tinyint`` ``bigint`` | ||
``smallint`` ``bigint`` | ||
``byteint`` ``bigint`` | ||
``int`` ``bigint`` | ||
``integer`` ``bigint`` | ||
``bigint`` ``bigint`` | ||
``float`` ``real`` | ||
``real`` ``real`` | ||
``double`` ``double`` | ||
``decimal`` ``decimal(P,S)`` | ||
``varchar(n)`` ``varchar(n)`` | ||
``char(n)`` ``varchar(n)`` | ||
``binary(n)`` ``varbinary`` | ||
``varbinary`` ``varbinary`` | ||
``date`` ``date`` | ||
``time`` ``time`` | ||
``timestampntz`` ``timestamp`` | ||
``timestamptz`` ``timestampTZ`` | ||
``timestampltz`` ``timestampTZ`` | ||
================================== =============================== | ||
|
||
Complete list of `Snowflake data types | ||
<https://docs.snowflake.com/en/sql-reference/intro-summary-data-types.html>`_. | ||
|
||
.. _snowflake-sql-support: | ||
|
||
SQL support | ||
----------- | ||
|
||
The connector provides read access and write access to data and metadata in | ||
a Snowflake database. In addition to the :ref:`globally available | ||
<sql-globally-available>` and :ref:`read operation <sql-read-operations>` | ||
statements, the connector supports the following features: | ||
|
||
* :doc:`/sql/insert` | ||
* :doc:`/sql/delete` | ||
* :doc:`/sql/truncate` | ||
* :doc:`/sql/create-table` | ||
* :doc:`/sql/create-table-as` | ||
* :doc:`/sql/drop-table` | ||
* :doc:`/sql/alter-table` | ||
* :doc:`/sql/create-schema` | ||
* :doc:`/sql/drop-schema` |
Empty file modified
0
lib/trino-parquet/src/main/java/io/trino/parquet/DataPageV1.java
100755 → 100644
Empty file.
Empty file.
Empty file modified
0
plugin/trino-hive-hadoop2/bin/run_hive_abfs_access_key_tests.sh
100755 → 100644
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file.
Empty file modified
0
plugin/trino-hive/src/test/resources/containers/hive_hadoop/hadoop-run.sh
100755 → 100644
Empty file.
Empty file modified
0
...st/resources/with_short_zone_id/data/part-00000-cab83205-643e-4b22-9846-54395fde4199-c000
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduClientConfig.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduColumnHandle.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduConnector.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduConnectorFactory.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduMetadata.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduModule.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduPlugin.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduRecordCursor.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduRecordSet.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduRecordSetProvider.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduSplit.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduSplitManager.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduTableHandle.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-kudu/src/main/java/io/trino/plugin/kudu/KuduTransactionHandle.java
100755 → 100644
Empty file.
Empty file.
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/ForPinot.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotColumnHandle.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotConfig.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotConnector.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotConnectorFactory.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotErrorCode.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotException.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotMetadata.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotModule.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotNodePartitioningProvider.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotPageSourceProvider.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotPlugin.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotSegmentPageSource.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotSessionProperties.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotSplit.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotSplitManager.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotTableHandle.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/PinotTransactionHandle.java
100755 → 100644
Empty file.
Empty file modified
0
...a/io/trino/plugin/pinot/auth/password/inline/PinotPasswordBrokerAuthenticationConfig.java
100755 → 100644
Empty file.
Empty file modified
0
.../trino/plugin/pinot/auth/password/inline/PinotPasswordControllerAuthenticationConfig.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/client/PinotClient.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/DynamicTable.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/DynamicTableBuilder.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/DynamicTablePqlExtractor.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/OrderByExpression.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/PinotQueryBuilder.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/main/java/io/trino/plugin/pinot/query/PinotQueryInfo.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/MetadataUtil.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/MockPinotClient.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/PinotQueryRunner.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestDynamicTable.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotClient.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotColumnHandle.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotConfig.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotMetadata.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotQueryBase.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotSessionProperties.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotSplitManager.java
100755 → 100644
Empty file.
Empty file modified
0
plugin/trino-pinot/src/test/java/io/trino/plugin/pinot/TestPinotTableHandle.java
100755 → 100644
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -35,4 +35,4 @@ protected SqlExecutor onRemoteDatabase() | |
{ | ||
return server::execute; | ||
} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -74,4 +74,4 @@ public void close() | |
{ | ||
execute("DROP SCHEMA IF EXISTS tpch"); | ||
} | ||
} | ||
} |
Empty file.
Empty file modified
0
testing/trino-benchto-benchmarks/generate_schemas/generate-tpcds.py
100755 → 100644
Empty file.
Empty file modified
0
testing/trino-benchto-benchmarks/generate_schemas/generate-tpch.py
100755 → 100644
Empty file.
Empty file.
Empty file modified
0
...er/src/main/resources/docker/presto-product-tests/common/hadoop/apply-config-overrides.sh
100755 → 100644
Empty file.
Empty file modified
0
...tests-launcher/src/main/resources/docker/presto-product-tests/common/hadoop/hadoop-run.sh
100755 → 100644
Empty file.
Empty file modified
0
...ain/resources/docker/presto-product-tests/common/hydra-identity-provider/cert/generate.sh
100755 → 100644
Empty file.
Empty file modified
0
...ources/docker/presto-product-tests/conf/environment/multinode-azure/apply-azure-config.sh
100755 → 100644
Empty file.
Empty file modified
0
.../resources/docker/presto-product-tests/conf/environment/multinode-gcs/apply-gcs-config.sh
100755 → 100644
Empty file.
Empty file modified
0
.../docker/presto-product-tests/conf/environment/multinode-kafka-ssl/secrets/create-certs.sh
100755 → 100644
Empty file.
Empty file modified
0
...es/docker/presto-product-tests/conf/environment/singlenode-hive-acid/apply-hive-config.sh
100755 → 100644
Empty file.
Empty file modified
0
.../presto-product-tests/conf/environment/singlenode-oauth2-https-proxy/cert/create-certs.sh
100755 → 100644
Empty file.
Empty file modified
0
...s/conf/environment/singlenode-spark-iceberg-jdbc-catalog/apply-hive-config-for-iceberg.sh
100755 → 100644
Empty file.
Empty file modified
0
...-product-tests/conf/environment/singlenode-spark-iceberg/apply-hive-config-for-iceberg.sh
100755 → 100644
Empty file.
Empty file modified
0
.../presto-product-tests/conf/environment/two-kerberos-hives/hadoop-master-2-copy-keytabs.sh
100755 → 100644
Empty file.
Empty file modified
0
...er/presto-product-tests/conf/environment/two-kerberos-hives/hadoop-master-copy-keytabs.sh
100755 → 100644
Empty file.
Empty file modified
0
...ncher/src/main/resources/docker/presto-product-tests/health-checks/hadoop-health-check.sh
100755 → 100644
Empty file.
Empty file modified
0
...uncher/src/main/resources/docker/presto-product-tests/health-checks/trino-health-check.sh
100755 → 100644
Empty file.
Empty file modified
0
...trino-product-tests-launcher/src/main/resources/docker/presto-product-tests/run-presto.sh
100755 → 100644
Empty file.
Empty file modified
0
testing/trino-test-jdbc-compatibility-old-driver/bin/run_tests.sh
100755 → 100644
Empty file.