Skip to content

Commit 7c7a74d

Browse files
[FLINK-38496][docs] Icerberg YAML sink requires extra Hadoop jar to run (#4153)
1 parent e0e0931 commit 7c7a74d

File tree

2 files changed

+37
-0
lines changed
  • docs
    • content.zh/docs/connectors/pipeline-connectors
    • content/docs/connectors/pipeline-connectors

2 files changed

+37
-0
lines changed

docs/content.zh/docs/connectors/pipeline-connectors/iceberg.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -62,6 +62,24 @@ pipeline:
6262
name: MySQL to Iceberg Pipeline
6363
parallelism: 2
6464
```
65+
***Note:***
66+
If `catalog.properties.type` is hadoop, you need to configure the following dependencies manually, and pass it with `--jar` argument of Flink CDC CLI when submitting YAML pipeline jobs.
67+
<div class="wy-table-responsive">
68+
<table class="colwidths-auto docutils">
69+
<thead>
70+
<tr>
71+
<th class="text-left">Dependency Item</th>
72+
<th class="text-left">Description</th>
73+
</tr>
74+
</thead>
75+
<tbody>
76+
<tr>
77+
<td><a href="https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-hadoop-2-uber/2.8.3-10.0 "> org.apache.flink:flink-shaded-hadoop-2-uber:2.8.3-10.0</a></td>
78+
<td>Used for Hadoop dependencies.</td>
79+
</tr>
80+
</tbody>
81+
</table>
82+
</div>
6583

6684
Pipeline Connector Options
6785
----------------

docs/content/docs/connectors/pipeline-connectors/iceberg.md

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,25 @@ pipeline:
6363
parallelism: 2
6464
```
6565
66+
***Note:***
67+
If `catalog.properties.type` is hadoop, you need to configure the following dependencies manually, and pass it with `--jar` argument of Flink CDC CLI when submitting YAML pipeline jobs.
68+
<div class="wy-table-responsive">
69+
<table class="colwidths-auto docutils">
70+
<thead>
71+
<tr>
72+
<th class="text-left">Dependency Item</th>
73+
<th class="text-left">Description</th>
74+
</tr>
75+
</thead>
76+
<tbody>
77+
<tr>
78+
<td><a href="https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-hadoop-2-uber/2.8.3-10.0 "> org.apache.flink:flink-shaded-hadoop-2-uber:2.8.3-10.0</a></td>
79+
<td>Used for Hadoop dependencies.</td>
80+
</tr>
81+
</tbody>
82+
</table>
83+
</div>
84+
6685
Pipeline Connector Options
6786
----------------
6887
<div class="highlight">

0 commit comments

Comments
 (0)