Skip to content

Commit b159545

Browse files
authored
Merge pull request #1946 from fluent/lynettemiles/sc-136245/update-fluent-bit-docs-pipeline-outputs-kafka
2 parents 6eee081 + 9866b7f commit b159545

File tree

2 files changed

+25
-21
lines changed

2 files changed

+25
-21
lines changed

pipeline/outputs/kafka-rest-proxy.md

Lines changed: 23 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,40 +1,42 @@
1-
# Kafka REST Proxy
1+
# Kafka REST proxy
22

3-
The **kafka-rest** output plugin, allows to flush your records into a [Kafka REST Proxy](http://docs.confluent.io/current/kafka-rest/docs/index.html) server. The following instructions assumes that you have a fully operational Kafka REST Proxy and Kafka services running in your environment.
3+
The _Kafka rest_ (`kafka-rest`) output plugin lets you flush your records into a [Kafka REST Proxy](http://docs.confluent.io/current/kafka-rest/docs/index.html) server. The following instructions assume you have an operational Kafka REST Proxy and Kafka services running in your environment.
44

5-
## Configuration Parameters
5+
## Configuration parameters
6+
7+
This plugin supports the following parameters:
68

79
| Key | Description | default |
810
| :--- | :--- | :--- |
9-
| Host | IP address or hostname of the target Kafka REST Proxy server | 127.0.0.1 |
10-
| Port | TCP port of the target Kafka REST Proxy server | 8082 |
11-
| Topic | Set the Kafka topic | fluent-bit |
12-
| Partition | Set the partition number \(optional\) | |
13-
| Message\_Key | Set a message key \(optional\) | |
14-
| Time\_Key | The Time\_Key property defines the name of the field that holds the record timestamp. | @timestamp |
15-
| Time\_Key\_Format | Defines the format of the timestamp. | %Y-%m-%dT%H:%M:%S |
16-
| Include\_Tag\_Key | Append the Tag name to the final record. | Off |
17-
| Tag\_Key | If Include\_Tag\_Key is enabled, this property defines the key name for the tag. | \_flb-key |
18-
| Workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
11+
| `Host` | IP address or hostname of the target Kafka REST Proxy server. | `127.0.0.1` |
12+
| `Port` | TCP port of the target Kafka REST Proxy server. | `8082` |
13+
| `Topic` | Set the Kafka topic. | `fluent-bit` |
14+
| `Partition` | Optional. Set the partition number. | _none_ |
15+
| `Message_Key` | Optional. Set a message key. | _none_ |
16+
| `Time_Key` | The `Time_Key` property defines the name of the field that holds the record timestamp. | `@timestamp` |
17+
| `Time_Key_Format` | Defines the format of the timestamp. | `%Y-%m-%dT%H:%M:%S` |
18+
| `Include_Tag_Key` | Append the Tag name to the final record. | `Off` |
19+
| `Tag_Key` | If `Include_Tag_Key` is enabled, this property defines the key name for the tag. | `_flb-key` |
20+
| `Workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
1921

2022
### TLS / SSL
2123

2224
The Kafka REST Proxy output plugin supports TLS/SSL.
2325
For more details about the properties available and general configuration, see [TLS/SSL](../../administration/transport-security.md).
2426

25-
## Getting Started
27+
## Get started
2628

27-
In order to insert records into a Kafka REST Proxy service, you can run the plugin from the command line or through the configuration file:
29+
To insert records into a Kafka REST Proxy service, you can run the plugin from the command line or through the configuration file.
2830

29-
### Command Line
31+
### Command line
3032

31-
The **kafka-rest** plugin, can read the parameters from the command line in two ways, through the **-p** argument \(property\), e.g:
33+
The Kafka REST plugin can read the parameters from the command line through the `-p` argument (property):
3234

3335
```shell
3436
fluent-bit -i cpu -t cpu -o kafka-rest -p host=127.0.0.1 -p port=8082 -m '*'
3537
```
3638

37-
### Configuration File
39+
### Configuration file
3840

3941
In your main configuration file append the following:
4042

@@ -45,8 +47,8 @@ In your main configuration file append the following:
4547
pipeline:
4648
inputs:
4749
- name: cpu
48-
tag: cpu
49-
50+
tag: cpu
51+
5052
outputs:
5153
- name: kafka-rest
5254
match: '*'
@@ -74,4 +76,4 @@ pipeline:
7476
```
7577

7678
{% endtab %}
77-
{% endtabs %}
79+
{% endtabs %}

vale-styles/FluentBit/Headings.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,8 @@ exceptions:
5151
- gRPC
5252
- I
5353
- InfluxDB
54+
- Kafka
55+
- Kafka REST
5456
- Kinesis
5557
- Kubernetes
5658
- LaunchDarkly

0 commit comments

Comments
 (0)