Skip to content

Commit 596287f

Browse files
committed
feat: add doris output plugin
Signed-off-by: composer <[email protected]>
1 parent 4a1cf44 commit 596287f

File tree

7 files changed

+36
-0
lines changed

7 files changed

+36
-0
lines changed

.gitbook.yaml

+1
Original file line numberDiff line numberDiff line change
@@ -56,6 +56,7 @@ redirects:
5656
output/chronicle: ./pipeline/outputs/chronicle.md
5757
output/cloudwatch: ./pipeline/outputs/cloudwatch.md
5858
output/datadog: ./pipeline/outputs/datadog.md
59+
output/doris: ./pipeline/outputs/doris.md
5960
output/es: ./pipeline/outputs/elasticsearch.md
6061
output/fabric: ./pipeline/outputs/azure_kusto.md
6162
output/file: ./pipeline/outputs/file.md

SUMMARY.md

+1
Original file line numberDiff line numberDiff line change
@@ -170,6 +170,7 @@
170170
* [Azure Logs Ingestion API](pipeline/outputs/azure_logs_ingestion.md)
171171
* [Counter](pipeline/outputs/counter.md)
172172
* [Datadog](pipeline/outputs/datadog.md)
173+
* [Doris](pipeline/outputs/doris.md)
173174
* [Elasticsearch](pipeline/outputs/elasticsearch.md)
174175
* [File](pipeline/outputs/file.md)
175176
* [FlowCounter](pipeline/outputs/flowcounter.md)

administration/configuring-fluent-bit/README.md

+1
Original file line numberDiff line numberDiff line change
@@ -100,6 +100,7 @@ Outputs
100100
bigquery Send events to BigQuery via streaming insert
101101
counter Records counter
102102
datadog Send events to DataDog HTTP Event Collector
103+
doris Apache Doris
103104
es Elasticsearch
104105
exit Exit after a number of flushes (test purposes)
105106
file Generate log file

administration/transport-security.md

+1
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ The following **output** plugins can take advantage of the TLS feature:
3232
* [Azure Logs Ingestion API](../pipeline/outputs/azure_logs_ingestion.md)
3333
* [BigQuery](../pipeline/outputs/bigquery.md)
3434
* [Datadog](../pipeline/outputs/datadog.md)
35+
* [Doris](../pipeline/outputs/doris.md)
3536
* [Elasticsearch](../pipeline/outputs/elasticsearch.md)
3637
* [Forward](../pipeline/outputs/forward.md)
3738
* [GELF](../pipeline/outputs/gelf.md)

installation/sources/build-and-install.md

+1
Original file line numberDiff line numberDiff line change
@@ -188,6 +188,7 @@ The _output plugins_ gives the capacity to flush the information to some externa
188188
| [FLB\_OUT\_COUNTER](../../pipeline/outputs/counter.md) | Enable Counter output plugin | On |
189189
| [FLB\_OUT\_CLOUDWATCH\_LOGS](../../pipeline/outputs/cloudwatch.md) | Enable Amazon CloudWatch output plugin | On |
190190
| [FLB\_OUT\_DATADOG](../../pipeline/outputs/datadog.md) | Enable Datadog output plugin | On |
191+
| [FLB\_OUT|_DORIS](../../pipeline/outputs/doris.md) | Enable Apache Doris output plugin | On |
191192
| [FLB\_OUT\_ES](../../pipeline/outputs/elasticsearch.md) | Enable [Elastic Search](http://www.elastic.co) output plugin | On |
192193
| [FLB\_OUT\_FILE](../../pipeline/outputs/file.md) | Enable File output plugin | On |
193194
| [FLB\_OUT\_KINESIS\_FIREHOSE](../../pipeline/outputs/firehose.md) | Enable Amazon Kinesis Data Firehose output plugin | On |

pipeline/outputs/doris.md

+30
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
---
2+
description: Send logs to Apache Doris
3+
---
4+
5+
# Apache Doris
6+
7+
The **doris** output plugin lets you ingest your records into an
8+
[Apache Doris](https://doris.apache.org) database. To use this plugin, you must have an
9+
operational Doris service running in your environment.
10+
11+
## Configuration Parameters
12+
13+
| Key | Description | Default |
14+
| :--- | :--- | :--- |
15+
| `host` | HTTP address of the target Doris fe or be | `127.0.0.1` |
16+
| `port` | HTTP port of the target Doris fe or be | `8300` |
17+
| `user` | Username for Doris access | _none_ |
18+
| `password` | Password for Doris access | _none_ |
19+
| `database` | The target Doris database | _none_ |
20+
| `table` | The target Doris table | _none_ |
21+
| `time_key` | The name of the time key in the output record | `date` |
22+
| `columns` | The column mappings, details in [Doris stream load](https://doris.apache.org/docs/data-operate/import/import-way/stream-load-manual) | `date, log` |
23+
| `timeout_second` | Timeout seconds for Doris stream load | `60` |
24+
| `Workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `2` |
25+
26+
### TLS / SSL
27+
28+
Doris output plugin supports TLS/SSL. For more details about the properties
29+
available and general configuration, refer to[TLS/SSL](../../administration/transport-security.md).
30+

vale-styles/FluentBit/Spelling-exceptions.txt

+1
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ deprovisioning
3535
deprovisions
3636
Devo
3737
DogStatsD
38+
Doris
3839
downsample
3940
downsampled
4041
downsamples

0 commit comments

Comments
 (0)