out_es: add apikey to available auth types #10461
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Allow for using an API key as an authentication type to elastic. Signed-off-by: Todd Kennedy <[email protected]>
tkennedy1-godaddy
force-pushed
the
outputs_elasticsearch_add_api_key
branch
from
dd20b37 to
d3510d5
Compare
ensure new field is available Signed-off-by: Todd Kennedy <[email protected]>
|
Configuration: service:
flush: 1
daemon: off
log_level: debug
pipeline:
inputs:
- name: forward
unix_path: /tmp/fluent.sock
tag: log
outputs:
- name: es
match: "*"
host: [ES HOST]
port: [ES PORT]
index: fluent-bit-test-10
http_api_key: [base 64 encoded key]
suppress_type_name: true
trace_error: true
trace_output: true
tls: trueResponse from debug log talking to elastic server: {
"errors": false,
"took": 0,
"items": [
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "gLJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 8,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "gbJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 9,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "grJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 10,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "g7J_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 11,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "hLJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"f=ailed": 0
},
"_seq_no": 12,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "hbJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 13,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "hrJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 14,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "h7J_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 15,
"_primary_term": 1,
"status": 201
}
},
{
"create": {
"_index": "fluent-bit-test-10",
"_id": "iLJ_YZcBuX40YbMfktq3",
"_version": 1,
"result": "created",
"_shards": {
"total": 2,
"successful": 2,
"failed": 0
},
"_seq_no": 16,
"_primary_term": 1,
"status": 201
}
}
]
}Full debug log: Valgrind details: |
tkennedy1-godaddy
requested review from
PettitWesley,
edsiper,
leonardo-albertovich,
fujimotos and
koleini
as code owners
|
Is there anything I can do to get this merged? I'd like to not have to use a fork of fluent-bit and username/password auth is difficult to manage from a secrets rotation perspective in elastic. |
|
Not to necro again, but Is there any way to get movement on this? |
|
Hi @tkennedy1-godaddy Thank you for adding this functionality. Hopefully, it gets reviewed soon. This is much-needed functionality. |
|
This would be exceptionally helpful for my large customers! |
|
Any chance this makes the cut for the next release? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Allow for using an API key as an authentication type to elastic.
Enter
[N/A]in the box, if an item is not applicable to your change.Testing
Before we can approve your change; please submit the following in a comment:
If this is a change to packaging of containers or native binaries then please confirm it works for all targets.
ok-package-testlabel to test for all targets (requires maintainer to do).Documentation
fluent/fluent-bit-docs#1727
Backporting
Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.