Use Kubernetes metadata

[omerlh]

Fluentd has plugin that extract metadata from Kubernetes (pod name, labels, etc) and enrich the record with this metadata. This can be useful for this plugin for multiple features:

• Dynamic API key. Currently, there is need to define a match for each different pod, so it will use a different API key. Using the metadata, the API key can be read from Kubernetes label.
• Log enrichment: Add all the metadata as userCustomData.
• Exception: Use labels to find the exception field on the logs and read it.
• Version: Use labels to read the version of the app

What do you think? Is this should be part of the plugin?

[UberMouse]

Hi @omerlh,

This sounds like it would be very valuable functionality. We would want to make it conditional so that people not using Kubernetes can choose not to use it. Do you have any example code for this or is this something you are interested in looking into?

Since we don't use either Kubernetes or FluentD in-house it will require some set up for us to get started on this feature so I'm not sure what ETA this would have but I'm sure we could start on it sometime in the not too distant future.

Thanks for bringing this plugin to our attention.

Regards,
Taylor

[omerlh]

Hey Taylor,
Thanks for getting back to me. You can check this plugin, which use labels to get the minimum log levels.