Add Indexes for Each Application in Elasticsearch for Better Log Filtering

[ayeshmcg]

Describe the task

To improve the log filtering process and enable better monitoring, we need to create separate indexes in Elasticsearch for each application (Backend, Registration frontend, Compliance frontend, Reporting frontend). This will allow us to organize logs more effectively and ensure more efficient search queries.

As of now:
We currently have a common values.yaml file from which the index is captured. Additionally, we have separate deployment files for each of the following pods:

• Reporting frontend
• Registration frontend
• Compliance frontend
• Backend pods

The goal is to ensure that each application’s logs are sent to its dedicated Elasticsearch index.

Acceptance Criteria

• Create a unique index for each application.
• Ensure that logs from Fluent Bit are correctly tagged and routed to the appropriate indexes.
• Update Kibana to reflect the new index structure.
• Verify that filtering in Kibana is working as expected.

Definition of Done

• first
• second
• third

Additional context

• Add any other context about the task here.
• Or here