[EPIC] Logs Improvements

[ankitnayan]

Bugs

• LOGS[BE]: JSON search results in empty results. #5619
• Bug in fields in query builder (explorer page) when switching panels #4826
• Color logs are supported partially, still missing in some views #4139
• [LOGS] Index on body is not working. #4259
• LOGS[FE]: Key DataType not respected and DataType not shown for materialised columns #5150
• LOGS[FE]: Logs context load more button doesn't update id in request payload #5062
• LOGS [FE]: Escape characters are not rendered just removed/replaced #4148
• LOGS[BE]: Index not utilized when wrtiing contains queries for attribute #5406
• attribute collision in the logs explorer page  #5645
• Incorrect histogram count and timerange shown in the histogram chart #5450
• https://github.com/SigNoz/engineering-pod/issues/1486

Features

• Improvements in logs explorer - to show more log lines #5169
• LOGS: Update histogram to show logs by severity #4727
• Group by field option in the attributes of a log detail view #5479
• [Logs] Ability to apply filters quickly #3536
• Automatically map the level to severity text from parsed logs #5245
• Move parsing for default otel fields like traceID and spanID from saas internal config to pipelines #3886
• Better usability of json in logs data #5478
• https://github.com/SigNoz/engineering-pod/issues/1300
• How to give the best UX for plain body logs #5620
• Support for more types in attributes #5008
• Logs explorer - in simple search view add transparency similar to query builder view #4564
• Highlight searched value in logs  #2366
• LOGS[FE]: New page for incontext logs. #4100
• [Logs] New page for log indices. #3063
• Ability to add OR operator in the where clause of QB #5484

---

• Should add sorting index for source in logs #2189
• Easy select of timeline in logs like we have in Services dashboard #2555
• Logs in Context: Showing X lines number doesn't change if more lines are shown #4067
• allow parsing at query time for logs #2829
• Cheaper price for latest data without indexing for long term. Helps to enable more logs to debug an issue at cheaper costs. Eg, $0.1/GB for 15 mins of data #5381
• Support more sources of logs in OSS and Cloud #3685
• Schema for filtering by type of resource attributes #5009
• Log Level indicator should be based on severity number if severity text is of an unknown type #4970
• LOGS[BE]: Automatic index suggestion and optimisation service #4849
• LOGS[FE]: Use selected column/attribute as pinned attributes. #4577
• Detect patterns in logs #3690
• Enable logs deduplication #3689
• https://github.com/SigNoz/engineering-pod/issues/1514
• Enable Transactions OR log group joining #3688
• Metrics to Logs correlation - Going from metrics graphs in services pages to Logs explorer #1798
• https://github.com/SigNoz/engineering-pod/issues/855
• https://github.com/SigNoz/engineering-pod/issues/1217
• LOGS[FE/UI]: Allow resizing of columns  #5088
• [EPIC] Query builder improvements #3617
• Query builder user interaction improvements #5208
• LOGS[FE]: Add instrumentation scope support. #5442
• Improve QB search performance #5543
• LOGS[FE]: Use = instead of in in attribute filtering #5597

Usability

• Keyboard compatibility #5384
• Move CTAs for share and Old Explorer elsewhere #5502
• Default logs view should be close to default logs reading from stdout/console/terminal #4115
• The logs detail or json view of a log should be near to what users see in console exporter of otel collector or sdks #5480
• Logs body not scrollable #3692
• Filtering body in logs doesn't work with white space tabs #3445
• Logs detail UX:- when body is large it takes up a lot of unnecessary space. #3302
• Nudge user to materialise frequently used attributes #2768
• Selected and Interesting fields becoming unmanageable #2188
• Should auto-refresh option in logs page be disabled? #1796
• Test sending logs from lambda to SigNoz #1791
• https://github.com/SigNoz/engineering-pod/issues/1205

Pipelines

• [Epic] Log Parsing Pipeline Issues  #3791

[YounixM]

#3513 - In Review

[ankitnayan]

#5619

[vikrantgupta25]

https://github.com/SigNoz/engineering-pod/issues/1655

[vikrantgupta25]

#5502