Add benchmark harness to tests and tooling

[imDarshanGK]

Improve the tests and tooling with benchmark harness.

Acceptance criteria:

• Implement the change in the tests and tooling.
• Add or update tests, docs, or validation for the touched path.

[prasiddhi-105]

Hiii can u please assign this issue to me!!!

[arcgod-design]

Hi @imDarshanGK! I'd love to work on this as part of SSoC 2026 👋

My Approach:

• Set up a benchmark harness in the tests and tooling that measures performance of key operations (e.g., config loading, query processing, embedding retrieval)
• Integrate with the existing test runner so benchmarks can be run alongside unit tests or separately
• Output clear metrics (time, memory) with baseline comparisons for regressions
• Follow the existing patterns for tests and tooling in the repo

Could you please assign this to me (@arcgod-design)? Thank you!