feat(llmobs): ragas evaluation framework integration

[lievan]

Publicize the RAGAS integration

RAGAS is an evaluation framework for RAG Applications. The integration supports evaluating LLM inferences with three RAGAS metrics

• faithfulness
• answer relevancy
• context precision

Checklist

• PR author has checked that all the criteria below are met
• The PR description includes an overview of the change
• The PR description articulates the motivation for the change
• The change includes tests OR the PR description describes a testing strategy
• The PR description notes risks associated with the change, if any
• Newly-added code is easy to change
• The change follows the library release note guidelines
• The change includes or references documentation updates if necessary
• Backport labels are set (if applicable)

Reviewer Checklist

• Reviewer has checked that all the criteria below are met
• Title is accurate
• All changes are related to the pull request's stated goal
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Newly-added code is easy to change
• Release note makes sense to a user of the library
• If necessary, author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[github-actions]

CODEOWNERS have been resolved as:

releasenotes/notes/ragas-integration-a81b696757c0e7a5.yaml              @DataDog/apm-python
ddtrace/llmobs/_evaluators/runner.py                                    @DataDog/ml-observability
ddtrace/llmobs/_evaluators/sampler.py                                   @DataDog/ml-observability
tests/llmobs/test_llmobs_evaluator_runner.py                            @DataDog/ml-observability
tests/llmobs/test_llmobs_ragas_evaluators.py                            @DataDog/ml-observability
tests/llmobs/test_llmobs_service.py                                     @DataDog/ml-observability

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: evan.li/release-ragas
Commit report: f642a1c
Test service: dd-trace-py

✅ 0 Failed, 130 Passed, 1468 Skipped, 4m 46.34s Total duration (29m 10.85s time saved)

[pr-commenter]

Benchmarks

Benchmark execution time: 2025-01-21 21:10:20

Comparing candidate commit 5415c24 in PR branch evan.li/release-ragas with baseline commit 0003501 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 394 metrics, 2 unstable metrics.

[sabrenner]

lgtm!

[vitor-de-araujo]

For these variables we have a declared constant, but for _DD_LLMOBS_EVALUATORS we use the string name directly. Should we make it more consistent?

[vitor-de-araujo]

The release notes are not Markdown, they are reStructuredText. See e.g. here for an example of the link syntax.