Search results

answer_correctness fails with OutputParserException: expected "text" but got "statements"`

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2162 In explodinggradients/ragas;

· harshil-sanghvi opened on Aug 12, 2025

Is there an metric to measure the alignment between the Retrieved Contexts and the ground truth?

module-metricsthis is part of metrics modulethis is part of metrics module

questionFurther information is requestedFurther information is requested

Status: Open.

#2126 In explodinggradients/ragas;

· rookiedali opened on Jul 21, 2025

Getting always 0 in agent evaluation with Agent Goal accuracy

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

questionFurther information is requestedFurther information is requested

Status: Open.

#2122 In explodinggradients/ragas;

· divyamuralidharan-ai opened on Jul 18, 2025

The output answer is the same as the reference answer, and the blue score has always been 0

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

questionFurther information is requestedFurther information is requested

Status: Open.

#2101 In explodinggradients/ragas;

· LillyChen opened on Jul 4, 2025

Answer_relevance value negative issue.

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2088 In explodinggradients/ragas;

· InhyeH opened on Jun 23, 2025

ToolCallAccuracy returns score higher than 1.0

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2079 In explodinggradients/ragas;

· mpanasiuk-suplari opened on Jun 16, 2025

difrences in LLM responces.

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2075 In explodinggradients/ragas;

· Sdegraauw opened on Jun 13, 2025

Gemini model 2.0-flash structured output

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2073 In explodinggradients/ragas;

· ramirolc02 opened on Jun 10, 2025

AspectCritic not working with openai o3

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2067 In explodinggradients/ragas;

· taborzbislaw opened on Jun 9, 2025

How to accelerate evaluate when using vLLM engine

module-metricsthis is part of metrics modulethis is part of metrics module

questionFurther information is requestedFurther information is requested

Status: Open.

#2058 In explodinggradients/ragas;

· MaximeSongIdris opened on May 28, 2025

<code>evaluate</code> supporting replicates

enhancementNew feature or requestNew feature or request

module-metricsthis is part of metrics modulethis is part of metrics module

Status: Open.

#2052 In explodinggradients/ragas;

· jamesbraza opened on May 21, 2025

question about src.ragas.metrics._nv_metrics.ContextRelevance._single_turn_ascore

bugSomething isn't workingSomething isn't working

module-metricsthis is part of metrics modulethis is part of metrics module

questionFurther information is requestedFurther information is requested

Status: Open.

#2051 In explodinggradients/ragas;

· zjt148680 opened on May 20, 2025