Skip to content

Commit

Permalink
docs: update summarization calculation (#1510)
Browse files Browse the repository at this point in the history
There is mismatch how coeff is used in docs vs actual computation.

Related code is in:

https://github.com/explodinggradients/ragas/blob/889fe2b9181baf203ca96fa876a54c7d80989767/src/ragas/metrics/_summarization.py#L189

![Screenshot 2024-10-15 at 17 29
16](https://github.com/user-attachments/assets/3d987aaf-656f-4e10-ba84-1ee0bc2fa44a)

Co-authored-by: Jakub Kanitra <[email protected]>
  • Loading branch information
jCobbSK and Jakub Kanitra authored Oct 16, 2024
1 parent 8e41fe3 commit efdda3f
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,8 @@ We also provide a coefficient `coeff`(default value 0.5) to control the weightag
The final summarization score is then calculated as:

$$
\text{Summarization Score} = \text{QA score}*\text{coeff} + \\
\text{conciseness score}*\text{(1-coeff)}
\text{Summarization Score} = \text{QA score}*\text{(1-coeff)} + \\
\text{conciseness score}*\text{coeff}
$$

## Example
Expand Down

0 comments on commit efdda3f

Please sign in to comment.