-
Notifications
You must be signed in to change notification settings - Fork 0
Description
-- | -- | --
JSON schema for source texts | ✅ | SourceText dataclass
JSON schema for model outputs | ✅ | ModelOutput dataclass
JSON schema for evaluations | ✅ | EvaluationResult dataclass
JSON schema for tickets | ✅ | DevelopmentTicket dataclass
ARI scoring | ✅ | Works for EN + DE
LIX scoring | ✅ | Standard readability metric
Sentence metrics | ✅ | avg/max/pct_long
Meaning similarity | ✅ | sentence-transformers + TF-IDF fallback
Rule violation detection | ✅ | Passive, negations, length, intro text, XML
Verification test suite | ✅ | Based on prompt template examples
Feedback aggregation | ✅ | Summarizes patterns and recommendations
Ticket generation | ✅ | Auto-generates from findings
Complete pipeline | ✅ | FeedbackLoopPipeline class
Model configuration | ✅ | llama-3.1-8b-instant via Groq