harmonized and removed typos in prompts in testset generation

src/ragas/testset/prompts.py

@@ -3,24 +3,26 @@
 SEED_QUESTION = HumanMessagePromptTemplate.from_template(
     """\
 Your task is to formulate a question from given context satisfying the rules given below:
-    1.The question should make sense to humans even when read without the given context.
-    2.The question should be fully answered from the given context.
-    3.The question should be framed from a part of context that contains important information. It can also be from tables,code,etc.
-    4.The answer to the question should not contain any links.
-    5.The question should be of moderate difficulty.
-    6.The question must be reasonable and must be understood and responded by humans.
-    7.Do no use phrases like 'provided context',etc in the question
-    8.Avoid framing question using word "and" that can be decomposed into more than one question.
-    9.The question should not contain more than 10 words, make of use of abbreviation wherever possible.
+    1. The question should make sense to humans even when read without the given context.
+    2. The question should be fully answered from the given context.
+    3. The question should be framed from a part of context that contains important information. It can also be from tables, code, etc.
+    4. The answer to the question should not contain any links.
+    5. The question should be of moderate difficulty.
+    6. The question must be reasonable and must be understood and responded by humans.
+    7. Do no use phrases like 'provided context' etc in the question.
+    8. Avoid framing question using word "and" that can be decomposed into more than one question.
+    9. The question should not contain more than 10 words, make of use of abbreviation wherever possible.
 
-context:{context}
+context:\n{context}
+
+question:
 """  # noqa: E501
 )
 
 
 REASONING_QUESTION = HumanMessagePromptTemplate.from_template(
     """\
-You are a prompt rewriter. You will be provided with a question and a long context.Your task to is to complicate the given question to improve the difficulty of answering. 
+You are a prompt rewriter. You will be provided with a question and a long context. Your task to is to complicate the given question to improve the difficulty of answering. 
 You should do complicate the question by rewriting question into a multi-hop reasoning question based on the provided context. The question should require the reader to make multiple logical connections or inferences using the information available in given context. 
 Here are some strategies to create multi-hop questions:
 
@@ -38,9 +40,8 @@
 3. Make sure the question is clear and unambiguous. 
 4. phrases like 'based on the provided context','according to the context',etc are not allowed to appear in the question.
 
-question: {question}
-CONTEXTS:
-{context}
+question:\n{question}
+context:\n{context}
 
 Multi-hop Reasoning Question:
 """  # noqa: E501
@@ -55,11 +56,12 @@
     2. The rewritten question must be reasonable and must be understood and responded by humans.
     3. The rewritten question must be fully answerable from information present in context1 and context2. 
     4. Read and understand both contexts and rewrite the question so that answering requires insight from both context1 and context2.
-    5. phrases like 'based on the provided context','according to the context?',etc are not allowed to appear in the question.
+    5. phrases like 'based on the provided context', 'according to the context?' etc are not allowed to appear in the question.
 
 question:\n{question}
 context1:\n{context1}
 context2:\n{context2}
+more complicated question:
 """  # noqa: E501
 )
 
@@ -72,14 +74,14 @@
     1. The rewritten question should not be longer than 25 words. Use abbreviation wherever possible.
     2. The rewritten question must be reasonable and must be understood and responded by humans.
     3. The rewritten question must be fully answerable from information present context.
-    4. phrases like 'provided context','according to the context?',etc are not allowed to appear in the question.
-for example,
+    4. phrases like 'provided context','according to the context?', etc are not allowed to appear in the question.
+For example:
 question: What are the general principles for designing prompts in LLMs?
-Rewritten Question:how to apply prompt designing principles to improve LLMs performance in reasoning tasks
+rewritten question: How to apply prompt designing principles to improve LLMs performance in reasoning tasks?
 
-question:{question}
+question:\n{question}
 context:\n{context}
-Rewritten Question
+rewritten question:
 """  # noqa: E501
 )
 
@@ -88,8 +90,8 @@
     """\
 Rewrite the following question to make it more indirect and shorter while retaining the essence of the original question. The goal is to create a question that conveys the same meaning but in a less direct manner.
 The rewritten question should shorter so use abbreviation wherever possible.
-Original Question:
-{question}
+
+original question:\n{question}
 
 Indirectly Rewritten Question:
 """  # noqa: E501
@@ -101,7 +103,8 @@
 Reformat the provided question into two separate questions as if it were to be part of a conversation. Each question should focus on a specific aspect or subtopic related to the original question.
 question: What are the advantages and disadvantages of remote work?
 Reformatted Questions for Conversation: What are the benefits of remote work?\nOn the flip side, what challenges are encountered when working remotely?
-question:{question}
+
+question:\b{question}
 
 Reformatted Questions for Conversation:
 """  # noqa: E501
@@ -111,37 +114,44 @@
     """Evaluate the provided context and assign a numerical score between 0 and 10 based on the following criteria:
 1. Award a high score to context that thoroughly delves into and explains concepts.
 2. Assign a lower score to context that contains excessive references, acknowledgments, external links, personal information, or other non-essential elements.
-Output the score only.
-Context:
-{context}
-Score:
+Output the numerical score only.
+
+Context:\n{context}
+
+Numerical score:
 """  # noqa: E501
 )
 
 FILTER_QUESTION = HumanMessagePromptTemplate.from_template(
     """\
-Determine if the given question can be clearly understood even when presented without any additional context. Specify reason and verdict is a valid json format.
+Determine if the given question can be clearly understood even when presented without any additional context. Return reason and verdict in a valid json format.
+The verdict is always either "Yes" or "No".
+
+For example:
 question: What is the keyword that best describes the paper's focus in natural language understanding tasks?
-{{"reason":"The specific paper being referred to is not mentioned in the question.", "verdict": "No"}}
-question:{question}
+{{"reason": "The specific paper being referred to is not mentioned in the question. The question can therefore not be understood without additional context.", "verdict": "No"}}
+
+question: {question}
 """  # noqa: E501
 )
 
 
 ANSWER_FORMULATE = HumanMessagePromptTemplate.from_template(
     """\
 Answer the question using the information from the given context. 
-question:{question}
-context:{context}
+question: {question}
+context: {context}
 answer:
 """  # noqa: E501
 )
 
 CONTEXT_FORMULATE = HumanMessagePromptTemplate.from_template(
-    """Please extract relevant sentences from the provided context that can potentially help answer the following question. While extracting candidate sentences you're not allowed to make any changes to sentences from given context.
+    """\
+Please extract relevant sentences from the provided context that can potentially help answer the following question.\ 
+While extracting candidate sentences you're not allowed to make any changes to sentences from given context.
 
-question:{question}
+question:\n{question}
 context:\n{context}
-candidate sentences:\n
+candidate sentences:
 """  # noqa: E501
 )