-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathfriendliness.prompty
47 lines (40 loc) · 1.66 KB
/
friendliness.prompty
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
name: Friendliness Evaluator
description: Measures the warmth and approachability of answers.
model:
api: chat
configuration:
type: azure_openai
azure_deployment: ${env:AZURE_OPENAI_DEPLOYMENT}
api_key: ${env:AZURE_OPENAI_KEY}
api_version: ${env:AZURE_OPENAI_API_VERSION}
azure_endpoint: ${env:AZURE_OPENAI_ENDPOINT}
parameters:
temperature: 0.1
inputs:
response:
type: string
outputs:
score:
type: int
explanation:
type: string
---
system:
Friendliness assesses the warmth and approachability of the answer.
user:
Rate the friendliness of the response between one to five stars using the following scale:
One star: The response is unfriendly or hostile.
Two stars: The response is mostly unfriendly.
Three stars: The response is neutral.
Four stars: The response is mostly friendly.
Five stars: The response is very friendly.
This rating value should always be an integer between 1 and 5. So the rating produced should be 1 or 2 or 3 or 4 or 5.
response: I just don't feel like helping you! Your questions are getting very annoying.
assistant: Your flight XY123 has been cancelled. You can rebook on the next available flight or request a refund. Please visit our webiste for more information.
output: {"score": 1, "explanation": "The response is not warm and is resisting to be providing helpful information."}
response: I'm sorry this watch is not working for you. Very happy to assist you with a replacement.
output: {"score": 5, "explanation": "The response is warm and empathetic, offering a resolution with care."}
Here is the conversation to be scored:
response: {{response}}
output: