Skip to content

Commit

Permalink
evaluation workshop updates
Browse files Browse the repository at this point in the history
  • Loading branch information
@aprilspeight
aprilspeight committed Jan 17, 2025
1 parent 6d2375a commit 5bf8c4c
Show file tree
Hide file tree
Showing 6 changed files with 21 additions and 9 deletions.
4 changes: 3 additions & 1 deletion Evaluation and Data Generation Workshop/evaluate-custom-evaluator.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,8 @@
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**.\n",
"\n",
"The **OpenAI API version** is available in the [API version lifecycle](https://learn.microsoft.com/azure/ai-services/openai/api-version-deprecation#latest-ga-api-release) document."
]
},
Expand All @@ -74,7 +76,7 @@
"source": [
"os.environ['AZURE_OPENAI_ENDPOINT'] = 'Your Azure OpenAI endpoint'\n",
"os.environ['AZURE_OPENAI_API_KEY'] = 'Your Azure OpenAI API key'\n",
"os.environ['AZURE_DEPLOYMENT'] = 'Your Azure deployment'\n",
"os.environ['AZURE_DEPLOYMENT'] = 'Your model deployment name'\n",
"os.environ['OPENAI_API_VERSION'] = 'API version'"
]
},
Expand Down
4 changes: 3 additions & 1 deletion Evaluation and Data Generation Workshop/evaluate-performance-quality.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,9 @@
"- Azure OpenAI API Key\n",
"- Azure deployment\n",
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment."
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**."
]
},
{
Expand Down
2 changes: 1 addition & 1 deletion Evaluation and Data Generation Workshop/evaluate-risk-safety.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@
"- Resource group name\n",
"- Subscription ID\n",
"\n",
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project.\n"
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project (at the very bottom of the navigation menu).\n"
]
},
{
Expand Down
6 changes: 4 additions & 2 deletions Evaluation and Data Generation Workshop/evaluate-synthetic-data.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,8 @@
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Deployments** and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**.\n",
"\n",
"The name of your Azure deployment is provided on the Deployment page.\n",
"\n",
"The **Azure OpenAI API** version is available within the [Latest GA API Release](https://learn.microsoft.com/azure/ai-services/openai/api-version-deprecation#latest-ga-api-release) article."
Expand All @@ -81,7 +83,7 @@
"source": [
"os.environ['AZURE_OPENAI_ENDPOINT'] = 'Your OpenAI endpoint'\n",
"os.environ['AZURE_OPENAI_API_KEY'] = 'Your OpenAI API key'\n",
"os.environ['AZURE_OPENAI_DEPLOYMENT'] = 'Your deployment'\n",
"os.environ['AZURE_OPENAI_DEPLOYMENT'] = 'Your deployment name'\n",
"os.environ['OPENAI_API_VERSION'] = 'The Azure OpenAI API version'"
]
},
Expand Down Expand Up @@ -342,7 +344,7 @@
"- Resource group name\n",
"- Subscription ID\n",
"\n",
"Each value can be found within [Azure AI Studio](https://ai.azure.com) by navigating to your project and viewing the **Project overview** page. If you select the link to your subscription, you'll be taken to the [Azure portal](https://portal.azure.com) which displays your subscription ID."
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project (at the very bottom of the navigation menu)."
]
},
{
Expand Down
4 changes: 4 additions & 0 deletions Evaluation and Data Generation Workshop/evaluate-target.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,8 @@
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**.\n",
"\n",
"The **OpenAI API version** is available in the [API version lifecycle](https://learn.microsoft.com/azure/ai-services/openai/api-version-deprecation#latest-ga-api-release) document.\n",
"\n",
"Open the `askwiki.py` file and set the following environment variables:\n",
Expand Down Expand Up @@ -112,6 +114,8 @@
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**.\n",
"\n",
"The **OpenAI API version** is available in the [API version lifecycle](https://learn.microsoft.com/azure/ai-services/openai/api-version-deprecation#latest-ga-api-release) document."
]
},
Expand Down
10 changes: 6 additions & 4 deletions Evaluation and Data Generation Workshop/evaluate-track-results.ipynb
View file
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@
"\n",
"**Resource Group and Subscription ID**\n",
"\n",
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project.\n",
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project (at the very bottom of the navigation menu).\n",
"\n",
"**User ID**\n",
"\n",
Expand Down Expand Up @@ -108,7 +108,9 @@
"- Azure OpenAI API Key\n",
"- Azure deployment\n",
"\n",
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment."
"You can locate your **Azure OpenAI endpoint** and **Azure OpenAI API Key** by navigating to **Models + endpoints**, selecting the model, and copying the respective credentials for your model deployment.\n",
"\n",
"**Note**: The **Target URI** is the **Azure OpenAI endpoint**."
]
},
{
Expand All @@ -119,7 +121,7 @@
"source": [
"os.environ['AZURE_OPENAI_ENDPOINT'] = 'Your OpenAI endpoint'\n",
"os.environ['AZURE_OPENAI_API_KEY'] = 'Your OpenAI API key'\n",
"os.environ['AZURE_OPENAI_DEPLOYMENT'] = 'Your Azure OpenAI API key'"
"os.environ['AZURE_OPENAI_DEPLOYMENT'] = 'Your model deployment name'"
]
},
{
Expand Down Expand Up @@ -161,7 +163,7 @@
"- Resource group name\n",
"- Subscription ID\n",
"\n",
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project.\n",
"Each value can be found within the **Management center** for your project, located in [Azure AI Foundry](https://ai.azure.com). The **Management center** page is accessible via the left navigation menu of your project (at the very bottom of the navigation menu).\n",
"\n",
"Let's first create environment variables for the variables listed above.\n"
]
Expand Down

0 comments on commit 5bf8c4c

Please sign in to comment.