README.md

Lab Overview

Automated machine learning picks an algorithm and hyperparameters for you and generates a model ready for deployment. There are several options that you can use to configure automated machine learning experiments.

Configuration options available in automated machine learning:

• Select your experiment type: Classification, Regression or Time Series Forecasting
• Data source, formats, and fetch data
• Choose your compute target
• Automated machine learning experiment settings
• Run an automated machine learning experiment
• Explore model metrics
• Register and deploy model

You can create and run automated machine learning experiments in code using the Azure ML Python SDK or if you prefer a no code experience, you can also create your automated machine learning experiments in Azure Machine Learning Studio.

In this lab, we will use Automated Machine Learning to find the best performing regression model for predicting automobile prices. We will do all of this from the Azure Machine Learning Studio without writing a single line of code.

Exercise 1: Register Dataset with Azure Machine Learning studio

Task 1: Upload Dataset

1. In Azure portal, open the available machine learning workspace.

2. Select Launch now under the Try the new Azure Machine Learning studio message.

   

3. When you first launch the studio, you may need to set the directory and subscription. If so, you will see this screen:

   

   For the directory, select Udacity and for the subscription, select Azure Sponsorship. For the machine learning workspace, you may see multiple options listed. Select any of these (it doesn't matter which) and then click Get started.

4. From the studio, select Datasets, + Create dataset, From web files. This will open the Create dataset from web files dialog on the right.

   

5. In the Web URL field provide the following URL for the training data file:

   https://introtomlsampledata.blob.core.windows.net/data/automobile-price/automobile-price.csv
   

6. Provide Automobile-Price as the Name, leave the remaining values at their defaults and select Next.

   

Task 2: Preview Dataset

1. On the Settings and preview panel, set the column headers drop down to All files have same headers.

2. Review the dataset and then select Next

   

Task 3: Select Columns

1. Keep the default selections, and select Next

   

Task 4: Create Dataset

1. Confirm the dataset details and select Create

   

Exercise 2: Setup New Automated Machine Learning Experiment

Task 1: Create New Automated Machine Learning Experiment

1. From the studio home, select Create new, Automated ML run

   

2. This will open a Create a new automated machine learning experiment page

Task 2: Select Training Data

1. Select the dataset Automobile-Price and then select Next

   

Task 3: Create a new Automated ML run

1. Provide an experiment name: automobile-price-prediction

2. Select target column: price

3. Select compute target: select the available compute

4. Select Next

   

Task 4: Setup Task type and Settings

1. Select task type: Regression, and then select View additional configuration settings

   

2. This will open the Additional configurations dialog.

3. Provide the following information and then select Save

   1. Primary metric: Normalized root mean squared error
   2. Exit criteria, Metric score threshold: 0.056

   

   Note that we are setting a metric score threshold to limit the training time. In practice, for initial experiments, you will typically only set the training job time to allow AutoML to discover the best algorithm to use for your specific data.

Exercise 3: Start and Monitor Experiment

Task 1: Start Experiment

1. Select Finish to start running the experiment

   

Task 2: Monitor Experiment

1. The experiment will run for about 10 min.

2. In the Details tab, observe the run status of the job.

   

3. Select the Models tab, and observe the various algorithms the AutoML is evaluating. You can also observe the corresponding Normalized root mean squared error scores for each algorithm.

   

4. Select Details and wait till the run status becomes Completed.

   

5. While you wait for the model training to complete, you can learn more about how Automated Machine Learning offers preprocessing and data guardrails automatically by selecting Automatic featurization.

Exercise 4: Review Best Model's Performance

Task 1: Review Best Model Performance

1. From the Details tab review the best model's Algorithm name and its corresponding Normalized root mean squared error score. Next, select the best model's Algorithm name

   

2. Select View all other metrics to review the various Run Metrics to evaluate the model performance. Next, select Metrics

   

3. Select predicted_true, Chart to review the Predicted vs. True curve.

   

Next Steps

Congratulations! You have trained and evaluated a regression model using automated machine learning. You can continue to experiment in the environment but are free to close the lab environment tab and return to the Udacity portal to continue with the lesson.