Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ No, customers don't require a separate BAA with Fireworks when using the Firewor

## Does customer data travel outside of Azure when using the Fireworks on Foundry service? Why? What data processing terms apply?

Yes, customer data travels outside Microsoft facilities because Fireworks runs inferencing for this service on Fireworks’ GPUs. However, since Fireworks is a Microsoft subprocessor, any processing of customer data continues to be governed by Microsoft’s Product Terms and DPA, and any documented exceptions (see response to #1 above).
Yes, customer data travels outside Microsoft facilities because Fireworks runs inferencing for this service on Fireworks’ GPUs. However, since Fireworks is a Microsoft subprocessor, any processing of customer data continues to be governed by Microsoft’s Product Terms and DPA, and any documented exceptions.

## Where is the customer data stored? Do Foundry’s DataZone commitments apply?

Expand Down
12 changes: 6 additions & 6 deletions docs/models/claude-models-quotas-limits.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -59,8 +59,8 @@ Your Azure subscription type determines your default rate limits. The **Version
| claude-opus-4-7 | Global Standard | N/A | Yes | 40 | 40,000 | 8,000 |
| claude-opus-4-6 | Global Standard | N/A | Yes | 40 | 40,000 | 8,000 |
| claude-opus-4-5 | Global Standard | N/A | Yes | 40 | 40,000 | 8,000 |
| claude-sonnet-5.5 | Global Standard | Yes | Yes | 40 | 40,000 | 8,000 |
| claude-sonnet-5.5 | Data Zone Standard (US) | Yes | N/A | 40 | 40,000 | 8,000 |
| claude-sonnet-5-5 | Global Standard | Yes | Yes | 40 | 40,000 | 8,000 |
| claude-sonnet-5-5 | Data Zone Standard (US) | Yes | N/A | 40 | 40,000 | 8,000 |
| claude-sonnet-5 | Global Standard | Yes | Yes | 40 | 40,000 | 8,000 |
| claude-sonnet-5 | Data Zone Standard (US) | Yes | N/A | 40 | 40,000 | 8,000 |
| claude-sonnet-4-6 | Global Standard | N/A | Yes | 80 | 80,000 | 16,000 |
Expand All @@ -85,8 +85,8 @@ Your Azure subscription type determines your default rate limits. The **Version
| claude-opus-4-7 | Global Standard | N/A | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-opus-4-6 | Global Standard | N/A | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-opus-4-5 | Global Standard | N/A | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5.5 | Global Standard | Yes | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5.5 | Data Zone Standard (US) | Yes | N/A | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5-5 | Global Standard | Yes | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5-5 | Data Zone Standard (US) | Yes | N/A | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5 | Global Standard | Yes | Yes | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-5 | Data Zone Standard (US) | Yes | N/A | 10,000 | 10,000,000 | 2,000,000 |
| claude-sonnet-4-6 | Global Standard | N/A | Yes | 10,000 | 10,000,000 | 2,000,000 |
Expand All @@ -111,8 +111,8 @@ Your Azure subscription type determines your default rate limits. The **Version
| claude-opus-4-7 | Global Standard | N/A | Yes | 0 | 0 | 0 |
| claude-opus-4-6 | Global Standard | N/A | Yes | 0 | 0 | 0 |
| claude-opus-4-5 | Global Standard | N/A | Yes | 0 | 0 | 0 |
| claude-sonnet-5.5 | Global Standard | Yes | Yes | 0 | 0 | 0 |
| claude-sonnet-5.5 | Data Zone Standard (US) | Yes | N/A | 0 | 0 | 0 |
| claude-sonnet-5-5 | Global Standard | Yes | Yes | 0 | 0 | 0 |
| claude-sonnet-5-5 | Data Zone Standard (US) | Yes | N/A | 0 | 0 | 0 |
| claude-sonnet-5 | Global Standard | Yes | Yes | 0 | 0 | 0 |
| claude-sonnet-5 | Data Zone Standard (US) | Yes | N/A | 0 | 0 | 0 |
| claude-sonnet-4-6 | Global Standard | N/A | Yes | 0 | 0 | 0 |
Expand Down
8 changes: 4 additions & 4 deletions docs/models/claude-models.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ For errors you might encounter when you deploy or call Claude models, see [Deplo
| `claude-opus-4-7` | - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - Reasoning over entire codebases- High-resolution image input (up to 2576px / 3.75MP) <br /> - See [Migrating to Claude Opus 5.5](https://platform.claude.com/docs/en/models/opus-5-5/migration-guide) | - Coding <br /> - Enterprise workflows <br /> - Long-running agents <br /> - Multimodal reasoning <br /> - Financial analysis <br /> - Cybersecurity |
| `claude-opus-4-6` | - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - Image and text input <br /> - Computer use <br /> - Advanced tool use (search, programmatic calling, examples) <br /> - See [Migrating to Claude Opus 5.5](https://platform.claude.com/docs/en/models/opus-5-5/migration-guide) | - Coding <br /> - Enterprise agents |
| `claude-opus-4-5` | - Hosted on Anthropic infrastructure: GA | 200K / 64K | - Extended thinking <br /> - Image and text input <br /> - Computer use <br /> - Advanced tool use (search, programmatic calling, examples) <br /> - See [Migrating to Claude Opus 5.5](https://platform.claude.com/docs/en/models/opus-5-5/migration-guide) | - Coding <br /> - Agents <br /> - Computer use <br /> - Enterprise workflows |
| `claude-sonnet-5.5` | - Hosted on Azure: GA <br /> - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - `xhigh` effort level <br /> - Reasoning over entire codebases and multi-day project context <br /> - High-res image input (up to 2576px / 3.75MP) are on by default <br /> - Mid-conversation<sup>3</sup> `role:"system"` <br /> - Token budgets<sup>3</sup> (`task_budget`) | - Coding <br /> - Long-running agents <br /> - Financial analysis <br /> - Cybersecurity <br /> - Computer use |
| `claude-sonnet-5-5` | - Hosted on Azure: GA <br /> - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - `xhigh` effort level <br /> - Reasoning over entire codebases and multi-day project context <br /> - High-res image input (up to 2576px / 3.75MP) are on by default <br /> - Mid-conversation<sup>3</sup> `role:"system"` <br /> - Token budgets<sup>3</sup> (`task_budget`) | - Coding <br /> - Long-running agents <br /> - Financial analysis <br /> - Cybersecurity <br /> - Computer use <br /> - See [What's new in Claude Sonnet 5.5](https://platform.claude.com/docs/en/models/sonnet-5-5/whats-new-sonnet-5-5) |
| `claude-sonnet-5` | - Hosted on Azure: GA <br /> - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - `xhigh` effort level <br /> - Reasoning over entire codebases and multi-day project context <br /> - High-res image input (up to 2576px / 3.75MP) are on by default <br /> - Mid-conversation<sup>3</sup> `role:"system"` <br /> - Token budgets<sup>3</sup> (`task_budget`) <br /> - See [What's new in Claude Sonnet 5](https://platform.claude.com/docs/en/about-claude/models/whats-new-sonnet-5) | - Coding <br /> - Long-running agents <br /> - Financial analysis <br /> - Cybersecurity <br /> - Computer use |
| `claude-sonnet-4-6` | - Hosted on Anthropic infrastructure: GA | 1M / 128K | - Adaptive thinking <br /> - Image and text input <br /> - Computer use <br /> - Advanced tool use (search, programmatic calling, examples) <br /> - See [Migrating to Claude Sonnet 5](https://platform.claude.com/docs/en/about-claude/models/migration-guide#migrating-to-claude-sonnet-5) | - Coding <br /> - Agents <br /> - Enterprise workflows |
| `claude-sonnet-4-5` | - Hosted on Anthropic infrastructure: GA | 200K / 64K | - Extended thinking <br /> - Image and text input <br /> - Computer use <br /> - See [Migrating to Claude Sonnet 5](https://platform.claude.com/docs/en/about-claude/models/migration-guide#migrating-to-claude-sonnet-5) | - Agents and complex, long-horizon tasks <br /> - High-volume workloads |
Expand Down Expand Up @@ -144,7 +144,7 @@ The **Thinking** feature allows specific values for the `thinking` parameter typ
| `claude-opus-4-8` | Yes | No | Yes |
| `claude-opus-4-7` | Yes | No | Yes |
| `claude-opus-4-6` | Yes | Yes | Yes |
| `claude-sonnet-5.5` | Yes | Yes | Yes |
| `claude-sonnet-5-5` | Yes | Yes | Yes |
| `claude-sonnet-5` | Yes | No | Yes |
| `claude-sonnet-4-6` | Yes | Yes | Yes |

Expand All @@ -163,7 +163,7 @@ The **Effort** feature allows specific `effort` levels for each model, as descri
| `claude-opus-4-8` | Yes | Yes | Yes | Yes | Yes |
| `claude-opus-4-7` | Yes | Yes | Yes | Yes | Yes |
| `claude-opus-4-6` | Yes | Yes | Yes | No | Yes |
| `claude-sonnet-5.5` | Yes | Yes | Yes | Yes | Yes |
| `claude-sonnet-5-5` | Yes | Yes | Yes | Yes | Yes |
| `claude-sonnet-5` | Yes | Yes | Yes | Yes | Yes |
| `claude-sonnet-4-6` | Yes | Yes | Yes | No | Yes |

Expand Down Expand Up @@ -217,7 +217,7 @@ Manage the documents and data you provide to Claude.
Claude models in Foundry are available for the following deployment types in specific Azure regions:

- **Global Standard**: All Claude models (Hosted on Azure and Hosted on Anthropic infrastructure).
- **Data Zone Standard (US)**: Hosted on Azure versions of `claude-opus-5-5`, `claude-opus-5`, `claude-opus-4-8`, `claude-sonnet-5`, and `claude-sonnet-5.5`.
- **Data Zone Standard (US)**: Hosted on Azure versions of `claude-opus-5-5`, `claude-opus-5`, `claude-opus-4-8`, `claude-sonnet-5`, and `claude-sonnet-5-5`.

For the exact Azure regions where Claude models are available for deployment, see [Region availability by deployment type](/models/models-from-partners#region-availability-by-deployment-type).

Expand Down
4 changes: 3 additions & 1 deletion docs/models/deploy-models-managed.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,8 @@ Managed compute in Foundry is in **public preview**. APIs, SKU names, and suppor

Managed compute deploys models from the **Hugging Face Collection** in the Foundry model catalog, served from the `azure-huggingface` registry.

For Hugging Face model availability in your project and Hugging Face-specific deployment guidance, see [Hugging Face models in Microsoft Foundry](/models/hugging-face-models).

1. Sign in to [Microsoft Foundry](https://ai.azure.com/?cid=learnDocs). Make sure the **New Foundry** toggle is on. These steps refer to **Foundry (new)**.

<img src="/images/new-foundry.png" />
Expand Down Expand Up @@ -86,7 +88,7 @@ A model ID and a deployment template ID must be compatible; every template lists

To learn more about deployment templates, see [Deployment template](/models/managed-compute-overview#deployment-template) in the Managed compute overview article.

- **Accelerator type**: for example `H100_80GB`, `A100_80GB`, or `MI_300_192GB`. Shown next to each template in the deployment wizard.
- **Accelerator type**: for example, `H100_80GB`, `A100_80GB`, or `MI300_192GB`. Shown next to each template in the deployment wizard.

## Deploy the model

Expand Down
3 changes: 1 addition & 2 deletions docs/models/deployments-overview.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -92,13 +92,12 @@ Managed compute (Preview) supports:
- **Model-instance sizing** — Deployments are sized in model-centric terms. You don't need to pick virtual machine SKUs, because Foundry chooses GPUs per instance based on model size, architecture, context length, and whether the workload is optimized for latency or throughput.
- **Optimized inference runtimes** — Microsoft-curated vLLM, SGLang, and NVIDIA NIM containers with continuous batching and tensor parallelism.
- **Accelerator families** — A100 (80 GB), H100 (80 GB), and MI300X (192 GB).
- **Auto-scaling and scale-to-zero** — Auto-scale from live traffic or scale manually. Configure an idle timeout so the deployment scales to zero when no traffic arrives, making billing stop immediately.
- **Microsoft-managed runtimes** — Microsoft owns serving runtimes, base container images, and security patches. Updates are applied to live deployments automatically.
- **Observability metrics** — Each deployment emits API call count by status code and response-time percentiles. Chat-completion models also emit input and output token counts, time-to-first-token (TTFT) percentiles, and total response-time percentiles, grouped by time.

### Billing and quota

Managed compute billing is hourly per accelerator SKU, with throughput per GPU as the underlying billing unit. Auto-scale and scale-to-zero align cost with actual traffic so that billing stops immediately when instances scale down.
Managed compute billing is hourly per accelerator SKU, with throughput per GPU as the underlying billing unit.

Quota is granted per accelerator SKU per region through the **Foundry quota process** and is **separate from Azure VM quota**. Azure virtual machines are an infrastructure-as-a-service (IaaS) offering with regional SKUs; managed compute is a PaaS offering that leads with Global and Data Zone processing. Existing Azure VM quota can't be applied to a managed compute deployment.

Expand Down
Loading
Loading