DOCSP-43580 BYO LLM

[nvillahermosa-mdb]

DESCRIPTION

• Adds a new procedure for setting the Query Converter LLM
• Updates the AI and Data Usage topic to add supported LLMs

Info mainly taken from App Modernisation FAQ

STAGING

Query Converter (added "Important" callout)
Set the Query Converter LLM
AI and Data Usage Information

JIRA

DOCSP-43580

BUILD LOG

Self-Review Checklist

• Is this free of any warnings or errors in the RST?
• Is this free of spelling errors?
• Is this free of grammatical errors?
• Is this free of staging / rendering issues?
• Are all the links working?

External Review Requirements

What's expected of an external reviewer?

[netlify]

✅ Deploy Preview for docs-relational-migrator ready!

Name	Link
🔨 Latest commit	681f593
🔍 Latest deploy log	https://app.netlify.com/sites/docs-relational-migrator/deploys/677c058744464c0008592964
😎 Deploy Preview	https://deploy-preview-189--docs-relational-migrator.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.
Lighthouse	1 paths audited Performance: 46 (🟢 up 16 from production) Accessibility: 85 (no change from production) Best Practices: 75 (no change from production) SEO: 83 (no change from production) PWA: - View the detailed breakdown and full score reports

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[netlify]

✅ Deploy Preview for docs-relational-migrator ready!

Name	Link
🔨 Latest commit	352cd5f
🔍 Latest deploy log	https://app.netlify.com/sites/docs-relational-migrator/deploys/67c7731405901100087d39a5
😎 Deploy Preview	https://deploy-preview-189--docs-relational-migrator.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.
Lighthouse	1 paths audited Performance: 35 (🔴 down 46 from production) Accessibility: 85 (🔴 down 13 from production) Best Practices: 75 (no change from production) SEO: 83 (🔴 down 9 from production) PWA: - View the detailed breakdown and full score reports

---

To edit notification comments on pull requests, go to your Netlify site configuration.

[jason-price-mongodb]

@nvillahermosa-mdb LGTM with suggestions. Cheers.

[jason-price-mongodb]

Consider adding link to info on how to restart, or add command.

[davidsoulmdb]

Recommend we add a note that Query Converter has been tested and optimized for use with ChatGPT-4o. If considering changing to a different LLM, we recommend that you first conduct an internal test to validate the quality of the results is suitable. If you have any questions, please reach out to your MongoDB technical contact.

[davidsoulmdb]

Suggestion to :Query Converter generates application code to streamline migrating an application from its original database into MongoDB. Query Converter is powered by generative AI. By default, it uses the GPT-4o model, hosted on MongoDB's Azure OpenAI subscription. You can configure Query Converter to use a different AI provider or Large Language Model (LLM) by following these steps.

Calling out as hosted by MongoDB subscription feels like it might actually promote abuse? Also would like to add context here eg:

Relational Migrator users can configure the tool to use a customer-hosted LLM service instead of the default Azure OpenAI service hosted by MongoDB. For general information on how MongoDB uses GenAI, please see our official GenAI FAQ.

When configured to use a locally-hosted LLM service, Relational Migrator does not require internet access for GenAI-based query conversion. The Query Converter feature generates application code to streamline migrating an application from its original database into MongoDB. It is currently the only feature powered by generative AI. By default, it uses the GPT-4o model from the MongoDB Azure OpenAI service. You can configure Query Converter to use a different AI provider or Large Language Model (LLM) by following these steps.

Call out need for testing as quality may be impacted?

[nvillahermosa-mdb]

Rebased and resolved merge commits before proceeding