Model Distillation in Azure AI Foundry

Tom Raisbeck 20 Reputation points
2025-03-11T19:54:34.64+00:00

I'd like to distill a Llama model into a DeepSeek model. According to this page, only very specific model can be used. Is this still true and, if so, do we know when this feature will be available for other models?

Foundry Tools
Foundry Tools

Formerly known as Azure AI Services or Azure Cognitive Services is a unified collection of prebuilt AI capabilities within the Microsoft Foundry platform

0 comments No comments

Answer accepted by question author
Pavankumar Purilla 11,655 Reputation points Moderator
2025-03-11T21:15:21.3166667+00:00

Hi Tom Raisbeck,
Yes, as of now, model distillation in Azure AI Foundry is limited to specific models. According to the latest documentation, distillation is supported for Microsoft models and a selection of open-source models available in the model catalog.
Currently, there is no official announcement regarding when this feature will be expanded to support other models, such as DeepSeek. However, you can keep an eye on the Azure OpenAI Service release notes for updates on What's new in Azure OpenAI Service page will be updated accordingly with more details.

Hope this helps. Do let us know if you have any further queries.


If this answers your query, do click Accept Answer and Yes for was this answer helpful.

Was this answer helpful?

0 comments No comments

0 additional answers

Sort by: Oldest

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.