Using own data in Azure Open AI via the REST API

Question

Using own data in Azure Open AI via the REST API

Henk Terblanche 35

I have created a deployment and loaded my own data (number of html files from a knowledge base). When asking a question related to the data in the Chat Playground / a Web App deployed from Azure OpenAI Studio the answer is related to my own data. However when I use the Azure OpenAI REST API (using the keys and end-point supplied for my deployment) it returns a generic answer and not based on my data. Does the REST API support user data at this stage or have I made a mistake in my configuration?

GABRIEL SUSAI 35 Reputation points

2024-03-14T14:51:48.2933333+00:00

Hi, I am facing the below error "Failed to get managed identity token." while testing the code locally using the sample app using your own data.

Error Error code: 400 - {'error': {'requestid': 'aae728a0-799f-49de-8ade-c1e51a5bbbbc', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

Using AzureSearch Service with semantic search. I don't have any identify enabled at the storage or AI Search service.

Thanks

2 answers

Your answer

GABRIEL SUSAI 35 Reputation points

2024-03-14T14:51:48.2933333+00:00

Hi, I am facing the below error "Failed to get managed identity token." while testing the code locally using the sample app using your own data.

Error Error code: 400 - {'error': {'requestid': 'aae728a0-799f-49de-8ade-c1e51a5bbbbc', 'code': 400, 'message': 'Failed to get managed identity token. Response: {"error":{"code":"ManagedIdentityIsNotEnabled","message":"Managed Identity (MI) is not set for this account while the encryption key source is 'Microsoft.KeyVault', customer managed storage or Network Security Perimeter is used."}}'}}

Using AzureSearch Service with semantic search. I don't have any identify enabled at the storage or AI Search service.

Thanks

Answer 1

Deleted

This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

5 deleted comments

Comments have been turned off. Learn more

Answer 2

Henk Terblanche Greetings & Welcome to Microsoft Q&A forum!

Does the REST API support user data at this stage or have I made a mistake in my configuration?

To answer your question, yes you can access Azure OpenAI on your data using a REST API or the web-based interface in the Azure OpenAI Studio

However when I use the Azure OpenAI REST API (using the keys and end-point supplied for my deployment) it returns a generic answer and not based on my data.

Make sure that you have correctly loaded your data into the deployment. You can check this by verifying that your data is visible in the Chat Playground or Web App

Did you try setting the inScope parameter?

You can refer to the Azure OpenAI Service REST API reference documentation for details on how to structure a request and receive a response.

Do let me know if that helps or have any further queries.