GPT-5.6 - Again unusable

Hendrik 50 Reputation points
2026-07-14T15:35:24.87+00:00

Hello Microsoft. The whole working day GPT 5.6 Sol is again unusable at the Response API. Region East-US and Swedencentral. No cache hits and 5 minutes loading time per request. Impossible to develop with it.

After prompt cache fix Sunday evening it works perfect, but today its completely broken again... Could you please fix your Inference setup? It cost a lot of money to develop via API and it should not work like this.

Azure OpenAI in Foundry Models
0 comments No comments

1 answer

Sort by: Most helpful
  1. Christos Panagiotidis 3,566 Reputation points
    2026-07-17T18:29:34.5933333+00:00

    Five-minute response times in two regions are not normal client-side latency, especially if the same payload previously completed quickly. First separate caching from inference performance: prompt caching only applies when the prompt is at least 1,024 tokens and the initial 1,024-token prefix is identical. Cache entries can disappear after 5–10 minutes of inactivity, so a zero cached-token count alone does not prove an incident.

    For the slow requests, capture timestamp, region, deployment name, request ID, status code, total input/output tokens, and whether streaming was enabled. In Azure Monitor compare Time to Response, Time to Last Byte, Model Availability Rate, 429s, and 5xx errors for both deployments. Also check personalized Service Health.

    As an immediate mitigation, route to a healthy secondary deployment, use streaming, lower the maximum output-token limit, and honor Retry-After with exponential backoff for 429s. Global Standard can improve availability but may still have latency variation; PTU is the option for predictable capacity. If five-minute latency persists on minimal test prompts, open a support case with the captured request IDs—only Microsoft can investigate shared inference capacity.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.