how to resolve error 429 when requesting Azure AI services

mybdai.com 5 Reputation points
2025-01-03T07:11:50.1733333+00:00

I newly created and deploy model GPT-4-32K, unfortunately every request is throwing error 429.

Error code: 429 - {'error': {'code': '429', 'message': 'Requests to the ChatCompletions_Create Operation under Azure OpenAI API version 2024-05-01-preview have exceeded token rate limit of your current AIServices S0 pricing tier. Please retry after 86400 seconds. Please contact Azure support service if you would like to further increase the default rate limit.'}}

This is new environment and never used. how can i resolved it?

Azure OpenAI in Foundry Models
Foundry Tools
Foundry Tools

Formerly known as Azure AI Services or Azure Cognitive Services is a unified collection of prebuilt AI capabilities within the Microsoft Foundry platform


1 answer

Sort by: Newest
  1. Rizwan Ahmed 0 Reputation points
    2026-11-20T07:21:40.04+00:00

    The 429 here is a token-per-minute (TPM) throttle from the AIServices S0 tier's deployment-level rate limit, not a capacity failure. The default quota per deployment is low until you request an increase, and it gets worse fast when multiple callers share one deployment.

    Two things to check:

    1. Look at your deployment's TPM/RPM quota in Azure AI Foundry under Management Center > Quota, and file a quota increase request if you're consistently near the ceiling.
    2. If more than one app or environment is hitting the same deployment, put a gateway in front of it (Azure API Management, or Foundry's own gateway capability) so you can enforce per-caller token/rate limits and fail over across deployments instead of letting one noisy caller exhaust the shared quota and 429 everyone else.

    I wrote up the gateway plus cost/rate-limit pattern in more detail here, including the policy config for token-based limiting and multi-model failover:

    Cost-Safe Guardrails for Microsoft Foundry with the Azure AI Gateway

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.