Azure AI Search Private Endpoint Connection Issue — HTTP 424 Tool Server Error

Shinji Tanaka 5 Reputation points
2026-09-13T03:45:08.5033333+00:00

Setup (production, Japan East): Microsoft Foundry account with public network access disabled + private endpoint, standard agent setup with virtual network injection into a delegated subnet, project-level capability host with bring-your-own Azure AI Search / Cosmos DB / Storage, keyless (project managed identity) connection to the search service. The search service (standard tier, 3 replicas) has a private endpoint in a peered VNet, the privatelink DNS zone is linked to the agent VNet, and the project managed identity holds Search Index Data Contributor and Search Service Contributor.Symptom: every POST {project endpoint}/openai/v1/responses that includes the built-in azure_ai_search tool (single tool, tool_choice=required, max_tool_calls=1, store=false, model gpt-5.6-luna) fails with HTTP 424 after 10-13 seconds:{"error":{"code":"tool_server_error","type":"server_error","param":null,"message":"An error occurred while processing your request. You can retry your request, or contact us through an Azure support request ... Please include the request ID a2bc05e8-60c6-417e-8170-6e8254681c51 in your message.","request_id":"2f8cd45c2ec5d8f3608bde6dc8f19ac2"}}Other request IDs (2026-09-12 UTC): 4d971e8e-b4f0-4df7-9709-f35cb4edffe5, ce745f67-6e98-4ce0-95c6-71a580e2d554, c59fc929-8b3b-40fd-b1de-3d62dd093030, 54e65b1a-4976-46a6-bfb4-f74c88f403f9, 228c996e-5437-45cc-a9c1-221176ac8820.What we verified:- Azure AI Search diagnostic logs (OperationLogs) show no request of any kind from the tool in any failure window: no private-endpoint row, no public row, no rejected row. Requests from other callers in the same VNets are logged normally.- We repeated the call with the search service temporarily open to ALL networks (propagation verified by an HTTP 200 from an IP outside the former rules one second earlier): still HTTP 424 (request ID a2bc05e8-... above), and still zero rows at the search service during the call.- A Hosted agent container in the same delegated subnet reaches the same search private endpoint and its queries are logged (HTTP 200), so the subnet, DNS zone, peering and private endpoint work. The data proxy path also reaches the Cosmos DB private endpoint in the same VNet (thousands of logged requests from the project managed identity).- Both capability hosts (account and project) are Succeeded and the project capability host lists the search connection. Account diagnostic settings (RequestResponse/Trace) and a project Application Insights connection produced zero rows for the failing calls; ManagedNetworkEvent is empty; Resource Health and Service Health are clean.- In a development subscription the identical request succeeds 7/7, including with the production differences reproduced one by one and together (NSG + NAT gateway on the agent subnet, search private endpoint in a peered VNet, search public access enabled with IP rules and trusted-services bypass, account public access disabled, serverless Cosmos DB). Remaining untested differences: search tier (standard/3 replicas vs basic/1) and account networkAcls defaultAction (Deny vs Allow).- Possibly related: from the same delegated subnet, the Hosted agent's first TLS handshake to the search private endpoint took 11.2 s, while an App Service in the same VNet completes it in 12-18 ms.Question: which stage of the azure_ai_search tool execution fails for these request IDs (connection resolution, DNS, TCP/TLS to the private endpoint, token acquisition for the project managed identity, the Search HTTP call, or an internal timeout), and is there a known issue or unsupported condition for this topology? We have exhausted customer-visible telemetry; the tool server / data proxy logs are needed. Support case 2609130060000009 is open and linked to this thread; resource names and IDs can be provided privately.

Foundry Agent Service
Foundry Agent Service

A fully managed platform in Microsoft Foundry for hosting, scaling, and securing AI agents built with any supported framework or model


1 answer

Sort by: Most helpful
  1. Pavan Kumar Purilla 425 Reputation points Microsoft External Staff Moderator
    2026-10-13T09:07:14.63+00:00

    Hi Shinji Tanaka,

    The Product Group confirmed that your test results are consistent with their investigation.

    The resource group containing the Foundry account/project is the relevant resource group in this scenario, rather than the resource group containing the Azure AI Search service.

    The project connection identifier contains the full ARM path of the Foundry project, including the resource group name. When the resource group name contains non-ASCII characters, the current ToolServer-to-authentication-service request attempts to place this identifier into an ASCII-only HTTP header. This causes the request to fail before it reaches the Azure AI Search service.

    This explains why:

    • The ASCII-only resource group scenario succeeded with HTTP 200 and generated a Query.Search operation.
    • The non-ASCII resource group scenario failed with HTTP 424 tool_server_error.
    • No Query.Search operation was recorded by the Azure AI Search service for the failing request.

    The Product Group is working on a permanent fix that changes how these resource identifiers are transferred by using an encoded header representation. The fix covers the Search connection identifier involved in this incident as well as other susceptible resource-identifier headers on the same boundary.

    Japan East Deployment

    At this time, there is no committed deployment date for Japan East.

    The required receiver, ToolServer sender, and feature-flag forwarding changes are currently under review and have not yet merged. The deployment will need to occur in sequence, with the receiver changes deployed first, followed by the ToolServer and feature-flag changes. The behavior will then be enabled gradually.

    The Product Group will be able to provide a Japan East deployment estimate once the changes have merged and entered the deployment pipeline.

    Current Workaround

    At present, there is no validated in-place workaround for an existing Foundry account/project located in a resource group whose name contains non-ASCII characters.

    Creating another connection to the same Azure AI Search service would not resolve the issue because the Foundry project connection identifier would still contain the non-ASCII resource-group name.

    Was this answer helpful?

    0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.