Building and customizing solutions using Microsoft 365 Copilot APIs and tools
Yes, there is automatic content refresh for existing knowledge sources, but not automatic discovery of brand-new URLs.
- If the provider updates content on the same website or in the same existing knowledge source, the agent reflects those underlying content changes automatically. Manual update is only needed when the source location or connection settings change.
- If the provider publishes new content at a new URL that is not already covered by the knowledge source, that new URL must be added as a new knowledge source.
For a documentation website, the best way to reduce manual maintenance is to add a broader website URL that already covers the relevant pages, instead of adding many individual page URLs one by one.
For SharePoint and similar URL-based sources, the agent searches the registered URL and its subpaths. That means if updates are published under the same site or folder path, the agent can use them without re-adding each page.
To manage the source in Copilot Studio:
- Open the agent.
- Go to the Build tab.
- Open Knowledge.
- Select the existing knowledge source to review or modify its URL or connection settings.
- Select Save.
If hallucinations are happening, one common cause is that the agent is answering beyond the attached knowledge. In the standard agent experience, the Allow the AI to use its own general knowledge option can let the agent answer outside the specific sources. Disabling that helps keep responses restricted to the configured knowledge base.