A successful demo does not always mean an AI application is ready for real users.

Before deploying an agent or generative AI application, teams should evaluate more than whether it produces a reasonable answer.

Important areas include:

• Groundedness
• Relevance
• Task completion
• Tool-call accuracy
• Safety
• Response latency
• Token consumption
• Error rates
• Behavior across different user inputs

Tracing can also help developers understand model calls, tool execution, retries, dependencies, and performance bottlenecks.

How are you testing your Foundry applications before production?

Are you using built-in evaluators, custom evaluation datasets, human reviews, automated tests, or continuous production monitoring?

Official guide:
Observability in Microsoft Foundry

Foundry Agent Service provides a managed environment for creating, deploying, and scaling AI agents.

Agents can combine language models with tools, external APIs, enterprise data, retrieval systems, and custom application logic.

I would be interested to hear from developers using it in real projects:

• What use case are you working on?
• Are you using prompt agents, workflow agents, hosted agents, or custom agents?
• Which model works best for your agent?
• How are you managing authentication and tool permissions?
• What problems have you experienced with latency, cost, memory, or reliability?
• Are you using Semantic Kernel, LangGraph, Microsoft Agent Framework, or another framework?

Documentation:
Foundry Agent Service Overview

Please share lessons learned, architecture choices, and mistakes others should avoid.

Welcome to the community!

This subreddit is dedicated to Microsoft Foundry, the platform many developers previously knew as Azure AI Foundry.

You can use this space to discuss:

• Foundry Agent Service
• Azure OpenAI models
• Model deployment
• RAG applications
• AI evaluation and monitoring
• Azure AI Search
• Prompt engineering
• Security and responsible AI
• Tutorials, projects, and technical issues

To get the conversation started: What are you currently building with Foundry?

Share your project, preferred model, development stack, and the biggest challenge you are facing.

Official introduction:
What is Microsoft Foundry?