AI & Cloud Infrastructure

Running AI Agents in Production with Azure App Platform - Microsoft Ignite 2025

By Technspire TeamNovember 28, 202512601 views

Agent Inventory and Requirements (1-2 weeks)

• Catalog existing agents (experimental, staging, production)
• Document tool dependencies (what APIs/data does each agent need?)
• Define SLAs (uptime, response time, error rate targets)
• Assess security requirements (data sensitivity, compliance rules)
• Estimate resource needs (expected traffic, autoscaling requirements)

Infrastructure Setup (2-3 weeks)

• Deploy Azure App Service plans (choose tier based on SLA requirements)
• Configure Azure AI Foundry for agent lifecycle management
• Set up Azure API Management for MCP tool gateway
• Enable Application Insights for observability
• Configure Azure Entra for agent identities and RBAC
• Implement network security (VNets, private endpoints, firewalls)

Tool Integration via MCP (3-4 weeks)

• Build or adopt MCP servers for required tools
• Register tools in Azure API Center
• Configure authentication flows (OAuth, managed identities)
• Set rate limits and quotas per agent/tool combination
• Test tool invocations from staging agents
• Document tool capabilities for agent developers

Pilot Agent Deployment (4-6 weeks)

• Select 1-2 high-value agents for initial production deployment
• Deploy to staging environment, run load tests
• Validate observability (can you debug agent decisions?)
• Test failure scenarios (what happens if tools are down?)
• Deploy to production with canary rollout (5% traffic → 100%)
• Monitor for 2 weeks, gather feedback

Scale to Full Agent Fleet (8-12 weeks)

• Migrate remaining agents to Azure App Service
• Implement CI/CD pipelines for agent deployments (GitHub Actions, Azure DevOps)
• Configure autoscaling rules based on observed traffic patterns
• Set up alerting for SLA violations (uptime, error rates)
• Train teams on agent operations (deployment, monitoring, troubleshooting)
• Establish governance review process (quarterly policy audits)

Continuous Improvement (Ongoing)

• Analyze agent performance data weekly (identify slow tools, high-error agents)
• Run A/B tests on agent improvements (new prompts, different models)
• Optimize costs (switch to smaller models where quality is sufficient)
• Expand tool catalog (add new capabilities based on agent needs)
• Review compliance (ensure audit logs meet regulatory requirements)
• Measure ROI (cost savings, efficiency gains, revenue impact)

Why This Matters for Swedish Organizations

Sweden's businesses are building AI agents rapidly—but many struggle with the transition from prototype to production. Azure App Platform addresses critical challenges:

Regulatory compliance: GDPR, NIS2, AI Act—Azure's built-in governance and audit trails simplify compliance
Operational reliability: Autoscaling, circuit breakers, and observability ensure 99%+ uptime
Security by default: Entra authentication, private endpoints, and policy enforcement protect sensitive data
Cost control: Quotas, rate limiting, and model optimization prevent runaway spending
Developer productivity: MCP tool integration, GitHub Copilot modernization, and Azure AI Foundry reduce development time by 60-70%
Scalability: From 1 agent to 100+ agents without infrastructure rewrites

Key Takeaways from BRK116

✓ Azure App Platform provides complete infrastructure for production AI agents: hosting, scaling, security, governance
✓ MCP tools integrate via Azure API Management, ensuring secure, rate-limited, and observable agent-tool interactions
✓ Application Insights enables deep observability: understand why agents make decisions, debug production issues
✓ GitHub Copilot accelerates app modernization, preparing legacy systems for agent integration
✓ Hitachi's real-world success: 73% reduction in unplanned downtime, 41% lower maintenance costs
✓ Azure AI Foundry manages agent lifecycle: version control, A/B testing, safe deployments
✓ Built-in governance: cost controls, data residency, audit trails, compliance reporting
✓ Organizations report 99%+ agent uptime and 60-70% faster development cycles

The journey from AI prototype to production-grade agent is complex—but Azure App Platform removes the infrastructure barriers. As demonstrated in BRK116, organizations like Hitachi are already reaping the benefits: autonomous systems that scale reliably, operate securely, and deliver measurable business value. For Swedish organizations ready to move beyond experimentation, Azure App Platform provides the foundation for sustainable agent innovation.