AI & Cloud Infrastructure

Running AI Agents in Production with Azure App Platform - Microsoft Ignite 2025

By Falak MahmoodNovember 28, 202512984 views

Agent Inventory and Requirements (1-2 weeks)

  • • Catalog existing agents (experimental, staging, production)
  • • Document tool dependencies (what APIs/data does each agent need?)
  • • Define SLAs (uptime, response time, error rate targets)
  • • Assess security requirements (data sensitivity, compliance rules)
  • • Estimate resource needs (expected traffic, autoscaling requirements)
2

Infrastructure Setup (2-3 weeks)

  • • Deploy Azure App Service plans (choose tier based on SLA requirements)
  • • Configure Azure AI Foundry for agent lifecycle management
  • • Set up Azure API Management for MCP tool gateway
  • • Enable Application Insights for observability
  • • Configure Azure Entra for agent identities and RBAC
  • • Implement network security (VNets, private endpoints, firewalls)
3

Tool Integration via MCP (3-4 weeks)

  • • Build or adopt MCP servers for required tools
  • • Register tools in Azure API Center
  • • Configure authentication flows (OAuth, managed identities)
  • • Set rate limits and quotas per agent/tool combination
  • • Test tool invocations from staging agents
  • • Document tool capabilities for agent developers
4

Pilot Agent Deployment (4-6 weeks)

  • • Select 1-2 high-value agents for initial production deployment
  • • Deploy to staging environment, run load tests
  • • Validate observability (can you debug agent decisions?)
  • • Test failure scenarios (what happens if tools are down?)
  • • Deploy to production with canary rollout (5% traffic → 100%)
  • • Monitor for 2 weeks, gather feedback
5

Scale to Full Agent Fleet (8-12 weeks)

  • • Migrate remaining agents to Azure App Service
  • • Implement CI/CD pipelines for agent deployments (GitHub Actions, Azure DevOps)
  • • Configure autoscaling rules based on observed traffic patterns
  • • Set up alerting for SLA violations (uptime, error rates)
  • • Train teams on agent operations (deployment, monitoring, troubleshooting)
  • • Establish governance review process (quarterly policy audits)
6

Continuous Improvement (Ongoing)

  • • Analyze agent performance data weekly (identify slow tools, high-error agents)
  • • Run A/B tests on agent improvements (new prompts, different models)
  • • Optimize costs (switch to smaller models where quality is sufficient)
  • • Expand tool catalog (add new capabilities based on agent needs)
  • • Review compliance (ensure audit logs meet regulatory requirements)
  • • Measure ROI (cost savings, efficiency gains, revenue impact)

Why This Matters for Swedish Organizations

Sweden's businesses are building AI agents rapidly—but many struggle with the transition from prototype to production. Azure App Platform addresses critical challenges:

Key Takeaways from BRK116

The journey from AI prototype to production-grade agent is complex—but Azure App Platform removes the infrastructure barriers. As demonstrated in BRK116, organizations like Hitachi are already reaping the benefits: autonomous systems that scale reliably, operate securely, and deliver measurable business value. For Swedish organizations ready to move beyond experimentation, Azure App Platform provides the foundation for sustainable agent innovation.

Tags

Related posts

AI & Cloud Infrastructure
Model Context Protocol: The Future of Agent-Tool Interactions - Microsoft Ignite 2025

Microsoft Ignite BRK194: Model Context Protocol (MCP) standardizes agent-tool communication across platforms. Azure API Center integration, federated registries, cross-cloud orchestration, and enterprise governance for scalable agentic ecosystems.

AI & Cloud Infrastructure
MCP's new roadmap: five priorities after the stateless spec

The MCP core maintainers published a new roadmap on 22 August 2026, four weeks after the 2026-07-28 spec made the protocol core stateless: five priorities covering agentic messaging, HTTP-native transport unification, agent identity with DPoP and Workload Identity Federation, improved primitives, and SDK developer experience. Here is how Azure-first EU teams should sort that list into adopt now, prepare, and watch.

AI & Cloud Infrastructure
The MCP 2026-07-28 spec is final: your Azure migration plan

The Model Context Protocol specification version 2026-07-28 shipped on 28 July with a stateless core, Multi Round-Trip Requests, required routing headers, cacheable list results and a hardened authorization model that deprecates Dynamic Client Registration in favour of Client ID Metadata Documents. All four Tier 1 SDKs shipped support on release day, so Azure teams running MCP servers on Container Apps, AKS or behind API Management can start migrating immediately.

AI & Cloud Infrastructure
MCP goes stateless: Azure MCP server migration checklist

MCP's 2026-07-28 release candidate removes the initialize handshake and the Mcp-Session-Id header, so every request is self-contained and Azure-hosted MCP servers can run behind plain load balancers without sticky sessions or Redis session stores. Tasks and MCP Apps land as formal extensions, six SEPs harden authorization around OAuth 2.0 and OpenID Connect, and Roots, Sampling and Logging enter a 12-month deprecation window.

Back to all posts