ARTIFICIAL INTELLIGENCE
AI Knowledge Base by Sunil Marella

Azure - AI Services

Microsoft Foundry is an enterprise-grade platform for buiulding, deploying and managing AI applications and agents. It consolidates models, agent orchestration, monitoring and governance tools in one platform.

Components of AI Applications

  • Data Layer: Collection, storage, and management of data used for training, inference, and decision-making. Ex: Azure SQL, CosmoDB or data lake.
  • Model Layer: Involves the selection, training, and deployment of machine learning or AI models. Ex: Azure OpenAI custom build Azure ML etc.
  • Computer Layer: AI applications require compute resources to train and run models. Ex: Azure functions, Azure Kubernetes service, Azure app service etc.
  • Integration & Orchestration Layer: The integration and orchestration layer connects models and data with business logic and user interfaces. Ex: SDK’s & API for imntegrating AI Capabilities into application.

Introduction

With Microsoft Foundry, you can work with

  • Foundry Models: Access to foundation and partner models (Azure OpenAI in Foundry Models, Anthropic, Cohere, etc.).
  • Agent Service: Build and orchestrate multi-step AI workflows.
  • Foundry Tools: Prebuilt Azure services (Vision, Language, Search, Document Intelligence).
  • Governance & Observability capabilities: Centralized identity, policy, and monitoring for AI workloads.