Get in Touch
 Duration 21 hours

Course Outline

Foundations of AI System Architecture

  • Layers, boundaries and separation of concerns
  • Applying ports and adapters to AI components
  • Defining quality attribute scenarios for AI features
  • Using architecture decision records for governance

Modernizing Existing Applications

  • Incremental modernization over full rewrites
  • Positioning AI services alongside existing monoliths
  • Utilizing strangler and anti-corruption layer patterns
  • Creating integration seams for current APIs and data

Patterns for LLM Integration

  • Implementing a model gateway as an abstraction boundary
  • Synchronous, asynchronous and streaming integration strategies
  • Managing fallback, degradation and provider failover
  • Treating prompt and model configuration as versioned assets

Contracts, APIs and Data Exchange

  • Structured output schemas and validation protocols
  • Implementing idempotency, retries and rate limiting
  • Orchestrating latency budgets and timeouts
  • Considering cost per request as an architectural constraint

End-to-End RAG Architecture

  • Ingestion, chunking and embedding pipelines
  • Stages of indexing, retrieval, reranking and generation
  • Positioning retrieval relative to application services
  • Analyzing trade-offs and failure modes at each stage

Vector Databases and Retrieval Design

  • Choosing between managed and self-hosted vector stores
  • Dense, sparse and hybrid search techniques
  • Metadata filtering and tenant isolation
  • Re-embedding strategies when models change

Retrieval Quality, Grounding and Evaluation

  • Building evaluation sets from real user queries
  • Measuring retrieval and answer quality
  • Managing citation, grounding and hallucination containment
  • Implementing feedback loops into the index

Agent Architectures

  • The agent loop and tool invocation mechanics
  • Deterministic workflows versus autonomous planners
  • Identifying cases where an agent is the wrong solution
  • Scoping agent responsibilities and state management

Multi-Agent Systems and Orchestration

  • Supervisor and orchestrator topologies
  • Handoff protocols and message contracts
  • Shared memory and context management
  • Comparing frameworks on architectural grounds

Service Communication and Tool Protocols

  • Event-driven and queue-based coordination
  • Exposing tools through standard protocols
  • Handling sagas, compensation and long-running transactions
  • Ensuring observability across service hops

AI Agents in Development Workflows

  • Integrating coding agents into delivery pipelines
  • Spec-driven development and review gates
  • Test generation and automated quality checks
  • Guardrails that maintain architectural control

Governance and Software Quality

  • Design reviews for AI features
  • Managing changes to models and prompts
  • Incorporating regression evaluation into the pipeline
  • Defining ownership, policy and approval paths

Security, Privacy and Data Governance

  • Mitigating prompt injection and applying defence in depth
  • Managing secrets, access control and least privilege
  • Data residency, personal data handling and retention
  • Ensuring auditability and human-in-the-loop controls

Scalability, Cost and Observability

  • Tracing across agent chains
  • Monitoring token and cost telemetry
  • Optimizing caching and latency
  • Defining service levels and incident response for AI services

Capstone: Architecture for an AI-Powered Solution

  • Developing context, component and deployment views
  • Designing retrieval and agent orchestration
  • Planning for security, governance and cost
  • Conducting peer review, critique and mapping a migration roadmap

Requirements

  • Experience in designing and maintaining production-grade software systems
  • Proficient understanding of REST APIs and service integration
  • Familiarity with relational databases and data modelling practices
  • Basic exposure to LLM-based tools or APIs

Target Audience

  • Software architects
  • Technical leads and senior engineers
  • Engineering managers accountable for architectural decisions

Testimonials (1)

Related Categories