Get in Touch
 Duration 14 hours

Course Outline

Architecting an Open AIOps Framework

  • Introduction to critical elements in open AIOps workflows.
  • Tracing data pathways from ingestion through to alert delivery.
  • Evaluating tool compatibility and integration strategies.

Data Acquisition and Aggregation

  • Processing time-series metrics with Prometheus.
  • Capturing log data using Logstash and Beats.
  • Standardising data streams for cross-source correlation.

Developing Observability Dashboards

  • Visualising key metrics via Grafana.
  • Creating Kibana dashboards for log analysis.
  • Utilising Elasticsearch queries to derive operational insights.

Anomaly Identification and Incident Forecasting

  • Exporting observability data into Python-based processing pipelines.
  • Training machine learning models for outlier recognition and trend prediction.
  • Deploying models for real-time inference within the observability stack.

Automated Alerting and Response with Open Tools

  • Defining Prometheus alert rules and configuring Alertmanager routing.
  • Initiating script or API-based workflows for automated response.
  • Leveraging open-source orchestration platforms, such as Ansible and Rundeck.

Integration and Scalability Strategies

  • Managing high-volume data ingestion and long-term storage requirements.
  • Implementing security protocols and access controls in open-source ecosystems.
  • Independently scaling ingestion, processing, and alerting layers.

Practical Applications and Advanced Extensions

  • Case studies covering performance optimisation, downtime avoidance, and cost reduction.
  • Enhancing pipelines with tracing utilities or service mapping graphs.
  • Establishing best practices for operating and maintaining AIOps systems in production.

Recap and Future Directions

Requirements

  • Proficiency with observability platforms such as Prometheus or ELK.
  • Solid working knowledge of Python and core machine learning principles.
  • Comprehensive understanding of IT operations and alerting lifecycles.

Target Audience

  • Senior Site Reliability Engineers (SREs).
  • Data engineers focused on operational contexts.
  • DevOps platform leads and infrastructure architects.

Related Categories