Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 14 hours
Course Outline
Architecting an Open AIOps Framework
- Introduction to critical elements in open AIOps workflows.
- Tracing data pathways from ingestion through to alert delivery.
- Evaluating tool compatibility and integration strategies.
Data Acquisition and Aggregation
- Processing time-series metrics with Prometheus.
- Capturing log data using Logstash and Beats.
- Standardising data streams for cross-source correlation.
Developing Observability Dashboards
- Visualising key metrics via Grafana.
- Creating Kibana dashboards for log analysis.
- Utilising Elasticsearch queries to derive operational insights.
Anomaly Identification and Incident Forecasting
- Exporting observability data into Python-based processing pipelines.
- Training machine learning models for outlier recognition and trend prediction.
- Deploying models for real-time inference within the observability stack.
Automated Alerting and Response with Open Tools
- Defining Prometheus alert rules and configuring Alertmanager routing.
- Initiating script or API-based workflows for automated response.
- Leveraging open-source orchestration platforms, such as Ansible and Rundeck.
Integration and Scalability Strategies
- Managing high-volume data ingestion and long-term storage requirements.
- Implementing security protocols and access controls in open-source ecosystems.
- Independently scaling ingestion, processing, and alerting layers.
Practical Applications and Advanced Extensions
- Case studies covering performance optimisation, downtime avoidance, and cost reduction.
- Enhancing pipelines with tracing utilities or service mapping graphs.
- Establishing best practices for operating and maintaining AIOps systems in production.
Recap and Future Directions
Requirements
- Proficiency with observability platforms such as Prometheus or ELK.
- Solid working knowledge of Python and core machine learning principles.
- Comprehensive understanding of IT operations and alerting lifecycles.
Target Audience
- Senior Site Reliability Engineers (SREs).
- Data engineers focused on operational contexts.
- DevOps platform leads and infrastructure architects.