Get in Touch
 Duration 14 hours

Course Outline

Introduction to AIOps with Open Source Tools

  • Summary of AIOps principles and associated advantages
  • The role of Prometheus and Grafana within the observability ecosystem
  • Positioning machine learning in AIOps: predictive versus reactive analysis

Installing and Configuring Prometheus and Grafana

  • Setup and configuration of Prometheus for time series data collection
  • Development of Grafana dashboards using live metrics
  • Investigation of exporters, relabeling, and service discovery mechanisms

Preparing Data for Machine Learning

  • Extraction and transformation of Prometheus metrics
  • Preparation of datasets tailored for anomaly detection and forecasting tasks
  • Utilization of Grafana transformations or Python-based pipelines

Machine Learning for Anomaly Detection

  • Implementation of fundamental ML models for outlier detection (e.g., Isolation Forest, One-Class SVM)
  • Training and assessment of models using time series data
  • Representation of anomalies on Grafana dashboards

Forecasting Metrics Using Machine Learning

  • Construction of basic forecasting models (ARIMA, Prophet, introduction to LSTM)
  • Anticipation of system load and resource consumption
  • Leveraging predictions for proactive alerting and scaling decisions

Integrating Machine Learning with Alerting and Automation

  • Formulation of alert rules based on ML outputs or defined thresholds
  • Application of Alertmanager and notification routing strategies
  • Activation of scripts or automation workflows upon detection of anomalies

Scaling and Operationalizing AIOps

  • Integration with external observability platforms (e.g., ELK stack, Moogsoft, Dynatrace)
  • Deployment of ML models within observability workflows
  • Best practices for implementing AIOps at scale

Conclusion and Future Directions

Requirements

  • A solid grasp of system monitoring and observability principles
  • Practical experience utilizing Grafana or Prometheus
  • Proficiency in Python and a foundational understanding of machine learning concepts

Target Audience

  • Observability engineers
  • Infrastructure and DevOps teams
  • Monitoring platform architects and Site Reliability Engineers (SREs)

Related Categories