Get in Touch

Course Outline

Module 1: Streaming Overview

  • Key distinctions between batch and streaming
  • Use cases for Streaming Data Management
  • Streaming architecture
  • Kappa architecture
  • End-to-end Streaming Data Management
  • Types of streaming data
  • Benefits of streaming

Module 2: Edge Data Streaming (EDS) Overview

  • EDS architecture
  • Core features of EDS
  • EDS data flow process
  • EDS user interface
  • Setting up an EDS Service
  • Creating a data flow
  • Deploying a data flow
  • Monitoring the data flow
  • Lab 1: Establishing an Edge Data Streaming Service
  • Lab 2: Creating and Deploying a Data Flow

Module 3: Big Data Streaming Overview

  • Introduction to Big Data Streaming
  • Stream data processing using Spark streaming
  • BDS component architecture
  • Core features of BDS

Module 4: Kafka Overview

  • Kafka concepts
  • Kafka core APIs
  • Kafka topics
  • Kafka models
  • Kafka use cases
  • Lab: Establishing a Kafka connection

Module 5: Streaming Mappings

  • Sources within a Streaming Mapping
  • Targets in Streaming Mapping
  • Lookup sources
  • Properties of Kafka Data Objects
  • Lab: Creating a Mapping with Kafka Source and HDFS Target
  • Lab: Creating a Mapping with Kafka Source and Kafka Target
  • BDS transformations
  • Lab: Enhancing Mappings Using Filter and Expression Transformations
  • Lab: Enhancing Mappings Using Window and Aggregator Transformations
  • Lab: Enhancing Mappings Using Sorter and Rank Transformations

Module 6: Monitoring Logs and Troubleshooting

  • Spark monitoring
  • Viewing logs
  • Troubleshooting techniques
  • Lab: Monitoring an EDS data flow
  • Lab: Monitoring a BDS mapping

Module 7: Performance Tuning and Best Practices

  • Tuning Spark job performance
  • Key best practices for working with streaming data

Module 8: End-to-End Use Case

  • Use case description
  • EDS and BDS – Final objective
  • Lab: Transforming unstructured streaming data into structured data
  • Lab: Ingesting data from EDS to BDS and executing a mapping in BDS
 14 Hours

Testimonials (4)

Related Categories