Course Outline
Introduction to Azure Data Lake Storage Gen2
- Overview of Azure Data Lake Storage Gen2.
- Key features and benefits.
- Comparison between Azure Data Lake Storage Gen1 and Azure Blob Storage.
Setting up Azure Data Lake Storage Gen2
- Account creation and configuration.
- Understanding the hierarchical namespace.
- Data import and export strategies.
Security and Access Control
- Implementing authentication and authorization.
- Managing access via Azure Active Directory (Azure AD).
- Data encryption methods and best practices.
Managing Data and Cost Optimization
- Data lifecycle management using storage tiers.
- Performance tuning and optimization.
- Cost management and optimization strategies.
Integrating with Analytics Services
- Introduction to analytics frameworks compatible with Azure Data Lake Storage Gen2.
- Use cases involving Azure Databricks, Azure HDInsight, and Azure Synapse Analytics.
- Building ETL pipelines using Azure Data Factory.
Developer Tools and APIs
- Overview of available APIs and SDKs.
- Developing applications using the Azure Data Lake Storage Gen2 API.
- Automation and orchestration of tasks.
Monitoring, Troubleshooting, and Best Practices
- Tools and techniques for monitoring storage and access patterns.
- Troubleshooting common issues.
- Best practices for managing and scaling Azure Data Lake Storage Gen2.
Summary and Next Steps
Requirements
- Foundational understanding of cloud computing principles.
- Basic knowledge of data storage solutions and databases.
Target Audience
- Data engineers.
- Cloud professionals.
- Data scientists.
Testimonials (4)
A journey through the Spark world: a very intense course. DSL, spark sql, partitioning vs bucketing for me.
Georgiana Elisabeta
Course - Apache Spark Fundamentals
Examples and their usage
Dariusz Frycz - WASKO SPOLKA AKCYJNA
Course - AZ-040T00: Automating Administration with PowerShell
Everything, is a new platform for me and everything was interesting.
Sergiu
Course - AZ-104T00-A: Microsoft Azure Administrator
Hands on exercises. Class should have been 5 days, but the 3 days helped to clear up a lot of questions that I had from working with NiFi already