Get in Touch

Course Outline

Introduction to Cambricon and MLU Architecture

  • Overview of Cambricon’s AI chip portfolio
  • MLU architecture and instruction pipeline
  • Supported model types and applicable use cases

Installing the Development Toolchain

  • Installation of BANGPy and Neuware SDK
  • Environment configuration for Python and C++
  • Model compatibility checks and preprocessing steps

Model Development with BANGPy

  • Tensor structure and shape management
  • Construction of computation graphs
  • Support for custom operations within BANGPy

Deploying with Neuware Runtime

  • Model conversion and loading processes
  • Execution and inference control mechanisms
  • Best practices for edge and data centre deployment

Performance Optimization

  • Memory mapping and layer tuning
  • Execution tracing and profiling techniques
  • Identifying and resolving common bottlenecks

Integrating MLU into Applications

  • Utilising Neuware APIs for seamless application integration
  • Streaming capabilities and multi-model support
  • Hybrid CPU-MLU inference scenarios

End-to-End Project and Use Case

  • Lab: Deploying a vision or NLP model
  • Edge inference implementation with BANGPy integration
  • Testing for accuracy and throughput

Summary and Next Steps

Requirements

  • A solid understanding of machine learning model architectures
  • Practical experience with Python and/or C++
  • Familiarity with concepts related to model deployment and acceleration

Target Audience

  • Embedded AI developers
  • ML engineers deploying solutions to edge or data centre environments
  • Developers working with Chinese AI infrastructure
 21 Hours

Testimonials (1)

Related Categories