Get in Touch
 Duration 21 hours

Course Outline

Fundamentals of Cambricon and MLU Architecture

  • Overview of Cambricon’s AI chip portfolio
  • MLU architecture and instruction pipelines
  • Supported model types and applicable use cases

Setting Up the Development Toolchain

  • Installation of BANGPy and the Neuware SDK
  • Configuring environments for Python and C++
  • Model compatibility checks and preprocessing

Building Models with BANGPy

  • Managing tensor structures and shapes
  • Constructing computation graphs
  • Implementing custom operations in BANGPy

Deployment via Neuware Runtime

  • Converting and loading models
  • Controlling execution and inference
  • Best practices for edge and data center deployment

Optimizing Performance

  • Tuning memory mapping and layers
  • Tracing execution and profiling performance
  • Identifying common bottlenecks and implementing solutions

Integrating MLUs into Applications

  • Leveraging Neuware APIs for application integration
  • Supporting streaming and multi-model scenarios
  • Handling hybrid CPU-MLU inference workflows

End-to-End Project and Practical Application

  • Lab session: Deploying a vision or NLP model
  • Edge inference implementation with BANGPy integration
  • Evaluating accuracy and throughput

Conclusion and Recommended Next Steps

Requirements

  • A solid grasp of machine learning model architectures
  • Proficiency in Python and/or C++
  • Knowledge of model deployment and acceleration principles

Target Audience

  • Embedded AI developers
  • ML engineers focused on edge or datacenter deployments
  • Developers specializing in Chinese AI infrastructure

Testimonials (1)

Related Categories