Get in Touch

Course Outline

Introduction to Cambricon and MLU Architecture

  • Overview of Cambricon’s AI chip portfolio.
  • MLU architecture and instruction pipeline.
  • Supported model types and use cases.

Installing the Development Toolchain

  • Installing BANGPy and the Neuware SDK.
  • Environment setup for Python and C++.
  • Model compatibility and preprocessing.

Model Development with BANGPy

  • Tensor structure and shape management.
  • Computation graph construction.
  • Custom operation support within BANGPy.

Deploying with Neuware Runtime

  • Converting and loading models.
  • Execution and inference control.
  • Best practices for edge and data center deployment.

Performance Optimization

  • Memory mapping and layer tuning.
  • Execution tracing and profiling.
  • Identifying common bottlenecks and applying fixes.

Integrating MLU into Applications

  • Using Neuware APIs for seamless application integration.
  • Streaming and multi-model support.
  • Hybrid CPU-MLU inference scenarios.

End-to-End Project and Use Case

  • Lab: Deploying a vision or NLP model.
  • Edge inference utilizing BANGPy integration.
  • Testing accuracy and throughput.

Summary and Next Steps

Requirements

  • Understanding of machine learning model structures.
  • Experience with Python and/or C++.
  • Familiarity with concepts related to model deployment and acceleration.

Audience

  • Embedded AI developers.
  • Machine learning engineers deploying to edge or data center environments.
  • Developers working with Chinese AI infrastructure.
 21 Hours

Testimonials (1)

Related Categories