SyNAP Model Import And Quantization

• Introduction
  • Online Model Conversion
  • Offline Model Conversion
• Import Workflow Example
  • Use Case
  • Preliminary Evaluation
  • Use An Appropriate Input Size
  • Quantize Model
  • Remove Un-Necessary Layers
  • Improve Quantization Dataset
  • Per-Channel And KL_Divergence Quantization
  • 16-Bits Quantization
  • Mixed Quantization
  • Remove Un-Needed Outputs
  • Perform Input Preprocessing With The NPU
  • I Still Can’t Meet My Requirements
• Conclusions