Model Modification and HBIR Model Compilation

To pursue ultimate performance in those scenarios with enormous input size, the quantization and conversion of some inputs and outputs can be fused into data pre-processing. At this point you can choose to remove these nodes by using the hb_compile tool, the tool supports also the compilation of HBIR models at the same time.

Usage

How To Use:

hb_compile --config ${config_file} \ --model ${model.bc}

Parameters Introduction

PARAMETERDESCRIPTION
-h, --helpShow help information and exit.
-c, --configConfiguration file for the model compilation, in YAML format.
-m, --modelThe model to be modified, which suffix needs to be .bc .