To pursue ultimate performance in those scenarios with enormous input size, the quantization and conversion of some inputs and outputs can be fused into data pre-processing.
At this point you can choose to remove these nodes by using the hb_compile tool, the tool supports also the compilation of HBIR models at the same time.
How To Use:
| PARAMETER | DESCRIPTION |
|---|---|
-h, --help | Show help information and exit. |
-c, --config | Configuration file for the model compilation, in YAML format. |
-m, --model | The model to be modified, which suffix needs to be .bc . |