2024-07-11 16:07:41,770 file: tool_utils.py func: tool_utils line No: 81 log will be stored in /home/qinyonghang/UniAD/deps/UniAD/output/hb_compile.log
2024-07-11 16:07:41,770 file: hb_compile.py func: hb_compile line No: 376 Start hb_compile...
2024-07-11 16:07:41,771 file: hb_compile.py func: hb_compile line No: 377 hbdk version: 4.0.25
2024-07-11 16:07:41,771 file: hb_compile.py func: hb_compile line No: 378 horizon_nn version: 2.0.4
2024-07-11 16:07:41,771 file: hb_compile.py func: hb_compile line No: 379 hb_compile version: 3.2.4
2024-07-11 16:07:42,222 file: yaml_builder.py func: yaml_builder line No: 71 {'model_parameters': {'layer_out_dump': False, 'working_dir': '.hb_compile'}, 'input_parameters': {'input_name': '', 'input_shape': '', 'input_space_and_range': '', 'input_type_rt': 'featuremap', 'input_type_train': 'featuremap', 'norm_type': 'no_preprocess'}, 'calibration_parameters': {'calibration_type': 'skip', 'per_channel': False, 'run_on_bpu': '', 'run_on_cpu': ''}, 'compiler_parameters': {'compile_mode': 'latency', 'core_num': 1, 'debug': True, 'jobs': 32, 'max_time_per_fc': 0, 'optimize_level': 'O0'}}
2024-07-11 16:07:42,222 file: yaml_builder.py func: yaml_builder line No: 72 check template yaml load success
2024-07-11 16:07:42,222 file: yaml_builder.py func: yaml_builder line No: 220 Updated yaml config info: {'model_parameters': {'layer_out_dump': False, 'working_dir': '/home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile', 'onnx_model': '/home/qinyonghang/UniAD/deps/UniAD/output/../models/onnx/occ.onnx', 'march': 'nash-m', 'output_model_file_prefix': 'occ'}, 'input_parameters': {'input_name': 'bev;ins_query', 'input_shape': '1x256x200x200;1x64x256', 'input_space_and_range': '', 'input_type_rt': 'featuremap;featuremap', 'input_type_train': 'featuremap;featuremap', 'norm_type': 'no_preprocess;no_preprocess'}, 'calibration_parameters': {'calibration_type': 'skip', 'per_channel': False, 'run_on_bpu': '', 'run_on_cpu': ''}, 'compiler_parameters': {'compile_mode': 'latency', 'core_num': 1, 'debug': True, 'jobs': 32, 'max_time_per_fc': 0, 'optimize_level': 'O0'}}
2024-07-11 16:07:42,224 file: hb_compile.py func: hb_compile line No: 37 Start verifying yaml
2024-07-11 16:07:42,262 file: params_parser.py func: params_parser line No: 157 Using onnx model file: /home/qinyonghang/UniAD/deps/UniAD/output/../models/onnx/occ.onnx
2024-07-11 16:07:42,262 file: onnx_parser.py func: onnx_parser line No: 39 Model input names: ['bev', 'ins_query']
2024-07-11 16:07:42,262 file: params_parser.py func: params_parser line No: 167 Model has 2 inputs according to model file
2024-07-11 16:07:42,262 file: params_parser.py func: params_parser line No: 323 node_dict: {}
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 416 Input shape [1, 64, 256] has length: 3, make sure it is a featuremap input
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 661 Parameter calibration_type is skip. cal_data_dir check skipped
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 793 Input node bev's input_source not set, it will be set to None by default
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 793 Input node ins_query's input_source not set, it will be set to None by default
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 855 Parameter compile_mode is set to latency, balance_factor will set to 100.
2024-07-11 16:07:42,263 file: params_parser.py func: params_parser line No: 895 custom_op does not exist, skipped
2024-07-11 16:07:42,263 file: hb_compile.py func: hb_compile line No: 40 End verifying yaml
2024-07-11 16:07:42,263 file: ptq_model_builder.py func: ptq_model_builder line No: 241 quantize_params is {'cali_dict': {'calibration_type': 'max', 'quant_config': None}, 'input_dict': {'bev': {'input_shape': [1, 256, 200, 200]}, 'ins_query': {'input_shape': [1, 64, 256]}}, 'node_dict': {}, 'debug_methods': [], 'output_nodes': [], 'optimization_methods': None, 'quant_config': None}
2024-07-11 16:07:42,263 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute horizon_nn.api.build_model.
2024-07-11 16:07:42,263 file: model_builder.py func: model_builder line No: 32 Start to Horizon NN Model Convert.
2024-07-11 16:07:42,318 file: model_debugger.py func: model_debugger line No: 66 Loading horizon_nn debug methods:[]
2024-07-11 16:07:42,319 file: model_builder.py func: model_builder line No: 189 The specified model compilation architecture: nash.
2024-07-11 16:07:42,319 file: model_builder.py func: model_builder line No: 193 The specified model compilation optimization parameters: [].
2024-07-11 16:07:42,319 file: model_builder.py func: model_builder line No: 32 Start to prepare the onnx model.
2024-07-11 16:07:42,352 file: prepare.py func: prepare line No: 145 Input ONNX Model Information:
ONNX IR version:          6
Opset version:            ['ai.onnx v11', 'horizon v1']
Producer:                 pytorch v2.1.1
Domain:                   None
Model version:            None
Graph input:
    bev:                  shape=[1, 256, 200, 200], dtype=FLOAT32
    ins_query:            shape=[1, 64, 256], dtype=FLOAT32
Graph output:
    2731:                 shape=['Concat2731_dim_0', 'Concat2731_dim_1', 'Concat2731_dim_2', 'Concat2731_dim_3', 'Concat2731_dim_4'], dtype=FLOAT32
    2857:                 shape=['ReduceSum2857_dim_0', 'ReduceSum2857_dim_1', 'ReduceSum2857_dim_2', 'ReduceSum2857_dim_3', 'ReduceSum2857_dim_4'], dtype=FLOAT32
2024-07-11 16:07:42,556 file: prepare.py func: prepare line No: 42 The original model's opset version is 11, try converting to opset 19.
2024-07-11 16:07:43,002 file: model_builder.py func: model_builder line No: 35 End to prepare the onnx model.
2024-07-11 16:07:43,092 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_original_float_model.onnx.
2024-07-11 16:07:43,093 file: model_builder.py func: model_builder line No: 32 Start to optimize the onnx model.
2024-07-11 16:07:55,463 file: model_builder.py func: model_builder line No: 35 End to optimize the onnx model.
2024-07-11 16:07:55,525 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_optimized_float_model.onnx.
2024-07-11 16:07:55,525 file: model_builder.py func: model_builder line No: 32 Start to calibrate the model.
2024-07-11 16:07:56,092 file: calibration_data_set.py func: calibration_data_set line No: 82 input name: bev,  number_of_samples: 1
2024-07-11 16:07:56,093 file: calibration_data_set.py func: calibration_data_set line No: 82 input name: ins_query,  number_of_samples: 1
2024-07-11 16:07:56,093 file: calibration_data_set.py func: calibration_data_set line No: 96 There are 1 samples in the calibration data set.
2024-07-11 16:07:56,093 file: fixed_calibrater.py func: fixed_calibrater line No: 31 Run calibration model with fixed thresholds method.
2024-07-11 16:07:56,950 file: model_builder.py func: model_builder line No: 35 End to calibrate the model.
2024-07-11 16:07:57,138 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_calibrated_model.onnx.
2024-07-11 16:07:57,138 file: model_builder.py func: model_builder line No: 32 Start to precompile the model.
2024-07-11 16:08:10,960 file: model_builder.py func: model_builder line No: 35 End to precompile the model.
2024-07-11 16:08:11,179 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_ptq_model.onnx.