2024-07-15 18:12:43,275 file: tool_utils.py func: tool_utils line No: 81 log will be stored in /home/qinyonghang/UniAD/deps/UniAD/output/hb_compile.log 2024-07-15 18:12:43,275 file: hb_compile.py func: hb_compile line No: 376 Start hb_compile... 2024-07-15 18:12:43,275 file: hb_compile.py func: hb_compile line No: 377 hbdk version: 4.0.25 2024-07-15 18:12:43,275 file: hb_compile.py func: hb_compile line No: 378 horizon_nn version: 2.0.4 2024-07-15 18:12:43,276 file: hb_compile.py func: hb_compile line No: 379 hb_compile version: 3.2.4 2024-07-15 18:12:43,548 file: yaml_builder.py func: yaml_builder line No: 71 {'model_parameters': {'layer_out_dump': False, 'working_dir': '.hb_compile'}, 'input_parameters': {'input_name': '', 'input_shape': '', 'input_space_and_range': '', 'input_type_rt': 'featuremap', 'input_type_train': 'featuremap', 'norm_type': 'no_preprocess'}, 'calibration_parameters': {'calibration_type': 'skip', 'per_channel': False, 'run_on_bpu': '', 'run_on_cpu': ''}, 'compiler_parameters': {'compile_mode': 'latency', 'core_num': 1, 'debug': True, 'jobs': 32, 'max_time_per_fc': 0, 'optimize_level': 'O0'}} 2024-07-15 18:12:43,548 file: yaml_builder.py func: yaml_builder line No: 72 check template yaml load success 2024-07-15 18:12:43,548 file: yaml_builder.py func: yaml_builder line No: 220 Updated yaml config info: {'model_parameters': {'layer_out_dump': False, 'working_dir': '/home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile', 'onnx_model': '/home/qinyonghang/UniAD/deps/UniAD/output/../models/onnx/occ.onnx', 'march': 'nash-m', 'output_model_file_prefix': 'occ'}, 'input_parameters': {'input_name': 'bev;ins_query;p', 'input_shape': '1x256x200x200;1x64x256;1', 'input_space_and_range': '', 'input_type_rt': 'featuremap;featuremap;featuremap', 'input_type_train': 'featuremap;featuremap;featuremap', 'norm_type': 'no_preprocess;no_preprocess;no_preprocess'}, 'calibration_parameters': {'calibration_type': 'skip', 'per_channel': False, 'run_on_bpu': '', 'run_on_cpu': ''}, 'compiler_parameters': {'compile_mode': 'latency', 'core_num': 1, 'debug': True, 'jobs': 32, 'max_time_per_fc': 0, 'optimize_level': 'O0'}} 2024-07-15 18:12:43,550 file: hb_compile.py func: hb_compile line No: 37 Start verifying yaml 2024-07-15 18:12:43,585 file: params_parser.py func: params_parser line No: 157 Using onnx model file: /home/qinyonghang/UniAD/deps/UniAD/output/../models/onnx/occ.onnx 2024-07-15 18:12:43,586 file: onnx_parser.py func: onnx_parser line No: 39 Model input names: ['bev', 'ins_query', 'p'] 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 167 Model has 3 inputs according to model file 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 323 node_dict: {} 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 416 Input shape [1, 64, 256] has length: 3, make sure it is a featuremap input 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 416 Input shape [1] has length: 1, make sure it is a featuremap input 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 661 Parameter calibration_type is skip. cal_data_dir check skipped 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 793 Input node bev's input_source not set, it will be set to None by default 2024-07-15 18:12:43,586 file: params_parser.py func: params_parser line No: 793 Input node ins_query's input_source not set, it will be set to None by default 2024-07-15 18:12:43,587 file: params_parser.py func: params_parser line No: 793 Input node p's input_source not set, it will be set to None by default 2024-07-15 18:12:43,587 file: params_parser.py func: params_parser line No: 855 Parameter compile_mode is set to latency, balance_factor will set to 100. 2024-07-15 18:12:43,587 file: params_parser.py func: params_parser line No: 895 custom_op does not exist, skipped 2024-07-15 18:12:43,587 file: hb_compile.py func: hb_compile line No: 40 End verifying yaml 2024-07-15 18:12:43,587 file: ptq_model_builder.py func: ptq_model_builder line No: 241 quantize_params is {'cali_dict': {'calibration_type': 'max', 'quant_config': None}, 'input_dict': {'bev': {'input_shape': [1, 256, 200, 200]}, 'ins_query': {'input_shape': [1, 64, 256]}, 'p': {'input_shape': [1]}}, 'node_dict': {}, 'debug_methods': [], 'output_nodes': [], 'optimization_methods': None, 'quant_config': None} 2024-07-15 18:12:43,587 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute horizon_nn.api.build_model. 2024-07-15 18:12:43,587 file: model_builder.py func: model_builder line No: 32 Start to Horizon NN Model Convert. 2024-07-15 18:12:43,706 file: model_debugger.py func: model_debugger line No: 66 Loading horizon_nn debug methods:[] 2024-07-15 18:12:43,707 file: model_builder.py func: model_builder line No: 189 The specified model compilation architecture: nash. 2024-07-15 18:12:43,707 file: model_builder.py func: model_builder line No: 193 The specified model compilation optimization parameters: []. 2024-07-15 18:12:43,707 file: model_builder.py func: model_builder line No: 32 Start to prepare the onnx model. 2024-07-15 18:12:43,734 file: prepare.py func: prepare line No: 145 Input ONNX Model Information: ONNX IR version: 6 Opset version: ['ai.onnx v11', 'horizon v1'] Producer: pytorch v2.1.1 Domain: None Model version: None Graph input: bev: shape=[1, 256, 200, 200], dtype=FLOAT32 ins_query: shape=[1, 64, 256], dtype=FLOAT32 p: shape=[1], dtype=INT64 Graph output: 2601: shape=[64, 5, 200, 200], dtype=FLOAT32 2024-07-15 18:12:43,877 file: prepare.py func: prepare line No: 42 The original model's opset version is 11, try converting to opset 19. 2024-07-15 18:12:44,074 file: model_builder.py func: model_builder line No: 35 End to prepare the onnx model. 2024-07-15 18:12:44,134 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_original_float_model.onnx. 2024-07-15 18:12:44,135 file: model_builder.py func: model_builder line No: 32 Start to optimize the onnx model. 2024-07-15 18:12:45,715 file: model_builder.py func: model_builder line No: 35 End to optimize the onnx model. 2024-07-15 18:12:45,777 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_optimized_float_model.onnx. 2024-07-15 18:12:45,777 file: model_builder.py func: model_builder line No: 32 Start to calibrate the model. 2024-07-15 18:12:46,225 file: calibration_data_set.py func: calibration_data_set line No: 82 input name: bev, number_of_samples: 1 2024-07-15 18:12:46,226 file: calibration_data_set.py func: calibration_data_set line No: 82 input name: ins_query, number_of_samples: 1 2024-07-15 18:12:46,226 file: calibration_data_set.py func: calibration_data_set line No: 82 input name: p, number_of_samples: 1 2024-07-15 18:12:46,226 file: calibration_data_set.py func: calibration_data_set line No: 96 There are 1 samples in the calibration data set. 2024-07-15 18:12:46,226 file: fixed_calibrater.py func: fixed_calibrater line No: 31 Run calibration model with fixed thresholds method. 2024-07-15 18:12:47,249 file: model_builder.py func: model_builder line No: 35 End to calibrate the model. 2024-07-15 18:12:47,474 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_calibrated_model.onnx. 2024-07-15 18:12:47,475 file: model_builder.py func: model_builder line No: 32 Start to precompile the model. 2024-07-15 18:12:50,327 file: model_builder.py func: model_builder line No: 35 End to precompile the model. 2024-07-15 18:12:50,552 file: model_builder.py func: model_builder line No: 239 Saving model to: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_ptq_model.onnx. 2024-07-15 19:16:45,273 file: model_builder.py func: model_builder line No: 35 End to Horizon NN Model Convert. 2024-07-15 19:16:45,335 file: wrap_utils.py func: wrap_utils line No: 18 End to execute horizon_nn.api.build_model. 2024-07-15 19:16:45,349 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute hbdk.export. 2024-07-15 19:16:49,557 file: wrap_utils.py func: wrap_utils line No: 18 End to execute hbdk.export. 2024-07-15 19:16:49,570 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute hbdk.set_func_desc. 2024-07-15 19:16:49,577 file: wrap_utils.py func: wrap_utils line No: 18 End to execute hbdk.set_func_desc. 2024-07-15 19:16:49,577 file: hbm_builder.py func: hbm_builder line No: 150 current input_names: ['bev', 'ins_query', 'p'] 2024-07-15 19:16:49,578 file: hbm_builder.py func: hbm_builder line No: 154 bev input_source ddr 2024-07-15 19:16:49,578 file: hbm_builder.py func: hbm_builder line No: 150 current input_names: ['bev', 'ins_query', 'p'] 2024-07-15 19:16:49,578 file: hbm_builder.py func: hbm_builder line No: 154 ins_query input_source ddr 2024-07-15 19:16:49,578 file: hbm_builder.py func: hbm_builder line No: 150 current input_names: ['bev', 'ins_query', 'p'] 2024-07-15 19:16:49,578 file: hbm_builder.py func: hbm_builder line No: 154 p input_source ddr 2024-07-15 19:16:49,578 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute hbdk.convert. 2024-07-15 19:16:55,442 file: wrap_utils.py func: wrap_utils line No: 18 End to execute hbdk.convert. 2024-07-15 19:16:55,443 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute hbdk.save. 2024-07-15 19:16:55,629 file: hbm_builder.py func: hbm_builder line No: 213 Successful covert model: /home/qinyonghang/UniAD/deps/UniAD/output/.hb_compile/occ_quantized_model.bc 2024-07-15 19:16:55,633 file: wrap_utils.py func: wrap_utils line No: 18 End to execute hbdk.save. 2024-07-15 19:16:55,669 file: hbm_builder.py func: hbm_builder line No: 52 Compile params: {'jobs': 32, 'balance': 100, 'hbdk3_compatible_mode': False, 'progress_bar': True, 'opt': 0, 'max_time_per_fc': 0, 'debug': True} 2024-07-15 19:17:00,239 file: wrap_utils.py func: wrap_utils line No: 15 Start to execute hbdk.compile. 2024-07-15 19:32:18,653 file: tool_utils.py func: tool_utils line No: 139 exception in command: main 2024-07-15 19:32:18,656 file: tool_utils.py func: tool_utils line No: 140 Traceback (most recent call last): File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/utils/wrap_utils.py", line 17, in wrapper result = func(*args, **kwargs) File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/hbir_handle.py", line 67, in compile_model compile(m=self.model, path=save_path, march=march, **compile_params) File "/home/qinyonghang/.local/lib/python3.10/site-packages/hbdk4/compiler/apis.py", line 205, in compile _compileV2(new_m.module, m.module.context, args) ValueError: Failed to run pass pipeline The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/utils/tool_utils.py", line 137, in __decorator func(*args, **kargs) File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/hb_compile.py", line 399, in main check_mode(model, proto, march, input_shape) File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/hb_compile.py", line 338, in check_mode hbm_build(conf, ptq_model) File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/hb_compile.py", line 239, in hbm_build hbm_builder.build() File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/compile/hbm_builder.py", line 237, in build self.compile_model() File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/compile/hbm_builder.py", line 219, in compile_model compile_handler.compile_model(save_path=self.hbm_save_path, File "/home/qinyonghang/miniconda3/envs/j6/lib/python3.10/site-packages/horizon_tc_ui/utils/wrap_utils.py", line 22, in wrapper raise ValueError(f"*** ERROR-OCCUR-DURING {module_info} ***," + ValueError: *** ERROR-OCCUR-DURING hbdk.compile ***, error message: Failed to run pass pipeline 2024-07-15 19:32:18,657 file: tool_utils.py func: tool_utils line No: 141 *** ERROR-OCCUR-DURING hbdk.compile ***, error message: Failed to run pass pipeline