2023-07-05 17:30:54,879 file: build.py func: build line No: 39 [Wed Jul 5 17:30:54 2023] Start to Horizon NN Model Convert. 2023-07-05 17:30:54,880 file: dict_parser.py func: dict_parser line No: 37 Parsing the input parameter:{'img': {'input_shape': [6, 3, 256, 704], 'expected_input_type': 'RGB_128', 'original_input_type': 'RGB', 'original_input_layout': 'NCHW', 'means': array([123.675, 116.28 , 103.53 ], dtype=float32), 'scales': array([0.017125, 0.017507, 0.017429], dtype=float32)}, 'points_adjust': {'input_shape': [6, 128, 128, 2], 'original_input_layout': 'NHWC'}} 2023-07-05 17:30:54,880 file: build.py func: build line No: 199 Parsing the calibration parameter 2023-07-05 17:30:54,881 file: dict_parser.py func: dict_parser line No: 521 Parsing the hbdk parameter:{'hbdk_pass_through_params': '--O3 --core-num 1 --fast ', 'input-source': {'img': 'ddr', 'points_adjust': 'ddr', '_default_value': 'ddr'}} 2023-07-05 17:30:54,881 file: build.py func: build line No: 152 HorizonNN version: 0.15.7 2023-07-05 17:30:54,881 file: build.py func: build line No: 156 HBDK version: 3.42.2 2023-07-05 17:30:54,881 file: build.py func: build line No: 39 [Wed Jul 5 17:30:54 2023] Start to parse the onnx model. 2023-07-05 17:30:55,168 file: onnx_parser.py func: onnx_parser line No: 235 Input ONNX model infomation: ONNX IR version: 7 Opset version: [11, 1] Producer: pytorch1.10 Domain: none Input name: img, [6, 3, 256, 704] Input name: points_adjust, [6, 128, 128, 2] Output name: task0, [0, 0, 0, 0] Output name: task1, [0, 0, 0, 0] Output name: task2, [0, 0, 0, 0] Output name: task3, [0, 0, 0, 0] Output name: task4, [0, 0, 0, 0] Output name: task5, [0, 0, 0, 0] 2023-07-05 17:30:56,898 file: build.py func: build line No: 42 [Wed Jul 5 17:30:56 2023] End to parse the onnx model. 2023-07-05 17:30:56,899 file: build.py func: build line No: 233 Model input names parsed from model: ['img', 'points_adjust'] 2023-07-05 17:30:56,899 file: dict_parser.py func: dict_parser line No: 296 Create a preprocessing operator for input_name img with means=[123.675 116.28 103.53 ], std=[58.39416292 57.12000948 57.37563907], original_input_layout=NCHW, color convert from 'RGB' to 'RGB'. 2023-07-05 17:30:58,267 file: build.py func: build line No: 507 Saving the original float model: bev_256x704_img_128x128_ipm_original_float_model.onnx. 2023-07-05 17:30:58,269 file: build.py func: build line No: 39 [Wed Jul 5 17:30:58 2023] Start to optimize the model. 2023-07-05 17:31:00,668 file: build.py func: build line No: 42 [Wed Jul 5 17:31:00 2023] End to optimize the model. 2023-07-05 17:31:00,903 file: build.py func: build line No: 523 Saving the optimized model: bev_256x704_img_128x128_ipm_optimized_float_model.onnx. 2023-07-05 17:31:00,903 file: build.py func: build line No: 39 [Wed Jul 5 17:31:00 2023] Start to calibrate the model. 2023-07-05 17:31:00,905 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: img, number_of_samples: 151 2023-07-05 17:31:00,905 file: calibration_data_set.py func: calibration_data_set line No: 89 input name: points_adjust, number_of_samples: 151 2023-07-05 17:31:00,905 file: calibration_data_set.py func: calibration_data_set line No: 100 There are 151 samples in the calibration data set. 2023-07-05 17:31:02,690 file: kl_calibrater.py func: kl_calibrater line No: 56 Run calibration model with kl method. 2023-07-05 18:25:54,763 file: calibrater.py func: calibrater line No: 52 find illegal threshold in Mul_170Mul_1701010_scale2vec_expand_dims, it will be set default. 2023-07-05 18:25:54,764 file: calibrater.py func: calibrater line No: 52 find illegal threshold in Sub_1731015_expand_dims, it will be set default. 2023-07-05 18:25:54,764 file: calibrater.py func: calibrater line No: 52 find illegal threshold in Mul_1751010_expand_dims, it will be set default. 2023-07-05 18:25:54,764 file: calibrater.py func: calibrater line No: 52 find illegal threshold in Sub_1781015_expand_dims, it will be set default. 2023-07-05 18:25:55,389 file: build.py func: build line No: 42 [Wed Jul 5 18:25:55 2023] End to calibrate the model. 2023-07-05 18:25:55,390 file: build.py func: build line No: 39 [Wed Jul 5 18:25:55 2023] Start to quantize the model. 2023-07-05 18:29:03,464 file: build.py func: build line No: 42 [Wed Jul 5 18:29:03 2023] End to quantize the model. 2023-07-05 18:29:05,715 file: build.py func: build line No: 538 Saving the quantized model: bev_256x704_img_128x128_ipm_quantized_model.onnx. 2023-07-05 18:29:13,020 file: build.py func: build line No: 39 [Wed Jul 5 18:29:13 2023] Start to compile the model with march bayes. 2023-07-05 18:29:16,456 file: hybrid_build.py func: hybrid_build line No: 149 Compile submodel: torch-jit-export_subgraph_0 2023-07-05 18:29:21,753 file: hbdk_cc.py func: hbdk_cc line No: 117 hbdk-cc parameters:['--O3', '--core-num', '1', '--fast', '--input-layout', 'NHWC', '--output-layout', 'NHWC', '--input-source', 'ddr,ddr'] 2023-07-05 18:29:21,753 file: hbdk_cc.py func: hbdk_cc line No: 118 hbdk-cc command used:hbdk-cc -f hbir -m /tmp/tmpmsxepy22/torch-jit-export_subgraph_0.bin -o /tmp/tmpmsxepy22/torch-jit-export_subgraph_0.hbm --march bayes --progressbar --O3 --core-num 1 --fast --input-layout NHWC --output-layout NHWC --input-source ddr,ddr 2023-07-05 18:29:21,849 file: tool_utils.py func: tool_utils line No: 317 Can not find the scale for node HZ_PREPROCESS_FOR_img_NCHW2NHWC_LayoutConvert_Input0 2023-07-05 18:54:35,771 file: build.py func: build line No: 42 [Wed Jul 5 18:54:35 2023] End to compile the model with march bayes. 2023-07-05 18:54:35,780 file: node_info.py func: node_info line No: 54 The converted model node information: ============================================================================================================================ Node ON Subgraph Type Cosine Similarity Threshold ----------------------------------------------------------------------------------------------------------------------------- HZ_PREPROCESS_FOR_img BPU id(0) HzSQuantizedPreprocess 0.999766 127.000000 Conv_0 BPU id(0) HzSQuantizedConv 0.999353 2.133375 MaxPool_2 BPU id(0) HzQuantizedMaxPool 0.999773 2.094344 Conv_3 BPU id(0) HzSQuantizedConv 0.999216 2.094344 Conv_5 BPU id(0) HzSQuantizedConv 0.999022 1.335118 Conv_7 BPU id(0) HzSQuantizedConv 0.998259 1.641759 Conv_8 BPU id(0) HzSQuantizedConv 0.998053 2.094344 Conv_11 BPU id(0) HzSQuantizedConv 0.998275 1.741621 Conv_13 BPU id(0) HzSQuantizedConv 0.997356 1.191840 Conv_15 BPU id(0) HzSQuantizedConv 0.997475 2.098122 Conv_18 BPU id(0) HzSQuantizedConv 0.995552 2.117683 Conv_20 BPU id(0) HzSQuantizedConv 0.993404 1.203993 Conv_22 BPU id(0) HzSQuantizedConv 0.996101 1.558601 Conv_25 BPU id(0) HzSQuantizedConv 0.993333 2.052084 Conv_27 BPU id(0) HzSQuantizedConv 0.997240 2.159429 Conv_29 BPU id(0) HzSQuantizedConv 0.996210 1.523375 Conv_30 BPU id(0) HzSQuantizedConv 0.996377 2.052084 Conv_33 BPU id(0) HzSQuantizedConv 0.995950 2.405061 Conv_35 BPU id(0) HzSQuantizedConv 0.995064 1.318601 Conv_37 BPU id(0) HzSQuantizedConv 0.994641 2.068119 Conv_40 BPU id(0) HzSQuantizedConv 0.993682 2.425885 Conv_42 BPU id(0) HzSQuantizedConv 0.994228 1.624182 Conv_44 BPU id(0) HzSQuantizedConv 0.993308 1.813342 Conv_47 BPU id(0) HzSQuantizedConv 0.994704 2.980099 Conv_49 BPU id(0) HzSQuantizedConv 0.995257 1.677925 Conv_51 BPU id(0) HzSQuantizedConv 0.992639 1.823609 Conv_54 BPU id(0) HzSQuantizedConv 0.991975 2.979232 Conv_56 BPU id(0) HzSQuantizedConv 0.996234 2.622818 Conv_58 BPU id(0) HzSQuantizedConv 0.995907 2.122590 Conv_59 BPU id(0) HzSQuantizedConv 0.994968 2.979232 Conv_62 BPU id(0) HzSQuantizedConv 0.994481 4.122482 Conv_64 BPU id(0) HzSQuantizedConv 0.995724 2.442700 Conv_66 BPU id(0) HzSQuantizedConv 0.994725 2.888039 Conv_69 BPU id(0) HzSQuantizedConv 0.995233 3.499794 Conv_71 BPU id(0) HzSQuantizedConv 0.995676 2.131146 Conv_73 BPU id(0) HzSQuantizedConv 0.994527 2.015903 Conv_76 BPU id(0) HzSQuantizedConv 0.994670 3.463558 Conv_78 BPU id(0) HzSQuantizedConv 0.995169 2.220602 Conv_80 BPU id(0) HzSQuantizedConv 0.994103 2.154724 Conv_83 BPU id(0) HzSQuantizedConv 0.994211 3.451010 Conv_85 BPU id(0) HzSQuantizedConv 0.995068 2.442895 Conv_87 BPU id(0) HzSQuantizedConv 0.993583 2.488642 Conv_90 BPU id(0) HzSQuantizedConv 0.992626 2.936829 Conv_92 BPU id(0) HzSQuantizedConv 0.993998 2.760439 Conv_94 BPU id(0) HzSQuantizedConv 0.992298 2.643914 Conv_97 BPU id(0) HzSQuantizedConv 0.989914 4.075393 Conv_99 BPU id(0) HzSQuantizedConv 0.993105 2.728050 Conv_101 BPU id(0) HzSQuantizedConv 0.996732 2.986822 Conv_102 BPU id(0) HzSQuantizedConv 0.991583 4.075393 Conv_105 BPU id(0) HzSQuantizedConv 0.991941 10.909781 Conv_107 BPU id(0) HzSQuantizedConv 0.993008 2.949270 Conv_109 BPU id(0) HzSQuantizedConv 0.990432 3.138020 Conv_112 BPU id(0) HzSQuantizedConv 0.990679 11.320956 Conv_114 BPU id(0) HzSQuantizedConv 0.993979 3.105247 Conv_116 BPU id(0) HzSQuantizedConv 0.984931 2.347133 Resize_127 BPU id(0) HzQuantizedRoiResize 0.987828 7.536957 893_Requantize BPU id(0) HzRequantize Concat_128 BPU id(0) Concat 0.988267 4.075393 Conv_129 BPU id(0) HzSQuantizedConv 0.989790 7.536957 Conv_131 BPU id(0) HzSQuantizedConv 0.990618 5.149519 Resize_141 BPU id(0) HzQuantizedRoiResize 0.991828 3.345561 831_Requantize BPU id(0) HzRequantize Concat_142 BPU id(0) Concat 0.992006 2.979232 Conv_143 BPU id(0) HzSQuantizedConv 0.989383 3.345561 Conv_145 BPU id(0) HzSQuantizedConv 0.989516 4.507787 Conv_147 BPU id(0) HzSQuantizedConv 0.989276 5.702271 Gather_164 BPU id(0) Gather 0.999941 110275.281250 Gather_164_reshape BPU id(0) Reshape Add_165 BPU id(0) HzSElementwiseAdd 0.999939 110275.281250 Gather_167 BPU id(0) Gather 0.995280 110275.281250 Gather_167_reshape BPU id(0) Reshape 1008_Requantize BPU id(0) HzRequantize Add_168 BPU id(0) HzSElementwiseAdd 0.994438 5733.639648 Mul_170 BPU id(0) HzSElementwiseMul 0.999883 110275.281250 Sub_173 BPU id(0) HzSElementwiseSub 0.999865 2535.063965 Mul_175 BPU id(0) HzSElementwiseMul 0.994405 5733.639648 Sub_178 BPU id(0) HzSElementwiseSub 0.993871 369.912231 Unsqueeze_179 BPU id(0) Reshape Unsqueeze_180 BPU id(0) Reshape Concat_181 BPU id(0) Concat 0.999714 2848.837158 UNIT_CONV_FOR_GridSample_182 BPU id(0) HzSQuantizedConv 0.674032 2848.837158 GridSample_182_grid_split BPU id(0) Split GridSample_182_grid_add_for_x BPU id(0) HzSElementwiseAdd GridSample_182_grid_add_for_y BPU id(0) HzSElementwiseAdd GridSample_182_concat BPU id(0) Concat GridSample_182_grid_sub BPU id(0) HzSElementwiseSub GridSample_182 BPU id(0) HzQuantizedGridSample 0.309814 3.803920 Reshape_183 BPU id(0) Reshape ReduceSum_184 BPU id(0) HzSQuantizedReduceSum 0.555897 3.803920 ReduceSum_184_reshape BPU id(0) Reshape Conv_185 BPU id(0) HzSQuantizedConv 0.222916 3.803920 Conv_187 BPU id(0) HzSQuantizedConv 0.096698 7.525449 Conv_188 BPU id(0) HzSQuantizedConv 0.341348 3.803920 Conv_191 BPU id(0) HzSQuantizedConv 0.244867 11.095483 Conv_193 BPU id(0) HzSQuantizedConv 0.419316 4.827643 Conv_196 BPU id(0) HzSQuantizedConv 0.283038 11.820766 Conv_198 BPU id(0) HzSQuantizedConv 0.162756 5.908960 Conv_199 BPU id(0) HzSQuantizedConv 0.324242 11.820766 Conv_202 BPU id(0) HzSQuantizedConv 0.329911 8.900578 Conv_204 BPU id(0) HzSQuantizedConv 0.412867 6.480927 Conv_207 BPU id(0) HzSQuantizedConv 0.328469 8.817931 Conv_209 BPU id(0) HzSQuantizedConv 0.311125 4.645796 Conv_210 BPU id(0) HzSQuantizedConv 0.366162 8.817931 Conv_213 BPU id(0) HzSQuantizedConv 0.326370 6.616411 Conv_215 BPU id(0) HzSQuantizedConv 0.383618 6.169065 Resize_219 BPU id(0) HzQuantizedRoiResize 0.392454 7.857287 1055_Requantize BPU id(0) HzRequantize Concat_220 BPU id(0) Concat 0.406169 7.857287 Conv_221 BPU id(0) HzSQuantizedConv 0.282949 7.857287 Conv_223 BPU id(0) HzSQuantizedConv 0.461374 6.220785 Resize_226 BPU id(0) HzQuantizedRoiResize 0.468855 3.721247 Conv_227 BPU id(0) HzSQuantizedConv 0.485257 3.721247 Conv_229 BPU id(0) HzSQuantizedConv 0.689295 9.399282 Conv_231 BPU id(0) HzSQuantizedConv 0.382116 8.511086 Conv_233 BPU id(0) HzSQuantizedConv 0.980025 8.719223 Conv_234 BPU id(0) HzSQuantizedConv 0.367203 8.511086 Conv_236 BPU id(0) HzSQuantizedConv 0.898730 9.829160 Conv_237 BPU id(0) HzSQuantizedConv 0.437252 8.511086 Conv_239 BPU id(0) HzSQuantizedConv 0.995458 7.605279 Conv_240 BPU id(0) HzSQuantizedConv 0.366375 8.511086 Conv_242 BPU id(0) HzSQuantizedConv 0.050096 9.448231 Conv_243 BPU id(0) HzSQuantizedConv 0.450514 8.511086 Conv_245 BPU id(0) HzSQuantizedConv 0.192692 9.997887 Conv_246 BPU id(0) HzSQuantizedConv 0.383455 8.511086 Conv_248 BPU id(0) HzSQuantizedConv 0.951466 6.861767 Conv_249 BPU id(0) HzSQuantizedConv 0.571162 8.511086 Conv_251 BPU id(0) HzSQuantizedConv 0.973335 6.443427 Conv_252 BPU id(0) HzSQuantizedConv 0.425128 8.511086 Conv_254 BPU id(0) HzSQuantizedConv 0.859724 10.079817 Conv_255 BPU id(0) HzSQuantizedConv 0.423667 8.511086 Conv_257 BPU id(0) HzSQuantizedConv 0.972982 7.627350 Conv_258 BPU id(0) HzSQuantizedConv 0.334888 8.511086 Conv_260 BPU id(0) HzSQuantizedConv 0.009913 10.857686 Conv_261 BPU id(0) HzSQuantizedConv 0.306525 8.511086 Conv_263 BPU id(0) HzSQuantizedConv 0.145816 4.728426 Conv_264 BPU id(0) HzSQuantizedConv 0.485959 8.511086 Conv_266 BPU id(0) HzSQuantizedConv 0.955099 7.865407 Conv_267 BPU id(0) HzSQuantizedConv 0.540646 8.511086 Conv_269 BPU id(0) HzSQuantizedConv 0.966944 9.064408 Conv_270 BPU id(0) HzSQuantizedConv 0.446034 8.511086 Conv_272 BPU id(0) HzSQuantizedConv 0.938695 9.597807 Conv_273 BPU id(0) HzSQuantizedConv 0.452473 8.511086 Conv_275 BPU id(0) HzSQuantizedConv 0.976399 8.390079 Conv_276 BPU id(0) HzSQuantizedConv 0.374920 8.511086 Conv_278 BPU id(0) HzSQuantizedConv -0.043503 9.664576 Conv_279 BPU id(0) HzSQuantizedConv 0.217932 8.511086 Conv_281 BPU id(0) HzSQuantizedConv -0.043960 9.685871 Conv_282 BPU id(0) HzSQuantizedConv 0.537903 8.511086 Conv_284 BPU id(0) HzSQuantizedConv 0.962610 6.329774 Conv_285 BPU id(0) HzSQuantizedConv 0.357567 8.511086 Conv_287 BPU id(0) HzSQuantizedConv 0.757191 10.711418 Conv_288 BPU id(0) HzSQuantizedConv 0.388842 8.511086 Conv_290 BPU id(0) HzSQuantizedConv 0.770132 10.944383 Conv_291 BPU id(0) HzSQuantizedConv 0.416007 8.511086 Conv_293 BPU id(0) HzSQuantizedConv 0.600047 8.246118 Conv_294 BPU id(0) HzSQuantizedConv 0.316375 8.511086 Conv_296 BPU id(0) HzSQuantizedConv 0.342086 8.686859 Conv_297 BPU id(0) HzSQuantizedConv 0.000771 8.511086 Conv_299 BPU id(0) HzSQuantizedConv 0.187712 5.863175 Conv_300 BPU id(0) HzSQuantizedConv 0.434047 8.511086 Conv_302 BPU id(0) HzSQuantizedConv 0.881322 8.220150 Conv_303 BPU id(0) HzSQuantizedConv 0.393089 8.511086 Conv_305 BPU id(0) HzSQuantizedConv 0.268462 9.288347 Conv_306 BPU id(0) HzSQuantizedConv 0.399182 8.511086 Conv_308 BPU id(0) HzSQuantizedConv 0.670201 10.623415 Conv_309 BPU id(0) HzSQuantizedConv 0.356178 8.511086 Conv_311 BPU id(0) HzSQuantizedConv 0.289637 7.346363 Conv_312 BPU id(0) HzSQuantizedConv 0.313694 8.511086 Conv_314 BPU id(0) HzSQuantizedConv 0.076390 11.275399 Conv_315 BPU id(0) HzSQuantizedConv 0.158245 8.511086 Conv_317 BPU id(0) HzSQuantizedConv 0.023018 13.071164 Conv_318 BPU id(0) HzSQuantizedConv 0.484650 8.511086 Conv_320 BPU id(0) HzSQuantizedConv 0.894265 7.763505 Conv_321 BPU id(0) HzSQuantizedConv 0.433648 8.511086 Conv_323 BPU id(0) HzSQuantizedConv 0.975370 7.231327 Conv_324 BPU id(0) HzSQuantizedConv 0.324564 8.511086 Conv_326 BPU id(0) HzSQuantizedConv 0.834580 8.057782 Conv_327 BPU id(0) HzSQuantizedConv 0.415880 8.511086 Conv_329 BPU id(0) HzSQuantizedConv 0.743368 6.414621 Conv_330 BPU id(0) HzSQuantizedConv 0.378043 8.511086 Conv_332 BPU id(0) HzSQuantizedConv -0.016767 12.643826 Conv_333 BPU id(0) HzSQuantizedConv 0.015792 8.511086 Conv_335 BPU id(0) HzSQuantizedConv 0.011078 0.148269 Conv_336 BPU id(0) HzSQuantizedConv 0.446169 8.511086 Conv_338 BPU id(0) HzSQuantizedConv 0.889828 5.703768 Concat_339 CPU -- Concat 0.765954 -- Concat_340 CPU -- Concat 0.906452 -- Concat_341 CPU -- Concat 0.912151 -- Concat_342 CPU -- Concat 0.843090 -- Concat_343 CPU -- Concat 0.849114 -- Concat_344 CPU -- Concat 0.848407 -- 2023-07-05 18:54:35,781 file: build.py func: build line No: 598 The quantify model output: ============================================================================= Node Cosine Similarity L1 Distance L2 Distance Chebyshev Distance ----------------------------------------------------------------------------- Concat_339 0.765954 0.670977 0.003214 10.216146 Concat_340 0.906452 1.038763 0.004452 15.673310 Concat_341 0.912151 1.171066 0.004730 15.920738 Concat_342 0.843090 0.797155 0.004998 34.988979 Concat_343 0.849114 1.808242 0.008781 45.808876 Concat_344 0.848407 0.758469 0.003980 23.993338 2023-07-05 18:54:35,786 file: build.py func: build line No: 42 [Wed Jul 5 18:54:35 2023] End to Horizon NN Model Convert. 2023-07-05 18:54:36,888 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 550 start convert to *.bin file.... 2023-07-05 18:54:37,123 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4168 ONNX model output num : 6 2023-07-05 18:54:37,200 file: layout_util.py func: layout_util line No: 15 set_featuremap_layout start 2023-07-05 18:54:37,200 file: layout_util.py func: layout_util line No: 21 type item 0, featuremap 2023-07-05 18:54:37,201 file: layout_util.py func: layout_util line No: 257 A NHWC2NCHW transpose node will be added for input points_adjust in bin model since except for Quanitze/Dequantize and transpose, all other op's are treated as nchw layout by default! 2023-07-05 18:54:37,201 file: onnx2horizonrt.py func: onnx2horizonrt line No: 3915 model_deps_info: {'hb_mapper_version': '1.14.2', 'hbdk_version': '3.42.2', 'hbdk_runtime_version': ' 3.15.10.0', 'horizon_nn_version': '0.15.7', 'onnx_model': '/WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/bev_data/horizon_resnet50_ipm_s.onnx', 'march': 'bayes', 'layer_out_dump': False, 'log_level': 'DEBUG', 'working_dir': '/WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/model_output', 'model_prefix': 'bev_256x704_img_128x128_ipm', 'input_names': ['points_adjust', 'img'], 'input_type_rt': ['featuremap', 'rgb'], 'input_space_and_range': ['regular', 'regular'], 'input_type_train': ['featuremap', 'rgb'], 'input_layout_rt': ['NHWC', 'NCHW'], 'input_layout_train': ['NHWC', 'NCHW'], 'norm_type': ['no_preprocess', 'data_mean_and_scale'], 'scale_value': ['', '0.017125,0.017507,0.017429,'], 'mean_value': ['', '123.675,116.28,103.53,'], 'input_shape': ['6x128x128x2', '6x3x256x704'], 'input_batch': [], 'cal_dir': ['/WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/calibration_data/calibrate_points_f32', '/WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/calibration_data/calibrate_imgs_f32'], 'cal_data_type': ['float32', 'float32'], 'preprocess_on': False, 'calibration_type': 'kl', 'hbdk_params': {'hbdk_pass_through_params': '--O3 --core-num 1 --fast ', 'input-source': {'img': 'ddr', 'points_adjust': 'ddr', '_default_value': 'ddr'}}, 'ADD_NODES_IN_BUILD': 'transpose_node_points_adjust2nchw '} 2023-07-05 18:54:37,201 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4029 ############# model deps info ############# 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4030 hb_mapper version : 1.14.2 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4033 hbdk version : 3.42.2 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4035 hbdk runtime version: 3.15.10.0 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4038 horizon_nn version : 0.15.7 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4042 ############# model_parameters info ############# 2023-07-05 18:54:37,202 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4048 onnx_model : /WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/bev_data/horizon_resnet50_ipm_s.onnx 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4049 BPU march : bayes 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4050 layer_out_dump : False 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4051 log_level : DEBUG 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4052 working dir : /WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/model_output 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4053 output_model_file_prefix: bev_256x704_img_128x128_ipm 2023-07-05 18:54:37,203 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4067 ############# input_parameters info ############# 2023-07-05 18:54:37,204 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4085 ------------------------------------------ 2023-07-05 18:54:37,204 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4087 ---------input info : points_adjust --------- 2023-07-05 18:54:37,204 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4088 input_name : points_adjust 2023-07-05 18:54:37,204 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4089 input_type_rt : featuremap 2023-07-05 18:54:37,204 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4091 input_space&range : regular 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4093 input_layout_rt : NHWC 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4094 input_type_train : featuremap 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4095 input_layout_train : NHWC 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4096 norm_type : no_preprocess 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4097 input_shape : 6x128x128x2 2023-07-05 18:54:37,205 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4107 cal_data_dir : /WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/calibration_data/calibrate_points_f32 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4109 cal_data_type : float32 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4110 ---------input info : points_adjust end ------- 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4087 ---------input info : img --------- 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4088 input_name : img 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4089 input_type_rt : rgb 2023-07-05 18:54:37,206 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4091 input_space&range : regular 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4093 input_layout_rt : NCHW 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4094 input_type_train : rgb 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4095 input_layout_train : NCHW 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4096 norm_type : data_mean_and_scale 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4097 input_shape : 6x3x256x704 2023-07-05 18:54:37,207 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4103 mean_value : 123.675,116.28,103.53, 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4105 scale_value : 0.017125,0.017507,0.017429, 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4107 cal_data_dir : /WORKSPACE/horizon_j5_open_explorer_v1.1.40-py38_20230210/ddk/samples/ai_toolchain/horizon_model_convert_sample/08_bevdet_ipm/calibration_data/calibrate_imgs_f32 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4109 cal_data_type : float32 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4110 ---------input info : img end ------- 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4111 ------------------------------------------ 2023-07-05 18:54:37,208 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4113 ############# calibration_parameters info ############# 2023-07-05 18:54:37,209 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4114 preprocess_on : False 2023-07-05 18:54:37,209 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4115 calibration_type: : kl 2023-07-05 18:54:37,209 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4142 ############# compiler_parameters info ############# 2023-07-05 18:54:37,209 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4145 hbdk_pass_through_params: --O3 --core-num 1 --fast 2023-07-05 18:54:37,209 file: onnx2horizonrt.py func: onnx2horizonrt line No: 4145 input-source : {'img': 'ddr', 'points_adjust': 'ddr', '_default_value': 'ddr'} 2023-07-05 18:54:37,263 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 717 Convert to runtime bin file successfully! 2023-07-05 18:54:37,263 file: hb_mapper_makertbin.py func: hb_mapper_makertbin line No: 718 End Model Convert