English

Model Inference API Overview

This section mainly introduces the API, data, structures, layout, and alignment rules of model inference. By reading this section, you can use APIs to complete operations such as model loading and releasing, model information obtaining, and model inference on dev boards provided by Horizon Robotics.

Data Type and Data Structure

Name	Description
HB_DNN_TENSOR_MAX_DIMENSIONS	Maximum dimension of the tensor
hbDNNPackedHandle_t	DNN handle, pointing to the packed multiple models
hbDNNHandle_t	DNN handle, pointing to the single model
hbDNNDataType	Tensor type
hbDNNTensorShape	Tensor shape
hbDNNQuantiShift	Quantization/dequantization shift data
hbDNNQuantiScale	Quantization/dequantization scale data
hbDNNQuantiType	Fixed-point to floating-point conversion quantization/dequantization type
hbDNNTensorProperties	Tensor information
hbDNNTensor	Tensor
hbDNNRoi	Rectangular region of interest

API Interface

Name	Description
hbDNNGetVersion	Get version info of DNN prediction library
hbDNNInitializeFromFiles	Complete the creation and initialization of `dnnPackedHandle` from the file
hbDNNInitializeFromDDR	Complete the creation and initialization of `dnnPackedHandle` from the memory
hbDNNRelease	Release the model that `dnnPackedHandle` points to
hbDNNGetModelNameList	Get the name list and number of the models that `dnnPackedHandle` points to
hbDNNGetModelHandle	Get the handle of a model from the model list that `dnnPackedHandle` points to
hbDNNGetInputCount	Get the number of the input tensors of the model that `dnnHandle` points to
hbDNNGetInputName	Get the names of the input tensors of the model that `dnnHandle` points to
hbDNNGetInputTensorProperties	Get the property of the specific input tensor of the model that `dnnHandle` points to
hbDNNGetOutputCount	Get the number of the output tensors of the model that `dnnHandle` points to
hbDNNGetOutputName	Get the names of the output tensors of the model that `dnnHandle` points to
hbDNNGetOutputTensorProperties	Get the property of the specific output tensor of the model that `dnnHandle` points to
hbDNNInferV2	Create synchronous/asynchronous inference tasks based on input parameters
hbDNNRoiInferV2	Create ROI synchronous/asynchronous inference tasks based on input parameters
hbDNNGetErrorDesc	Translate the error codes into natural language

On This Page

The hb_compile Tool

QAT

Model Export

Horizon Operator

Vision Algorithm

Sample

VP API Introduction

Data Structure

Function Interface

Model Inference API Introduction

Data Type and Data Structure

API Interface

Model Inference Tool Introduction

High Performance Algorithm

HPL API Introduction

Data Structure

Functional Interface

Data Structure

Functional Interface

FRAMEWORK

TUTORIALS

EXAMPLES

API REFERENCE

#Model Inference API Overview

#Data Type and Data Structure

#API Interface

Model Inference API Overview

Data Type and Data Structure

API Interface