main
Ask or search…
K
Links
Comment on page

Neural Network

This module contains primitive Neural Net (NN) operations.
use orion::operators::nn;

Data types

Orion supports currently these NN types.
Data type
dtype
32-bit integer (signed)
Tensor<i32>
8-bit integer (signed)
Tensor<i8>
32-bit integer (unsigned)
Tensor<u32>
Fixed point (signed)
Tensor<FP8x23 | FP16x16 | FP32x32 | FP64x64>

NNTrait

NNTrait contains the primitive functions to build a Neural Network.
function
description
nn.relu
Applies the rectified linear unit function element-wise.
Applies the leaky rectified linear unit (Leaky ReLU) activation function element-wise.
Applies the Sigmoid function to an n-dimensional input tensor.
Computes softmax activations.
Applies the natural log to Softmax function to an n-dimensional input Tensor.
Applies the Softsign function element-wise.
Applies the Softplus function element-wise.
nn.linear
Performs a linear transformation of the input tensor using the provided weights and bias.
Applies the Hard Sigmoid function to an n-dimensional input tensor.
Performs the thresholded relu activation function element-wise.
nn.gemm
Performs General Matrix multiplication.