Celu — nnf_celu • torch

Applies element-wise, $C E L U (x) = m a x (0, x) + m i n (0, α * (e x p (x α) - 1))$ .

Usage

nnf_celu(input, alpha = 1, inplace = FALSE)

nnf_celu_(input, alpha = 1)

Arguments

input: (N,*) tensor, where * means, any number of additional dimensions
alpha: the alpha value for the CELU formulation. Default: 1.0
inplace: can optionally do the operation in-place. Default: FALSE