jax.nn.silu

jax.nn.silu(x)

SiLU (a.k.a. swish) activation function.

Computes the element-wise function:

\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]

swish() and silu() are both aliases for the same function.

Parameters:

x (Union[Array, ndarray, bool_, number, bool, int, float, complex]) – input array

Return type:

Array

Returns:

An array.

See also

sigmoid()