leaky rectified linear unit en · NOUN
Etymology
Named after the rectified linear unit, where “leaky” denotes how the negative half of the function becomes slightly negative, being “leaky” in comparison to the default ReLU, which is zero.
Meanings
- (qualifier:artificial intelligence; neural computing; artificial intelligence; neural computing) A variation of the rectified linear unit, defined as f(x)=x when x≥0 and f(x)=αx for some small α, e.g. 0.01, when x<0.
Forms
| Spelling | Features | Labels | Source |
|---|---|---|---|
| leaky rectified linear units | Number=Plur | lexicographic |