What is: Lecun's Tanh?
Year | 1998 |
Data Source | CC BY-SA - https://paperswithcode.com |
LeCun's tanh is an activation function of the form . The constants were chosen to keep the variance of the output close to 1.
Year | 1998 |
Data Source | CC BY-SA - https://paperswithcode.com |
LeCun's tanh is an activation function of the form . The constants were chosen to keep the variance of the output close to 1.