7 3 月, 2024

[Machine Learning] LayerNorm 層歸一化筆記

Last Updated on 2024-03-08 by Clay

LayerNorm 的工作原理如下：

$mean = \mu =\frac{\sum_{i=1}^{N}x_i}{N} \newline variance = \sigma^2 = \frac{\sum_{i=1}^{N}(x_{i}-\mu)^2}{N}$ Read More »