提交 05e4c826 编写于 作者: M Megvii Engine Team

fix(mge/module): fix a mistaken in BN docs

GitOrigin-RevId: 086a70649eb5b7a2f7c4beb2cf96ad2fc237ec9b
上级 f6e66ec6
......@@ -252,14 +252,6 @@ class BatchNorm2d(_BatchNorm):
keep running estimates, batch statistics is used during
evaluation time instead.
.. note::
This :attr:`momentum` argument is different from one used in optimizer
classes and the conventional notion of momentum. Mathematically, the
update rule for running statistics here is
:math:`\hat{x}_\text{new} = \text{momentum} \times \hat{x} + (1 - \text{momentum}) \times x_t`,
where :math:`\hat{x}` is the estimated statistic and :math:`x_t` is the
new observed value.
Because the Batch Normalization is done over the `C` dimension, computing
statistics on `(N, H, W)` slices, it's common terminology to call this
Spatial Batch Normalization.
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册