statement
LayerNorm, thought to be passive, turns out to precisely preserve the richness of information.
A statement by the post author. Statements are as reported by the cited publishers — not verified by DecisionGateway.
גם פעולת הנרמול (LayerNorm), שחשבו שהיא פסיבית, מתגלה ככזו ששומרת במדויק על עושר המידע.