statementSaid on 2026-10-19
In early versions of Attention Is All You Need the authors explicitly wrote that the FFN is "a kind of attention"; in later versions the paragraph simply disappeared.
A statement by post author, said on 2026-10-19. Statements are as reported by the cited publishers — not verified by DecisionGateway.
בגרסאות מוקדמות של Attention Is All You Need הכותבים כתבו במפורש שה-FFN הוא "סוג של attention". בגרסאות המאוחרות הפסקה פשוט נעלמה.