statementSaid on 2026-10-19
With squared ReLU the capacity jumps from 64 to about 2,700, and it is not a coincidence that such variants won in practice.
A statement by post author, said on 2026-10-19. Statements are as reported by the cited publishers — not verified by DecisionGateway.
עם ReLU בריבוע הקיבולת קופצת מ-64 ל-2,700 בערך, וזה לא מקרה שווריאנטים כאלה ניצחו בפועל.