commitment
If you train models with MTP architecture, stop injecting noisy CE gradients and instead add the Soft-MTP line of code.
A commitment by מייק. Statements are as reported by the cited publishers — not verified by DecisionGateway.
אם אתם מאמנים מודלים עם ארכיטקטורת MTP, תפסיקו להזריק גראדיאנטים רועשים של CE אלא הוסיפו את שורת הקוד של Soft-MTP
Discussion
More claims by מייק
In event-driven neuromorphic architectures, parts of the network that do not need to work simply stay at rest.statementIn event-driven neuromorphic architectures, memory is adjacent to the processor.statementIn event-driven neuromorphic architectures, time is a computational feature.statementThe future of AI lies not only in pushing more billions of parameters into hot GPUs, but in a smart combination of classic transformers and LLMs with event-driven neuromorphic architectures.predictionEBMs promised a revolution 20 years ago, and the problem was never elegance — it was training at scale.statement
All claims by מייק