4 points | by TSltd a day ago ago
1 comments
Reducing dropped tokens could also improve model training by reducing gradient noise
Reducing dropped tokens could also improve model training by reducing gradient noise