Repository Issues

BlinkDL/SmallInitEmb

LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

View on GitHub
Stars
 (61 stars)
Forks
 (4 forks)
Indexed issues
 (0 indexed issues)
open beginner issues
 (0 open beginner issues)
Latest indexed
Aug 14, 2026
Last GitHub push
Feb 21, 2022
License
No license data
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Dominant language
Python
PR merge metrics
 (No merged PRs in 30d)
Beginner labels
No beginner labels indexed

Issues

0 indexed issues

No indexed issues found for this repository.