No More Adam: Learning Rate Scaling at Initialization Is All You Need

Article URL: https://arxiv.org/abs/2412.11768

Comments URL: https://news.ycombinator.com/item?id=42448193

Points: 84

# Comments: 23