Representation Learning and Retrieval
A look at extending pre-trained representations with document retrieval to better solve downstream tasks.
Attention
Large Memory Layers with Product Keys
Augmenting transformer language models with sparse access of large memory matrices
Finetuning Transformers with JAX + Haiku
A practical, code-first look at DeepMind's new haiku library.
A Survey of Long-Term Context in Transformers
Exploring 6 noteworthy approaches for incorporating longer-term context in transformer models.
Processing your application
There was an error sending the email, please try again
Great!
Check your inbox and click the link to confirm your subscription
machine learning musings
You've successfully subscribed to machine learning musings
Welcome back! You've successfully signed in.
Great! You've successfully signed up.
Success! Your account is fully activated, you now have access to all content.