Talking-Heads Attention
Put on your headphones, jam out to some funky 80s rock and read about an equally funky variation on multi-head attention.
Programming
Finetuning Transformers with JAX + Haiku
A practical, code-first look at DeepMind's new haiku library.
A First Look at JAX
Put on your metaphorical safety goggles and start building something weird with JAX.
Einsum Extensions: A Wish List for Readable Matrix Ops
Musings on extensions to einsum notation for more readable machine learning code.
Processing your application
There was an error sending the email, please try again
Great!
Check your inbox and click the link to confirm your subscription
machine learning musings
You've successfully subscribed to machine learning musings
Welcome back! You've successfully signed in.
Great! You've successfully signed up.
Success! Your account is fully activated, you now have access to all content.