Finetuning Transformers with JAX + Haiku
A practical, code-first look at DeepMind's new haiku library.
A Survey of Long-Term Context in Transformers
Exploring 6 noteworthy approaches for incorporating longer-term context in transformer models.
Rationale Informed Classification
Leveraging annotator rationales for more interpretable and sample efficient classification.
A Deep Dive into the Reformer
Time and memory efficient alternatives to vanilla transformers through locality sensitive hashing and reversible layers.
A First Look at JAX
Put on your metaphorical safety goggles and start building something weird with JAX.
ROC Curves: Intuition Through Visualization
Building intuition for Receiving Operator Characterstic (ROC) curves and what they measure through visualization.
Einsum Extensions: A Wish List for Readable Matrix Ops
Musings on extensions to einsum notation for more readable machine learning code.
Processing your application
There was an error sending the email
Great!
Check your inbox and click the link to confirm your subscription
machine learning musings
You've successfully subscribed to machine learning musings
Welcome back! You've successfully signed in.
Great! You've successfully signed up.
Success! Your email is updated.
Your link has expired
Success! Your account is fully activated, you now have access to all content.