Oliver
Perrin

I’m the ML engineer at a stealth startup and the founder of LiminalML, a SaaS company I run solo.

My work is in NLP, multi-task learning, and post-training. I also write about the models I build and the ideas behind them.

Read my writing
Oliver standing on a rocky overlook in the mountains

My work

Stealth startup

I own the ML work: model development, evaluation, inference, and integration. The company is pre-launch, so I keep the product details private.

Experience

I founded LiminalML to build software for learning and explaining machine learning. I design, build, and run the company myself.

Study works through intuition, maths, code, and recall.

Studio lets you create and share interactive technical visuals. Try a few of the ones I’ve built below.

LoRA update space

Change the adapter rank to see its outputs expand from a line to a plane to a volume.

A three-output toy model with fixed synthetic inputs. It shows the adapter correction, not trained model activations.

Open in Studio

Preparing the interactive visual…

Writing

Implementation notes, explanations,
and things I learned the hard way.

Tokenization

Byte Pair Encoding From Scratch and the Tradeoffs the Tutorials Skip

Read essay
Architecture

Pre-LN, RMSNorm, and Why Normalization Placement Matters More Than You Think

Read essay
Transformers

Relative Position Bias: The Detail Most Transformer Tutorials Skip

Read essay
All writing on Substack

LexiMind

My open-source research project, started as an undergraduate. I’m exploring shared representations and adaptation for language tasks with a custom PyTorch transformer.

The repository also has a book-discovery app. Its content-based recommendations run separately from the research model.