Machine learning engineer & solo founder

Oliver
Perrin

I’m the ML engineer at a stealth startup and the founder of LiminalML, a SaaS company I run solo.

My work is in NLP, multi-task learning, and post-training. I also write about the models I build and the ideas behind them.

Read my writing
Oliver standing on a rocky overlook in the mountains

My work

Stealth startup

ML engineer

I own the ML work: model development, evaluation, inference, and integration. The company is pre-launch, so I keep the product details private.

Experience

Founder & solo builder

LiminalML

Visit LiminalML

I founded LiminalML to build software for learning and explaining machine learning. I design, build, and run the company myself.

Study works through intuition, maths, code, and recall.

Studio lets you create and share interactive technical visuals. Try a few of the ones I’ve built below.

LoRA update space

Change the adapter rank to see its outputs expand from a line to a plane to a volume.

A three-output toy model with fixed synthetic inputs. It shows the adapter correction, not trained model activations.

Open in Studio

Preparing the interactive visual…

Published on LiminalML

Writing

Implementation notes, explanations,
and things I learned the hard way.

Tokenization

Byte Pair Encoding From Scratch and the Tradeoffs the Tutorials Skip

Read essay
Architecture

Pre-LN, RMSNorm, and Why Normalization Placement Matters More Than You Think

Read essay
Transformers

Relative Position Bias: The Detail Most Transformer Tutorials Skip

Read essay
All writing on Substack

On the side

LexiMind

My open-source research project, started as an undergraduate. I’m exploring shared representations and adaptation for language tasks with a custom PyTorch transformer.

The repository also has a book-discovery app. Its content-based recommendations run separately from the research model.

Independent projects

Open source

Explore the projects