Ilia Ilmer

How does a BPE tokenizer work?

Posted on Mon 08 June 2026 in posts • Tagged with Rust, Machine Learning • 5 min read

Finishing my BPE-from-scratch adventure

Posted on Mon 01 June 2026 in posts • Tagged with Machine Learning, NLP • 2 min read

KV compaction is the quintessential step for long context conversations.
Let's review a new method for it!

Posted on Sun 22 March 2026 in posts • Tagged with Python, Machine Learning, Flow Matching • 5 min read

Some experiments I ran using my implementation

Posted on Tue 03 March 2026 in posts • Tagged with AI • 2 min read

A paper overview

Posted on Thu 15 January 2026 in posts • Tagged with C/C++ • 3 min read

Implementing a disjoint-set union (Union-Find) data structure

Posted on Thu 01 January 2026 in posts • Tagged with dotfiles • 4 min read

Tools I will (continue to) use in 2026

Posted on Sat 06 September 2025 in posts • Tagged with Rust • 4 min read

Putting fun into functors! (But only working with morhphisms)

Posted on Thu 04 September 2025 in posts • Tagged with Rust • 4 min read

In which I attempt to explore CPU emulation

Posted on Fri 15 August 2025 in posts • Tagged with Python, Machine Learning, Flow Matching • 2 min read

I almost gave up but decided to come back to images and flows

Posted on Wed 30 April 2025 in posts • Tagged with C/C++ • 3 min read

I am trying to build a BPE tokenizer