Ilia Ilmer

Attention Matching for Key Value Compaction

Posted on Mon 01 June 2026 in posts • Tagged with Machine Learning, NLP • 2 min read

KV compaction is the quintessential step for long context conversations.
Let's review a new method for it!

Posted on Sun 22 March 2026 in posts • Tagged with Python, Machine Learning, Flow Matching • 5 min read

Some experiments I ran using my implementation

Posted on Tue 03 March 2026 in posts • Tagged with AI • 2 min read

A paper overview

Posted on Thu 15 January 2026 in posts • Tagged with C/C++ • 3 min read

Implementing a disjoint-set union (Union-Find) data structure

Posted on Thu 01 January 2026 in posts • Tagged with dotfiles • 4 min read

Tools I will (continue to) use in 2026

Posted on Sat 06 September 2025 in posts • Tagged with Rust • 4 min read

Putting fun into functors! (But only working with morhphisms)

Posted on Thu 04 September 2025 in posts • Tagged with Rust • 4 min read

In which I attempt to explore CPU emulation

Posted on Fri 15 August 2025 in posts • Tagged with Python, Machine Learning, Flow Matching • 2 min read

I almost gave up but decided to come back to images and flows

Posted on Wed 30 April 2025 in posts • Tagged with C/C++ • 3 min read

I am trying to build a BPE tokenizer

Posted on Tue 25 March 2025 in posts • Tagged with C/C++ • 2 min read

I tried to make a TUI game in C