Learning BPE by Implementing it in C

Continuing to learn about data structures in applied manner

Learning about transformers by implementing from scratch

Let's implement some data structures using C programming language.

Extending our package with paths and schedulers.

Let's add some ODE solvers.

Let's try and build flow matching package in tinygrad!

Introduction

Over time, I became interested in not simply reading the relevant research papers in my field, but also write their overviews. I believe that writing these will help me solidify information I learned in various papers.

This review begins what I hope to make a series of posts about …

Here is a question: pick two points on a circle of radius \(r\) independently uniformly at random.

What is the average distance between these two points?

Analysis

Let's to analyze this question using probabilistic mathematical reasoning before doing simulations.

Sampling points on a circle

To sample a point \(P=(X …

Introduction

I am fascinated by the concept of Monte-Carlo simulation: you can, in principle, simulate random events and see how these simulations differ from reality (on a small scale, at least!)

Here I would like to show a couple of simple probability theory textbook problems and my attempt at simulating …