Learning about transformers by implementing from scratch

Extending our package with paths and schedulers.

Let's add some ODE solvers.

Let's try and build flow matching package in tinygrad!

Introduction

Over time, I became interested in not simply reading the relevant research papers in my field, but also write their overviews. I believe that writing these will help me solidify information I learned in various papers.

This review begins what I hope to make a series of posts about …

Here is a question: pick two points on a circle of radius \(r\) independently uniformly at random.

What is the average distance between these two points?

Analysis

Let's to analyze this question using probabilistic mathematical reasoning before doing simulations.

Sampling points on a circle

To sample a point \(P=(X …

In this short post, I wanted to point out one interesting application of regular expressions I had to work on for my PhD research project. The code was meant as a technical tool to help tranlate some ordingary differential equation models from numerical (Matlab) to symbolic (Maple) code.

The original …

In this post, I expand on a little class/self-teaching project that I did during the Spring 2020 semester.

NumPy-Learn: A Homemade Machine Learning Library

Organization

In this section we will discuss the main organization of the library:

• How the layers are built
• How loss functions work
• How a stochastic …

In this post, I put together an interesting example of what to do with imbalanced datasets and why precision and recall matter.

Introduction

The following is part of a Machine learning assignment I had to do while at CUNY. This particular example illustrates quite well the importance of understanding various …

In this post I wanted to describe a simple application of a linear least squares method to a problem of data classification. It is a naive approach and is unlikely to beat more sophisticated techniques like Logistic Regression, for instance.

Imports

Some imports we are going to need for this …