A project building a ChatGPT-style model from first principles in TypeScript to deeply understand transformers.
- •TypeScript was chosen because reimplementing concepts in a different language helps grasp implementation nuances.
- •Chapters so far cover dataloaders, embeddings, and the attention mechanism.
- •Feedback is welcome for any unclear parts, shared on Hacker News.