Andrej

Top repositories by stars

• karpathy/nanoGPT(on leaderboard)

  The simplest, fastest repository for training/finetuning medium-sized GPTs.

  Python53,398
• karpathy/nanochat(on leaderboard)

  The best ChatGPT that $100 can buy.

  Python43,593
• karpathy/LLM101n(on leaderboard)

  LLM101n: Let's build a Storyteller

  36,345
• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Cuda28,927
• karpathy/minGPT

  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

  Python23,618
• karpathy/nn-zero-to-hero

  Neural Networks: Zero to Hero

  Jupyter Notebook20,334
• karpathy/llama2.c

  Inference Llama 2 in one file of pure C

  C19,177
• karpathy/micrograd

  A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

  Jupyter Notebook14,717
• karpathy/llm-council

  LLM Council works together to answer your hardest questions

  Python14,681
• karpathy/char-rnn

  Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

  Lua11,973
• karpathy/convnetjs

  Deep Learning in Javascript. Train Convolutional Neural Networks (or ordinary ones) in your browser.

  JavaScript11,139
• karpathy/minbpe

  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

  Python10,319
• karpathy/arxiv-sanity-preserver

  Web interface for browsing, search and filtering recent arxiv submissions

  Python5,577
• karpathy/neuraltalk2

  Efficient Image Captioning code in Torch, runs on GPU

  Jupyter Notebook5,571
• karpathy/neuraltalk

  NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

  Python5,480
• karpathy/build-nanogpt

  Video+code lecture on building nanoGPT from scratch

  Python4,740
• karpathy/ng-video-lecture

  Python4,529
• karpathy/makemore

  An autoregressive character-level language model for making more things

  Python3,667
• karpathy/reader3

  Quick illustration of how one can easily read books together with LLMs. It's great and I highly recommend it.

  Python3,313
• karpathy/rendergit

  Render any git repo into a single static HTML page for humans or LLMs

  Python2,031
• karpathy/cryptos

  Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes

  Jupyter Notebook1,862
• karpathy/arxiv-sanity-lite

  arxiv-sanity lite: tag arxiv papers of interest get recommendations of similar papers in a nice UI using SVMs over tfidf feature vectors based on paper abstracts.

  Python1,474
• karpathy/reinforcejs

  Reinforcement Learning Agents in Javascript (Dynamic Programming, Temporal Difference, Deep Q-Learning, Stochastic/Deterministic Policy Gradients)

  HTML1,437
• karpathy/randomfun

  Notebooks and various random fun

  Jupyter Notebook1,146
• karpathy/ulogme

  Automatically collect and visualize usage statistics in Ubuntu/OSX environments.

  Python1,134
• karpathy/recurrentjs

  Deep Recurrent Neural Networks and LSTMs in Javascript. More generally also arbitrary expression graphs with automatic differentiation.

  HTML973
• karpathy/pytorch-normalizing-flows

  Normalizing flows in PyTorch. Current intended use is education not production.

  Jupyter Notebook909
• karpathy/tsnejs

  Implementation of t-SNE visualization algorithm in Javascript.

  JavaScript907
• karpathy/karpathy.github.io

  my blog

  CSS882
• karpathy/lecun1989-repro

  Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

  Jupyter Notebook714
• karpathy/paper-notes

  Random notes on papers, likely a short-term repo.

  704
• karpathy/svmjs

  Support Vector Machine in Javascript (SMO algorithm, supports arbitrary kernels) + GUI demo

  JavaScript702
• karpathy/deep-vector-quantization

  VQVAEs, GumbelSoftmaxes and friends

  Jupyter Notebook630
• karpathy/pytorch-made

  MADE (Masked Autoencoder Density Estimation) implementation in PyTorch

  Python588
• karpathy/hn-time-capsule

  Analyzing Hacker News discussions from a decade ago in hindsight with LLMs

  Python559
• karpathy/covid-sanity

  Aspires to help the influx of bioRxiv / medRxiv papers on COVID-19

  Python389
• karpathy/rustbpe

  The missing tiktoken training code

  Rust358
• karpathy/find-birds

  Find people you should follow on Twitter based on who the people you follow follow

  Python353
• karpathy/forestjs

  Random Forest implementation for JavaScript. Supports arbitrary weak learners. Includes interactive demo.

  JavaScript334
• karpathy/researchpooler

  Automating research publications discovery and analysis. For example, ever wish your computer could automatically open papers that are most similar to a paper at an arbitrary url? How about finding all papers that report results on some dataset? Let's re-imagine literature review.

  Python333
• karpathy/researchlei

  An Academic Papers Management and Discovery System

  Python248
• karpathy/Random-Forest-Matlab

  A Random Forest implementation for MATLAB. Supports arbitrary weak learners that you can define.

  MATLAB222
• karpathy/nipspreview

  Scripts that generate .html to more easily see NIPS papers

  Python181
• karpathy/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python179
• karpathy/scriptsbots

  ScriptBots is an Open Source Evolutionary Artificial Life Simulation of Predator-Prey dynamics, written by Andrej Karpathy.

  C++160
• karpathy/tf-agent

  tensorflow reinforcement learning agents for OpenAI gym environments

  Python139
• karpathy/examples

  A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

  Python131
• karpathy/calorie

  nice and effective super simple calorie counter web app

  HTML129
• karpathy/gitstats

  A lightweight/pretty visualizer for recent work on a git code base in multiple branches. Helps stay up to date with teams working on one git repo in many branches.

  HTML126
• karpathy/EigenLibSVM

  A wrapper for LibSVM that lets you train SVM's directly on Eigen library matrices in C++

  C++107
• karpathy/lifejs

  Artificial Life simulator using canvas. Based on https://github.com/karpathy/scriptsbots

  JavaScript104
• karpathy/notpygamejs

  Game making library for using Canvas element

  JavaScript94
• karpathy/MatlabWrapper

  C++ convenience class to communicate with a Matlab instance. Send matrices back and forth, execute arbitrary Matlab commands, or drop into interactive Matlab session right in the middle of your C++ code.

  C++86
• karpathy/twoolpy

  useful scripts to work with Twitter + Python. Requires the tweepy library.

  Python85
• karpathy/karpathy

  root repo

  73
• karpathy/scholaroctopus

  A set of tools/pages that help explore academic literature

  69
• karpathy/cpython

  The Python programming language

  Python39
• karpathy/optim

  A numeric optimization package for Torch.

  Lua39
• karpathy/sqlitedict

  Persistent dict, backed by sqlite3 and pickle, multithread-safe.

  Python37
• karpathy/nn

  Lua36
• karpathy/simple-amt

  A microframework for working with Amazon's Mechanical Turk

  Python33