Sebastian Raschka
@rasbtUserAI Research Engineer working on LLMs.
On the leaderboard
| Rank | Repository | Stars |
|---|---|---|
| 119 | rasbt/LLMs-from-scratch | 94,937 |
Top repositories by stars
- rasbt/LLMs-from-scratch(on leaderboard)
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Jupyter Notebook85,465 - rasbt/deeplearning-models
A collection of various deep learning architectures, models, and tips
Jupyter Notebook17,418 - rasbt/python-machine-learning-book
The "Python Machine Learning (1st edition)" book code repository and info resource
Jupyter Notebook12,587 - rasbt/python-machine-learning-book-2nd-edition
The "Python Machine Learning (2nd edition)" book code repository and info resource
Jupyter Notebook7,194 - rasbt/mlxtend
A library of extension and helper modules for Python's data analysis and machine learning libraries.
Python5,112 - rasbt/machine-learning-book
Code Repository for Machine Learning with PyTorch and Scikit-Learn
Jupyter Notebook4,989 - rasbt/python-machine-learning-book-3rd-edition
The "Python Machine Learning (3rd edition)" book code repository
Jupyter Notebook4,987 - rasbt/pattern_classification
A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks
Jupyter Notebook4,212 - rasbt/python_reference
Useful functions, tutorials, and other Python-related things
Jupyter Notebook3,884 - rasbt/reasoning-from-scratch
Implement a reasoning LLM in PyTorch from scratch, step by step
Jupyter Notebook3,037 - rasbt/deep-learning-book
Repository for "Introduction to Artificial Neural Networks and Deep Learning: A Practical Guide with Applications in Python"
Jupyter Notebook2,818 - rasbt/matplotlib-gallery
Examples of matplotlib codes and plots
Jupyter Notebook1,203 - rasbt/LLM-workshop-2024
A 4-hour coding workshop to understand how LLMs are implemented and used
Jupyter Notebook1,070 - rasbt/watermark
An IPython magic extension for printing date and time stamps, version numbers, and hardware information
Python942 - rasbt/machine-learning-notes
Collection of useful machine learning codes and snippets (originally intended for my personal use)
Jupyter Notebook836 - rasbt/stat479-machine-learning-fs19
Course material for STAT 479: Machine Learning (FS 2019) taught by Sebastian Raschka at University Wisconsin-Madison
Jupyter Notebook781 - rasbt/MachineLearning-QandAI-book
Machine Learning Q and AI book
Jupyter Notebook705 - Jupyter Notebook603
- rasbt/stat453-deep-learning-ss20
STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2020)
Jupyter Notebook576 - rasbt/stat479-deep-learning-ss19
Course material for STAT 479: Deep Learning (SS 2019) at University Wisconsin-Madison
Jupyter Notebook547 - rasbt/pyprind
PyPrind - Python Progress Indicator Utility
Python546 - rasbt/stat453-deep-learning-ss21
STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2021)
Jupyter Notebook541 - rasbt/algorithms_in_ipython_notebooks
A repository with IPython notebooks of algorithms implemented in Python.
Jupyter Notebook511 - rasbt/stat479-machine-learning-fs18
Course material for STAT 479: Machine Learning (FS 2018) at University Wisconsin-Madison
Jupyter Notebook502 - rasbt/stat451-machine-learning-fs20
STAT 451: Intro to Machine Learning @ UW-Madison (Fall 2020)
Jupyter Notebook451 - rasbt/musicmood
A machine learning approach to classify songs by mood.
OpenEdge ABL422 - rasbt/pycon2024
Tutorial Materials for "The Fundamentals of Modern Deep Learning with PyTorch" workshop at PyCon 2024
Jupyter Notebook247 - Jupyter Notebook218
- rasbt/dora-from-scratch
LoRA and DoRA from Scratch Implementations
Jupyter Notebook216 - rasbt/datacollect
A collection of tools to collect and download various data.
Jupyter Notebook210 - rasbt/data-science-tutorial
Code material for a data science tutorial
Jupyter Notebook197 - Jupyter Notebook151
- rasbt/RAGs
RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
Jupyter Notebook142 - Python132
- rasbt/One-Python-benchmark-per-day
An ongoing fun challenge where I'll try to post one Python benchmark per day.
HTML132 - rasbt/faster-pytorch-blog
Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
Python128 - rasbt/pydata-chicago2016-ml-tutorial
Machine learning with scikit-learn tutorial at PyData Chicago 2016
Jupyter Notebook128 - rasbt/msu-datascience-ml-tutorial-2018
Machine learning with Python tutorial at MSU Data Science 2018
Jupyter Notebook111 - rasbt/protein-science
A collection of useful tutorials for Protein Science
Python109 - rasbt/markdown-toclify
A Python command line tool that creates a Table of Contents for Markdown documents
Python94 - rasbt/pytorch-memory-optim
This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.
Python92 - rasbt/cyclemoid-pytorch
Cyclemoid implementation for PyTorch
Python90 - rasbt/smilite
A Python module to retrieve and compare SMILE strings of chemical compounds from the free ZINC online database
Python83 - rasbt/pydata-annarbor2017-dl-tutorial
Code snippets for "Introduction to Deep Learning with TensorFlow" at PyData Ann Arbor Aug 2017
Jupyter Notebook80 - rasbt/model-eval-article-supplementary
Supplementary material for the article "Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning"
Jupyter Notebook72 - rasbt/DeepLearning-Gdansk2019-tutorial
Ordinal Regression tutorial for the International Summer School on Deep Learning 2019
Jupyter Notebook70 - rasbt/nn_plus_gzip
Gzip and nearest neighbors for text classification
Jupyter Notebook57 - rasbt/interpretable-ml-article
Code examples for my Interpretable Machine Learning Blog Series
Jupyter Notebook57 - rasbt/courses
This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)
Python51 - rasbt/numpy-intro-blogarticle-2020
Jupyter Notebook for the "Scientific Computing in Python: Introduction to NumPy and Matplotlib" blog article
Jupyter Notebook50 - rasbt/blog-finetuning-llama-adapters
Supplementary material for "Understanding Parameter-Efficient Finetuning of Large Language Models: From Prefix Tuning to Adapters"
Jupyter Notebook47 - rasbt/R_snippets
R Scripts for general data analysis and plotting
R46 - rasbt/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
Markdown41 - rasbt/mputil
Utility functions for Python's multiprocessing standard library module
Python39 - rasbt/pybibtex
Utility functions for parsing BibTeX files and creating citation reference lists.
Python38 - rasbt/ML-YouTube-Courses
A repository to index and organize the latest machine learning courses found on YouTube.
36 - rasbt/gradient-accumulation-blog
Finetuning BLOOM on a single GPU using gradient-accumulation
Python31 - rasbt/comparing-automatic-augmentation-blog
Comparing four automatic image augmentation techniques in PyTorch: AutoAugment, RandAugment, AugMix, and TrivialAugment
Jupyter Notebook31 - rasbt/posit2023-python-ml
Workshop materials for posit::conf(2023)
Jupyter Notebook30 - rasbt/mytorch
Collection of PyTorch-related utility functions
Python29 - Python28
- rasbt/Hbind
Calculates hydrogen-bond interaction tables for protein-small molecule complexes, based on protein PDB and protonated ligand MOL2 structure input. Raschka et al. (2018) J. Computer-Aided Molec. Design
C28 - Python26
- Python26
- rasbt/ViT-finetuning-scripts
Vision transformer finetuning scripts
Python25 - rasbt/2021-issdl-gdansk
Intro to GAN Tutorial for the International Summer School of Deep Learning 2021 in Gdansk
Jupyter Notebook25 - rasbt/R-notes
Various R lang related material for teaching.
Python24 - rasbt/screenlamp
screenlamp is a Python toolkit for hypothesis-driven virtual screening
Python24 - rasbt/predicting-activity-by-machine-learning
Activity From Virtual Screening Code Repository
Jupyter Notebook23 - rasbt/BondPack
A collection of PyMOL plugins to visualize atomic bonds.
Python22 - rasbt/build-nanogpt
Video+code lecture on building nanoGPT from scratch
Python21 - rasbt/uw-madison-datacience-club-talk-oct2019
Slides and code for the talk at UW-Madison's Data Science Club, 10 Oct 2019
Jupyter Notebook21 - rasbt/b3-basic-batchsize-benchmark
Experiments for the blog post "No, We Don't Have to Choose Batch Sizes As Powers Of 2"
Python20 - rasbt/2021-pydata-jeddah
Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021
Jupyter Notebook20 - rasbt/siteinterlock
A novel approach to pose selection in protein-ligand docking based on graph theory.
Python20 - rasbt/scipy-2016-sklearn
Scikit-learn tutorial at SciPy2016
Jupyter Notebook19 - rasbt/scikit-learn
scikit-learn: machine learning in Python
Python18 - rasbt/PyMLSlides
Slides for my machine learning course based on Sebastian Raschka's Python Machine Learning book
TeX17 - rasbt/py-args
Python command line tools as productivity supplements for Posix systems
Python17 - rasbt/gpt-2
Code for the paper "Language Models are Unsupervised Multitask Learners"
Python16 - rasbt/srgan-lightning-blog
Sharing Deep Learning Research Models with Lightning Part 1: Building A Super Resolution App
Python16 - rasbt/mnist-pngs
MNIST files in PNG format
Python16 - rasbt/litdata
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
Python15 - rasbt/datapipes-blog
Code for the DataPipes article
Jupyter Notebook15 - Jupyter Notebook14
- Jupyter Notebook13
- rasbt/HbindViz
Tools for generating hydrogen-bond interaction visualizations from Hbind
Python11 - rasbt/macos-pdf-splitter
Native macOS app for splitting and converting PDF figures
Swift10 - rasbt/gpt-neox
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Python10 - rasbt/pytorch-lightning
Deep learning framework to train, deploy, and ship AI products Lightning fast.
Python10 - rasbt/LitServe
Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.
Python9 - rasbt/protein-recognition-index
Protein Recognition Index (PRI), measuring the similarity between H-bonding features in a given complex (predicted or designed) and the characteristic H-bond trends from crystallographic complexes
Python9 - rasbt/neurips_llm_efficiency_challenge
NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
Python8 - rasbt/compair
Model evaluation utilities
Python8 - rasbt/pytorch-image-models
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more
Python8 - rasbt/semi-adversarial-networks
Implementation of SAN model for imparting gender privacy to face images
Python8 - rasbt/tpot
A Python tool that automatically creates and optimizes Machine Learning pipelines using genetic programming.
Python8 - rasbt/matplotlib
matplotlib: plotting with Python
Python8 - rasbt/math_full_minus_math500
The MATH training dataset without MATH-500 test portion
Jupyter Notebook7