HPC-AI Tech

Top repositories by stars

• hpcaitech/ColossalAI(on leaderboard)

  Making large AI models cheaper, faster and more accessible

  Python41,346
• hpcaitech/Open-Sora

  Open-Sora: Democratizing Efficient Video Production for All

  Python28,538
• hpcaitech/EnergonAI

  Large-scale model inference.

  Python627
• hpcaitech/FastFold

  Optimizing AlphaFold Training and Inference on GPU Clusters

  Python612
• hpcaitech/SwiftInfer

  Efficient AI Inference & Serving

  Python479
• hpcaitech/ColossalAI-Examples

  Examples of training models with hybrid parallelism using ColossalAI

  Python339
• hpcaitech/PaLM-colossalai

  Scalable PaLM implementation of PyTorch

  Python190
• hpcaitech/TensorNVMe

  A Python library transfers PyTorch tensors between CPU and NVMe

  C++125
• hpcaitech/CachedEmbedding

  A memory efficient DLRM training solution using ColossalAI

  Python107
• hpcaitech/SkyComputing

  Sky Computing: Accelerating Geo-distributed Computing in Federated Learning

  Python90
• hpcaitech/ColossalAI-Benchmark

  Performance benchmarking with ColossalAI

  Python38
• hpcaitech/Titans

  A collection of models built with ColossalAI

  Python32
• hpcaitech/ColossalAI-Pytorch-lightning

  Python24
• hpcaitech/Oh-My-Dockerfile

  A collection of dockerfiles for various tasks

  Dockerfile24
• hpcaitech/ColossalAI-Documentation

  Documentation for Colossal-AI

  JavaScript23
• hpcaitech/Elixir

  Elixir: Train a Large Language Model on a Small GPU Cluster

  Python15
• hpcaitech/public_assets

  Storing publicly available assets such as images, animations and texts

  Python14
• hpcaitech/ColossalAI-Platform-CLI

  CLI for ColossalAI Platform

  Python10
• hpcaitech/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python10
• hpcaitech/GPT-Demo

  GPT Demo with hybrid distributed training

  Python10
• hpcaitech/Open-Sora-Demo

  8
• hpcaitech/OPT-Benchmark

  Python4
• hpcaitech/HPC-AI-SDK

  HPC-AI TECH 's Fine-tuning SDK

  Python3
• hpcaitech/mmdetection-examples

  Train mmdetection models with ColossalAI.

  Python2
• hpcaitech/xfold

  Democratizing AlphaFold3: an PyTorch reimplementation to accelerate protein structure prediction

  Python1
• hpcaitech/TensorRT-Model-Optimizer

  A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed.

  Python1
• hpcaitech/TensorRT-LLM

  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

  C++1
• hpcaitech/LLaVA-NeXT

  Python1
• hpcaitech/graphrag

  A modular graph-based Retrieval-Augmented Generation (RAG) system

  Python1
• hpcaitech/CANN-Installer

  This repository contains Huawei Ascend CANN files

  1
• hpcaitech/Cloud-Platform-Docs

  Documentation for our cloud platform

  JavaScript1
• hpcaitech/torchrec

  Pytorch domain library for recommendation systems

  Python1
• hpcaitech/pytest-testmon

  Selects tests affected by changed files. Executes the right tests first. Continuous test runner when used with pytest-watch.

  Python0