Official inference framework for 1-bit LLMs

Tiny ASIC implementation for "The Era of 1-bit LLMs All Large Language Models are in 1.58 Bits" matrix multiplication unit

General technology for enabling AI capabilities w/ LLMs and MLLMs

A tool for extracting plain text from Wikipedia dumps

Foundation Architecture for (M)LLMs

Ubuntu 18.04 How to install Nvidia driver + CUDA + CUDNN + build tensorflow for gpu step by step command line

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.