RohitRathore1
Follow
Starred repositories
Compiles Python to Rust, helping transition off of Python to Energy Efficient and Safe Rust Code
Ever used asyncio and wished you hadn't? A tiny (~300 lines) event loop for Python.
Supercharge Your LLM with the Fastest KV Cache Layer
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
Your memories are in ChatGPT... But nowhere else. Universal Memory MCP makes your memories available to every single LLM. No logins or paywall. One command to set it up.
A curated list of Large Language Model (LLM) Interpretability resources.
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
Nim is a statically typed compiled systems programming language. It combines successful concepts from mature languages like Python, Ada and Modula. Its design focuses on efficiency, expressiveness,…
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
beego is an open-source, high-performance web framework for the Go programming language.
This repository collects all relevant resources about interpretability in LLMs
A simple, performant and scalable Jax LLM!
Accelerate, Optimize performance with streamlined training and serving options with JAX.
Transports, Middleware, and Networks for the Alloy project
Monorepo for OP Stack Types, Components, and Services built in Rust.
Modular, contributor-friendly and blazing-fast implementation of the Ethereum protocol, in Rust
Easily convert tool, agents and orchestrators from existing agent frameworks to MCP servers
💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
Sample code and application showcases to get you going with AG2 (formally AutoGen)
Visualize your multi-stage Dockerfiles
A Datacenter Scale Distributed Inference Serving Framework
Send push notifications to your phone or desktop using PUT/POST
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
The TypeScript AI agent framework. ⚡ Assistants, RAG, observability. Supports any LLM: GPT-4, Claude, Gemini, Llama.
Cost-efficient and pluggable Infrastructure components for GenAI inference
ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
