A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Repositories
qiyuangong repositories
Python & JAVA Solutions for Leetcode
LLM inference in C/C++
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
Occlum is a memory-safe, multi-process library OS for Intel SGX
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
OpenVINO™ Toolkit - Deep Learning Deployment Toolkit repository
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more.
A fast and simple framework for building and running distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.
Intelligent Router for Mixture-of-Models
Apache Spark - A unified analytics engine for large-scale data processing