Alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

🚄 FASTJSON2 is a Java JSON library with excellent performance.

An evaluation and evolution tool for Agent Skills.

Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

A construction kit for reinforcement learning environment management.

Machine learning platform for Web developers

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

A collection of modern C++ libraries, include coro_http, coro_rpc, compile-time reflection, struct_pack, struct_json, struct_xml, struct_pb, easylog, async_simple etc.