The Intelligent Inference Scheduler for Large-scale Inference Services.

verl: Volcano Engine Reinforcement Learning for LLMs

SGLang is a fast serving framework for large language models and vision language models.

My learning notes/codes for ML SYS.

Currently, it's another gateway based on Istio/Envoy. (TODO: give it a better description)

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

MOSN is a powerful cloud-native proxy acts as a edge proxy or service mesh's data plane. https://mosn.io

Common packages used by other repos.

eBPF-based Networking, Security, and Observability

A curated list of awesome projects related to eBPF.

This repository defines some MOSN interfaces which can be implemented by others.

evnoy with go extension

bpf 学习仓库

BCC - Tools for BPF-based Linux IO analysis, networking, monitoring, and more

Collection of Linux eBPF slides/documents.

Source for mosn.io site

The Cloud-Native API Gateway

A Chaos Engineering Platform for Kubernetes.

Go client for Kubernetes.

meetup

A high-performance non-blocking I/O networking framework, which focused on RPC scenarios, developed by ByteDance.

A distributed, banking suitable, open-source related database featuring high scalability and high compatibility.

SRS is a simple, high efficiency and realtime video server, supports RTMP/WebRTC/HLS/HTTP-FLV/SRT/GB28181.

WebAssembly for Proxies (C++ host implementation)

High-performance, non-blocking, event-driven, easy-to-use, least-dependency networking framework written in Go.

A List of Quality OpenResty Libraries, and Resources.

用于搭建高性能、全异步、树形结构的BUS消息系统的跨平台框架库