aibrix

Popular repositories Loading

1. PrisKV PrisKV Public

   High Performance KV Cache Store for LLM

   C 59 8

2. ai-accelerator-tool ai-accelerator-tool Public

   Go 13 2

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 3 3

4. community community Public

   3 2

5. aibrix.github.io aibrix.github.io Public

   aibrix static site

   JavaScript 2 4

6. neocloud-node neocloud-node Public

   The Kubernetes bridge to NeoCloud GPUs.

   Python 1 1