About

Small, fast, sharp.

LLMX/router is a focused project: no unnecessary abstractions, no framework sprawl. The codebase is tight, the boundaries are explicit, and every dependency earns its keep.

Language
C++23

Modern, expressive, zero-overhead.

Build
CMake + Ninja

Fast, reproducible, scriptable.

License
Open source

Hosted on GitHub — see repository for details.

Coding guidelines

  • 01Use the llmx namespace.
  • 02Headers use #pragma once. Sources use the .cxx extension.
  • 034-space indent, ~90-char line limit.
  • 04Include order: own header, standard, system, third-party, DOCA wrappers, then project headers.
  • 05Prefer RAII wrappers — avoid raw doca_* / rte_* handles.
  • 06Use LOG(level) or DOCA_LOG_* for logging.
  • 07Return errors via llmx::expected or doca_unexpected.

Get involved

Issues, patches, and benchmarks are welcome. The project is small enough to read in an afternoon — start with src/main.cxx.