kimi-k3-in-c alternatives
Tools that could take the place of kimi-k3-in-c, ranked by the stacks builders put them in rather than by stars alone.
Other runtimes in the runchr registry that do the work of kimi-k3-in-c — a tool somebody pairs with it ranks above a more popular stranger. Read the kimi-k3-in-c page or browse every runtimes.
Run open models locally and serve an OpenAI-compatible API.
Run quantised models locally, with an OpenAI-compatible server.
A high-throughput inference and serving engine for GPUs.
CLI proxy that compresses shell command output before it reaches an LLM.
Extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS.
Distributed AI compute engine for scaling ML training, tuning, and serving.
Single-file executables that run LLMs and speech-to-text locally.
Optimized inference runtime for LLMs and visual gen models on NVIDIA GPUs.
On-device inference engine for phones, wearables, and robots.
Self-host open-source LLMs as OpenAI-compatible API endpoints.
OpenVINO toolkit optimizes and deploys deep learning inference across Intel
Run and manage AI workloads across clouds, Kubernetes, and Slurm.