halogen-flash-server alternatives
Tools that could take the place of halogen-flash-server, ranked by the stacks builders put them in rather than by stars alone.
Other runtimes in the runchr registry that do the work of halogen-flash-server — a tool somebody pairs with it ranks above a more popular stranger. Read the halogen-flash-server page or browse every runtimes.
Local AI server serving optimized LLMs on GPUs and NPUs via OpenAI-compatible
Run huge MoE models privately on your own GPUs with OpenAI-compatible API.
Native local LLM inference server for Apple Silicon with OpenAI and Anthropic
CLI proxy that compresses shell command output before it reaches an LLM.
GPU kernel library for fast LLM inference: attention, GEMM, MoE, sampling.
OpenAI/Anthropic-compatible MLX inference server for Apple Silicon tuned
Local MLX inference server that serves open models to Claude Code via Anthropic
Fast local LLM inference engine for Apple Silicon with native MTP speculative
Run open models locally and serve an OpenAI-compatible API.
Run quantised models locally, with an OpenAI-compatible server.
A high-throughput inference and serving engine for GPUs.
Extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS.