About
Tools for users who run their own models
LLM SysCore builds open-source infrastructure software for self-hosted LLMs.
LLM SysCore started the way most useful infrastructure does: someone was running language models on their own hardware and got tired of juggling terminals, ad-hoc scripts, and half a dozen browser tabs to answer simple questions. Is the model up? How fast is it? What is this actually costing me?
The answer grew into LLM Systems Manager: a complete operations platform for self-hosted LLM infrastructure. It treats a homelab GPU rig, a Mac Studio in the office, and a rack of servers as infrastructure worth managing properly, with real telemetry, cost accounting, and one place to control it all.
Everything we ship is open source under AGPL-3.0, and everything runs on your hardware. No cloud dependency, no telemetry phoning home, no account required.
What we believe
Four rules we build by
Local-first
Your models, your data, and your metrics stay on your machines. The whole platform works on a network with no internet access at all.
Honest measurement
Costs come from measured watts and counted tokens, not estimates. When a number is based on partial data, the dashboard says so.
The operator stays in control
Nothing restarts, installs, or reroutes without your approval. The platform surfaces what it wants to change, and the operator decides when it happens.
Open source, in the open
Development, issues, and releases all happen publicly on GitHub.
What we build
The LLM SysCore stack
LLM Systems Manager
The flagship: dashboard, OpenAI-compatible gateway, model library, benchmarking, autotuning, Autopilot routing, users and roles, backups.
LLM Systems Agent
One cross-platform binary for Linux and macOS that auto-detects what each host runs and reports system, GPU, PSU, and inference metrics.
LLM Systems Alarm Engine
A standalone service that stores every sample, evaluates threshold and anomaly rules, and notifies over email, webhook, toast, and Discord.
See it on your own hardware
The installer takes one command and keeps you in control the whole way.