What the install script does
The install command downloads one script and runs it:
bash <(curl -fsSL https://get.llmsyscore.com/install.sh)
To read the script before running it, save it first:
curl -fsSL https://get.llmsyscore.com/install.sh -o install.sh
less install.sh
bash install.sh
Where it runs
- The dashboard (manager and alarm engine) runs on Linux: Debian, Ubuntu, and Rocky Linux, AlmaLinux or RHEL 10. On macOS, install the dashboard with Homebrew instead.
- The agent runs on Linux and macOS (Apple Silicon).
- Windows is not supported.
What happens, step by step
- Checks the basics. It looks for Python 3.11 or newer,
git,jq,curlandrsync. If some are missing it offers to install them withaptordnf. - Downloads the latest release from the project's GitHub Releases page and checks its SHA-256 checksum. If the checksum doesn't match, it stops before installing anything.
- Asks what to install. A menu lets you choose the whole system on one machine, one part of it (dashboard, alarm engine, database or agent), an update, or uninstall.
- Creates a service account called
llmsysthat the services run as. You can choose a different account with--user <name>. - Installs the files into
/opt/llm-systems-manager, with the Python packages each part needs in its own folder. - Installs InfluxDB (full install or database-only) from InfluxData's package repository, and creates the database and its access tokens.
- Asks a few questions: the dashboard's admin login, email settings for alerts, and whether to send an anonymous install report. Press Enter to accept a default.
- Writes the settings file at
/opt/llm-systems-manager/config/llm-systems.tomland creates the certificates the parts use to talk to each other securely. - On agent machines, adds a rule to
/etc/sudoers.d/so the agent can start and stop your model servers. Skip it with--no-sudoers. - Sets up the system services and asks before starting them. When it finishes it prints the address of the dashboard, the sign-in details and the next steps.
Useful options
| Option | What it does |
|---|---|
--mode <1-9> |
Skips the menu and picks the install type |
--ref v3.2.0 |
Installs a specific release |
--source local |
Installs from a release you downloaded yourself, for machines without GitHub access |
--update |
Updates an installed system |
--uninstall |
Removes the services and files, and asks before removing the service account and InfluxDB data |
All options: bash install.sh --help. Full guide: Deployment.
Other ways to install
Docker Compose runs the dashboard in containers. Fill in
.envbefore the last command:curl -fsSLO https://raw.githubusercontent.com/llmsyscore/llm-systems-manager/main/docker-compose.yml curl -fsSL https://raw.githubusercontent.com/llmsyscore/llm-systems-manager/main/.env.example -o .env docker compose up -dPackages (
.deband.rpm) and Homebrew: see Deployment.