Installation

This guide provides detailed instructions for installing and configuring Inferia LLM.

System Requirements

Component	Requirement	Description
OS	Linux / macOS	Windows supported via WSL2
Python	3.10+	Core runtime for all services
Node.js	18+	Required for Dashboard and DePIN Sidecars
PostgreSQL	14+	Primary database
Redis	6+	Rate limiting and task queues

1. Environment Configuration

Clone the Repository:

git clone https://github.com/inferiallm/inferiallm.git
cd inferiallm

Initialize Configuration:
```
cp .env.sample .env
```

Edit .env:

Required Variables:

Variable	Description
`DATABASE_URL`	PostgreSQL connection string
`REDIS_HOST` / `REDIS_PORT`	Redis connection details
`JWT_SECRET_KEY`	JWT signing secret
`INTERNAL_API_KEY`	Service-to-service auth
`SECRET_ENCRYPTION_KEY`	Credential encryption key
`SUPERADMIN_EMAIL`	Initial admin email
`SUPERADMIN_PASSWORD`	Initial admin password

2. Option A: Python Package (Recommended)

Standard Installation

pip install inferiallm

Developer Installation

cd package
pip install -e .

Database Initialization

inferiallm init

Start Services

# Start all services
inferiallm start

# Or start specific services
inferiallm start orchestration  # Orchestration Gateway
inferiallm start inference      # Inference Gateway
inferiallm start filtration     # Filtration Gateway

3. Option B: Docker

1. Pull Image and Configure Environment

docker pull inferiaai/inferiallm:latest
curl -L https://raw.githubusercontent.com/InferiaAI/InferiaLLM/main/.env.sample -o .env
nano .env

2. Run the Container

docker run -d \
  --name inferia-app \
  --env-file .env \
  -p 8000:8000 -p 8001:8001 -p 8080:8080 -p 3000:3000 -p 3001:3001 \
  inferiaai/inferiallm:latest

CLI Commands

Command	Description
`inferiallm init`	Initialize database, roles, schemas, and admin user
`inferiallm start`	Start all services
`inferiallm start orchestration`	Start Orchestration Gateway + Worker + DePIN Sidecar
`inferiallm start inference`	Start Inference Gateway
`inferiallm start filtration`	Start Filtration Gateway

On this page