FREE AI SOC Is INSANE

Vigil SOC is a free, open source AI security operations center. I installed it on a rented RunPod GPU, gave it 15 synthetic alerts (9 are one attacker, 6 are noise), and scored what it found against my answer key. I rented the GPU because my laptop (RTX 4060 8GB) has no WSL2 distro and no Docker, and Vigil's own README says Windows is not yet tested. Focus on the idea: the install is the same on any Linux box with a GPU. CHAPTERS 0:00 Why this video runs on a rented GPU 0:56 What is Vigil SOC? 1:39 Why not run it on my laptop 2:09 Choosing the RunPod GPU (3 pods, 1 trap) 3:35 Installing Vigil without Docker 5:58 The Vigil console and setup wizard 6:40 The experiment: 15 alerts, 9 attack steps 9:08 Verdict, pros and cons, cost WHAT I TESTED (one scenario, synthetic data, a smoke test not a benchmark) - Run 1: Qwen2.5 14B, 4 of 9 attack steps, 3 of 7 containment actions - Run 2: Qwen2.5 32B, same prompt: "inconclusive" (it searched for my ID range and got no results) - Run 3: Qwen2.5 32B, 15 explicit finding IDs: 5 of 9 steps named, 5 of 7 containment actions, none of the 6 harmless alerts blamed Nothing was executed: Vigil proposed actions, and no EDR was connected. INSTALL COMMANDS (what worked on a RunPod pod without Docker, Vigil v0.8.0) # --- pod: RunPod secure cloud, A40 48GB (any =24GB GPU works), PyTorch Ubuntu 24.04 image --- apt-get update && apt-get install -y postgresql postgresql-contrib redis-server git curl zstd ca-certificates curl -fsSL https://deb.nodesource.com/setup_22.x | bash - && apt-get install -y nodejs pip install uv # Ollama from its GitHub release + a model curl -sL -o ollama.tar.zst https://github.com/ollama/ollama/releases/download/v0.40.11/ollama-linux-amd64.tar.zst zstd -dc ollama.tar.zst | tar -x -C /usr/local && (nohup ollama serve ollama.log 2&1 &) ollama pull qwen2.5:14b # and optionally qwen2.5:32b # Vigil v0.8.0 git clone --depth 1 --branch v0.8.0 https://github.com/Vigil-SOC/vigil.git && cd vigil uv python install && uv venv --python "$(cat .python-version)" --python-preference only-managed venv . venv/bin/activate && uv pip install -r requirements.lock # Postgres + Redis pg_ctlcluster 16 main start su postgres -c "psql -c \"CREATE ROLE deeptempo SUPERUSER LOGIN PASSWORD 'CHANGE_ME'\"" su postgres -c "psql -c \"CREATE DATABASE deeptempo_soc OWNER deeptempo ENCODING 'UTF8'\"" export PGHOST=localhost PGUSER=deeptempo PGDATABASE=deeptempo_soc PGPASSWORD=CHANGE_ME for f in infra/database/init/*.sql; do psql -v ON_ERROR_STOP=0 -q -f "$f"; done redis-server --daemonize yes cp env.example .env # set POSTGRES_PASSWORD, AGENT_INTERNAL_TOKEN, BIFROST_ADMIN_PASSWORD (random); DEV_MODE only on a throwaway box # Bifrost model gateway (no Docker): fix the Docker path in its config mkdir -p /workspace/bifrost-data && cp infra/docker/bifrost/config.json /workspace/bifrost-data/ sed -i 's|/app/data|/workspace/bifrost-data|g' /workspace/bifrost-data/config.json OLLAMA_URL=http://127.0.0.1:11434 nohup npx -y @maximhq/bifrost -app-dir /workspace/bifrost-data -port 8080 -host 127.0.0.1 bifrost.log 2&1 & # schema + seed, then the vigil_app role password (the line start.sh would have run) export PYTHONPATH=$PWD; python scripts/init_schema.py; python scripts/seed_reference_data.py psql -c "ALTER ROLE vigil_app PASSWORD 'CHANGE_ME'" # API, agent layer, web console nohup uvicorn services.api.main:app --host 0.0.0.0 --port 6987 api.log 2&1 & scripts/agent_up.sh sed -i "s/host: '127.0.0.1', \/\/ Use IPv4 explicitly/host: '0.0.0.0', allowedHosts: true,/" clients/web/vite.config.ts (cd clients/web && npm install && node_modules/.bin/vite) # console: https://pod-id-6988.proxy.runpod.net LINKS Vigil: https://github.com/Vigil-SOC/vigil Cheap, reliable GPUs I use: RunPod: https://get.runpod.io/pe48 NOTES - I used Vigil's documented DEV_MODE (authentication bypassed) on a throwaway, deleted pod. Do not do that on a real server. - Thumbnail uses an AI-generated image of me with a real screenshot of Vigil's replay screen. #Vigil #AISOC #CyberSecurity #Ollama #RunPod #OpenSource Get GPUs Runpod: https://get.runpod.io/pe48 Get Hostinger: https://www.hostg.xyz/SHJiu Coupon Code "PROMPT" 10% discount 🔗 Connect with me: Email → [email protected] Ko-fi → https://ko-fi.com/promptengineer Patreon → https://www.patreon.com/PromptEngineer975 Book a Call → https://calendly.com/prompt-engineer48/call GitHub → https://github.com/PromptEngineer48 Twitter/X → https://twitter.com/prompt48 Website → https://promptengineer48.com/