infrastructure
38 posts found
The SSRF Problem Nobody Talks About in AI Pipelines
Everyone hardens the model. Almost nobody hardens what the model fetches. A walkthrough of SSRF and SSRF-adjacent risks in AI ingestion pipelines, with practica…
Paying for AI Without Revealing Who You Are: Zero-Knowledge Inference Tokens Explained
Zero-knowledge proofs decouple payment identity from LLM inference requests. Here is how the cryptographic architecture works and what security risks exist at t…
VPS Security Baseline: 10-Point Checklist Before You Go Live
A practical pre-flight checklist for hardening a fresh Ubuntu 24.04 VPS before exposing any service to the internet.
Sandboxing Agent Runtimes with NVIDIA OpenShell
A practical guide to securing AI agent runtimes using NVIDIA OpenShell, defining capability manifests, and enforcing syscall boundaries in CI.
Model Optimization: From FP16 to Speculative Decoding
A timeline tracking how deep learning model optimization evolved from FP16 mixed precision and INT8 calibration to outlier-aware AWQ, speculative decoding, and …
Your Model Isn’t the Bottleneck. Your Queue Is.
A classifier consumed 0.3% of request time; the queue ate the rest. Why AI deployments fail around the queue, not the model.
AI Agents Don’t Need More Memory. They Need Better State Management.
Memory alone doesn't solve agent problems. Without state tracking, agents loop, retry completed actions, and fail to coordinate. Here's what actually works.
Agents Aren’t Chatbots: Why Distributed Systems Matter
AI agents make API calls, manage state, and fail under load. Treat them like distributed systems, not chatbots. Backoff, idempotency, and structured traces aren…
cua: Computer-Use Automation at Scale
An open-source framework for cross-OS computer-use agents with built-in benchmarks and fleet infrastructure — protocol-first, evaluation-native, fleet-aware.
Sandboxing Autonomous AI Coding Agents: Ephemeral Containers and Egress Boundary Enforcement
Infrastructure security engineer Alex Chen discusses container sandboxing, system call filtering with seccomp and Landlock, and network egress boundaries for au…