NVIDIA RTX 3090 - The Budget 24GB Value King
Full specs and benchmarks for the NVIDIA GeForce RTX 3090 - 24GB GDDR6X at 936 GB/s, Ampere architecture, and why used 3090s remain the best value option for local AI inference in 2026.
Articles Tagged "Inference"
NVIDIA RTX 4090 - The Home Lab AI Standard
Full specs and benchmarks for the NVIDIA GeForce RTX 4090 - 24GB GDDR6X, 1,008 GB/s bandwidth, Ada Lovelace architecture, and why it remains the default home lab GPU for local AI inference.
NVIDIA RTX 5090 - Blackwell for the Home Lab
Full specs and benchmarks for the NVIDIA GeForce RTX 5090 - 32GB GDDR7, 1,792 GB/s bandwidth, Blackwell architecture, and what it means for local AI inference.
AORUS RTX 5090 AI BOX vs NVIDIA DGX Spark for Local AI
Two very different approaches to desktop AI hardware - a 32 GB eGPU with 1,792 GB/s bandwidth versus a 128 GB unified memory mini PC with full CUDA. Which one should you buy?
AORUS RTX 5090 AI BOX Review: Desktop GPU Power via Thunderbolt 5
A review of the Gigabyte AORUS RTX 5090 AI BOX - a liquid-cooled eGPU packing a full desktop RTX 5090 with 32 GB GDDR7, connecting to any laptop over Thunderbolt 5 for $2,999.
DGX Spark Review: NVIDIA's $4,699 Desktop AI Box
A hands-on review of the NVIDIA DGX Spark - a 128 GB Grace Blackwell mini PC that promises 1 petaflop of AI performance on your desk for $4,699.
NVIDIA DGX Spark Setup and Usage Guide for 2026
A complete guide to setting up the NVIDIA DGX Spark - from unboxing and first boot to running LLM inference, fine-tuning models, and optimizing performance.
Ollama Cloud Review: From Local LLMs to Seamless Cloud Inference
Ollama Cloud extends the popular local LLM runner to the cloud, letting you push models from your laptop and serve them globally. We test latency, cold starts, pricing, and the developer experience against dedicated inference providers.
Groq Review: The Fastest Inference Engine Money Can Buy
Groq's LPU chips deliver inference speeds that make GPUs look slow - 1,200+ tokens per second on Llama 4. We benchmark latency, throughput, model availability, and pricing against the GPU-based competition.
OpenRouter Review: One API Key to Rule Them All
OpenRouter routes your API calls to 300+ models across every major provider through a single endpoint. We benchmark its routing, latency overhead, pricing, and reliability against direct API access.
Inception Ships Mercury 2 - A Diffusion LLM That Hits 1,009 Tokens Per Second
Inception Labs launches Mercury 2, the first diffusion-based reasoning language model, generating over 1,000 tokens per second on Blackwell GPUs at a fraction of the cost of conventional autoregressive models.
Qwen 3.5 FP8 Weights Drop - How to Actually Deploy a 397B Model on 8 GPUs
Alibaba releases official FP8-quantized weights for the Qwen 3.5 flagship and 27B dense model, cutting memory requirements roughly in half and enabling deployment on 8x H100 GPUs with native vLLM and SGLang support.
