Local AI on 8 GB of VRAM: What Actually Fits, and What Actually Runs
We took a stock Asus TUF gaming laptop with an RTX 3070 and 8 GB of video memory, and benched eight local models overnight across ten tasks. The result that surprised us: a 30 billion parameter model with two thirds of itself off the card beat a 14 billion parameter model that fit better, by nearly four times. File size does not predict speed. All 103 measured rows are free below, failures included.