It’s not a direct apples to apples comparison, but compared to a RTX 4090 this isn’t compelling. Other than the 32GB of VRAM there’s not much going for this card. For $4k most people would be better off with dual 4090s.

Absolutely honest question, please consider me novice in the area. If you have $7K and want to run LLM locally, does getting Mac with M2 ultra and 192 Gb make most sense?

12,800 CUDA - $4,000.00