This guide explains how to set up Ollama with GPU acceleration on a Framework Desktop with the AMD Ryzen AI Max+ 395 APU (RDNA 3.5 / gfx1151) running Ubuntu Server 24.04.
- Framework Desktop with AMD Ryzen AI Max+ 395
- Integrated GPU: AMD Radeon 8060S (gfx1151, RDNA 3.5)
- 128GB unified memory (shared between CPU and GPU)