With an AMD RX 6800 + 32gb DDR4, I can run up to a 34b model at an acceptable speed.
- 0 Posts
- 3 Comments
Joined 2 months ago
Cake day: March 6th, 2025
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Not to mention prion diseases.
With Ollama, all you have do is copy an extra folder of ROCm files. Not hard at all.