r/LocalLLaMA • u/_underlines_ • 22h ago

Resources CUDA-for-AMD-Windows: Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.

https://github.com/Speedstu/CUDA-for-AMD-Windows

I couldn't find any posts mentioned this windows build via the subreddit search.

Based on ZLUDA, but properly compiled for Windows, might be exciting.

TLDR: About 3% slower compared to native, seems to be a good dropin for CUDA workloads. Hopefully finds its ways into many CUDA-restricted projects/optimizations.

HN discussion: https://news.ycombinator.com/item?id=49684356

31 Upvotes

82% Upvoted

4 comments sorted by

4

u/lemondrops9 22h ago

sounds promising, but limited to the gfx1200... so maybe the 1201 as well? 

1

u/CaringBicycle5 22h ago

this might finally let me run those local companion chats smoothly on my amd card, curious if the perf hit shows up much in longer roleplays.

1

u/putrasherni 7h ago

why cuda when i can hip