mariah@feddit.rocks to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · edit-26 months agoIs there a good ai thats run fast on a amd rx 7600?message-squaremessage-square9fedilinkarrow-up111arrow-down12file-text
arrow-up19arrow-down1message-squareIs there a good ai thats run fast on a amd rx 7600?mariah@feddit.rocks to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · edit-26 months agomessage-square9fedilinkfile-text
Ive been playing koboldai horde but the queue annoys me. I want a nsfw ai for playing on tavernai chat
minus-squarerufus@discuss.tchncs.delinkfedilinkEnglisharrow-up2·edit-25 months agohttps://github.com/YellowRoseCx/koboldcpp-rocm That will be optimized for AMD and as far as I know has the same / a very similar user interface. (The 8GB of VRAM on your graphics card will be some limitation. So maybe stick with smaller and quantized models.) And share your success stories on [email protected]
https://github.com/YellowRoseCx/koboldcpp-rocm
That will be optimized for AMD and as far as I know has the same / a very similar user interface.
(The 8GB of VRAM on your graphics card will be some limitation. So maybe stick with smaller and quantized models.)
And share your success stories on [email protected]