Hyddro26@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agoWhat is considered the best uncensored LLM right now?message-squaremessage-square38fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareWhat is considered the best uncensored LLM right now?Hyddro26@alien.topB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square38fedilinkfile-text
minus-squareYuriWerewolf@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoHow did you set settings for memory sharing (layers) between gpus? I have 2 gpus: 3060Ti and 3060 and it seems like it tries to load everything on the first one and goes out of memory.
minus-squareBrave-Decision-1944@alien.topcakeBlinkfedilinkEnglisharrow-up1·1 year agoLike this to be exact https://preview.redd.it/bj2znub0r91c1.png?width=720&format=pjpg&auto=webp&s=c56dfb9dafd65a7c3f8ea73624118ff9c75de47d
How did you set settings for memory sharing (layers) between gpus? I have 2 gpus: 3060Ti and 3060 and it seems like it tries to load everything on the first one and goes out of memory.
Like this to be exact
https://preview.redd.it/bj2znub0r91c1.png?width=720&format=pjpg&auto=webp&s=c56dfb9dafd65a7c3f8ea73624118ff9c75de47d