Euphoric-Nebula-4559@alien.topcakeB to LocalLLaMA@poweruser.forumEnglish · 1 year agoFinetuning LLMs: Does it add new knowledge to model or not?message-squaremessage-square8fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareFinetuning LLMs: Does it add new knowledge to model or not?Euphoric-Nebula-4559@alien.topcakeB to LocalLLaMA@poweruser.forumEnglish · 1 year agomessage-square8fedilinkfile-text
minus-squarekristaller486@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoFull-weight fine-tuning should add new knowledge. Not LoRa.
minus-squareEuphoric-Nebula-4559@alien.topcakeOPBlinkfedilinkEnglisharrow-up1·1 year agoAny repo for llama-2 to do this?
Full-weight fine-tuning should add new knowledge. Not LoRa.
Any repo for llama-2 to do this?