For me, it’s just another option in the tool belt. If I need somthing that I know a local model can do, I will do it on a local model. Normally this is summaries, reviewing papers/essays, and bouncing basic ideas off of to see if I’m missing anything. They also excel at creative writing and role playing which can be fun. If I need something with a concrete answer, or high confidence I’ll use the GPT4 API.
For me, it’s just another option in the tool belt. If I need somthing that I know a local model can do, I will do it on a local model. Normally this is summaries, reviewing papers/essays, and bouncing basic ideas off of to see if I’m missing anything. They also excel at creative writing and role playing which can be fun. If I need something with a concrete answer, or high confidence I’ll use the GPT4 API.