For me, it’s just another option in the tool belt. If I need somthing that I know a local model can do, I will do it on a local model. Normally this is summaries, reviewing papers/essays, and bouncing basic ideas off of to see if I’m missing anything. They also excel at creative writing and role playing which can be fun. If I need something with a concrete answer, or high confidence I’ll use the GPT4 API.

I use Deepseek Coder instruct at work for writing PowerShell scripts and some help with troubleshooting. I set up a pc that wasn’t used anymore and had quadro rtx 4000 with DeepSeek Coder instruct 6.7B model and shared it among the team, earlier I was sharing 33B version from home to my work computer and using it at work myself only. I find it better than Bing Chat Enterprise for my use-case - it’s much faster and I don’t have to fight with it just to generate me some code. It’s also all local so I don’t have to worry about how private actually is Bing chat Enterprise.

At home I use various models for questions that I would be too embarrassed about when asking real human, or I would have to pay that human for an answer. It’s a really big deal for me to have some private pocket intelligence that I can talk to that won’t remember what you talked with it about and won’t log the conversation god knows where.

Privacy