I’m a data scientist working in consulting (EU) and I would like to push my company to delve more into open-source LLMs over closed ones (OpenAI…).

I’m constantly amazed by the progress shown by open-sourced LLMs in this sub. The increasing efficiency of models coupled with the expanding open-source LLM ecosystem make these models more and more competitive.

I keep thinking that there’s a market for custom LLMs, notably for private-sensitive companies like banks and insurances.

Any insights?

  • Glat0s@alien.topBEnglish
    1·
    1 year ago

    Yes. We are currently planning AI project and implementations in my company. We are handling sensitive data which requires us to do it local. And we want to setup a team and establish compentence and more experience in ML/LLMs. For our current use cases we don’t need a “super intelligence” or “the best” LLM on the market ! RAG with smaller models is totally fine and sufficient for us.

    • artelligence_consult@alien.topBEnglish
      1·
      1 year ago

      . We are handling sensitive data which requires us to do it local

      Likely this is incompetence on your end because - cough - OpenAI models are available under Azure and ok for even medical data. Takes some reading - but most “confidential, cannot use cloud” is “too stupid to read contracts”. Ther are some edge cases, but heck, you can even get government use approved from Azure.