I know the typical answer is “no because all the libs are in python”… but I am kind of baffled why more porting isn’t going on especially to Go given how Go like Python is stupid easy to learn and yet much faster to run. Truly not trying to start a flame war or anything. I am just a bigger fan of Go than Python and was thinking coming in to 2024 especially with all the huge money in AI now, we’d see a LOT more movement in the much faster runtime of Go while largely as easy if not easier to write/maintain code with. Not sure about Rust… it may run a little faster than Go, but the language is much more difficult to learn/use but it has been growing in popularity so was curious if that is a potential option.

There are some Go libs I’ve found but the few I have seem to be 3, 4 or more years old. I was hoping there would be things like PyTorch and the likes converted to Go.

I was even curious with the power of the GPT4 or DeepSeek Coder or similar, how hard would it be to run conversions between python libraries to go and/or is anyone working on that or is it pretty impossible to do so?

  • innocent2powerful@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    The demand is truly exist. The highest voted answer didn’t recognize the machine cost of serving a full AI product. Algorithm related library is fast, but langchain is so slow. What I know is many companies are replacing python with go now

    • Dry-Vermicelli-682@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Well that is interesting. What libraries are they using in Go do you know? Or are they building their own from scratch. I would imagine there would be some movement to translate python to Go for some situations. But there is a couple examples within this thread that show some good use of Go with OpenAI (and a local llama as well).

      I am thinking that I could stand up a model locally that uses OpenAI API, and then write some code in Go that calls the OpenAI APIs of the model… and then it would likely swap to ChatGPT APIs or if we decide to run our own larger model in the cloud.