I use Golang for the backend of an Agent-based platform mixed with Python. I use it mainly for the RAG part, but I’m considering expanding to other functions, and I did some small projects fully in Golang and OpenAI API.

Also, there is a langchain port to Golang: https://github.com/tmc/langchaingo, which shows how much can be done with Golang in the LLM world.

The cheapest and most straightforward solution would be to use Docker Swarm. You will benefit from the cluster without the cost or complexity of Kubernetes. Much less to learn, reuse the docker compose. Here is my go-to stack for similar needs: Swarm, Portainer, Caddy.