https://huggingface.co/NurtureAI/Starling-LM-11B-alpha-v1
This is Berkeley’s model: Starling-LM-7B-alpha with the size of model increased to 11B from 7B.
Special thanks to user Undi95 for their mistral passthrough explanation with cg123’s mergekit, Berkeley of course for Starling-LM-7B-alpha, and also everyone contributing to open source AI development.
Together we are strong!
The performance of this model will increase drastically as it is further fine tuned with the newly added layers.
AWQ version and GGUF version coming soon!
I have been further testing code generation, and I am impressed! It seems be almost on par with GPT4, and it can do things GPT4 cannot, like writing code for Google Apps Script. I have tried a few relatively complex tasks, in various languages (Powershell, Python, Javascript, Google Apps Script), covering various domain (Active Directory, Spotify, Mathematics). As far as I can tell, the code provided is correct!
Try the following example (make sure to load the OpenChat code prompt format I provided earlier); the result is impressive: