https://github.com/huggingface/candle

Now that you pointing it out, they are there because i copy/pasted this from a code block somewhere.

But that what i write in my command line and it dont seem to cause issue.

I have’nt been able to run the .gguf in either LM Studio, Ollama or oobabooga/text-generation-webui.

I had tu run it directly with llama.cpp in command line to get it working.

Something about using a special end token and not having standart transformer or something…

https://huggingface.co/TheBloke/deepseek-coder-33B-instruct-GGUF/discussions/2

I use ChatGpt all the time to help me with new project and error :

The error message “guidance is not callable” indicates that guidance is being used as if it were a function, but it isn’t defined as one in the code you’ve provided. It seems like guidance is intended to be a module or package that contains certain functions or classes that you want to use.

If guidance is a module you’ve imported, you should be calling a function within that module instead of the module itself. You need to check the guidance module’s documentation or source code to see what functions or classes it provides, and then use one of those.

For example, if guidance has a class or function named create_program, you would use it like this:

program = guidance.create_program(...)

Alternatively, if guidance is supposed to be a callable object, then the issue might be with how you’re importing or defining guidance. Make sure that guidance is imported correctly and that it refers to a callable object. If guidance is the name of a function you intended to define, ensure that you have actually defined it before trying to call it.