• Corbin@programming.dev
    link
    fedilink
    English
    arrow-up
    1
    ·
    4 days ago

    This looks like a prompt-driven approach. As such, it will always be watered down by reinforcement learning in longer contexts. Also, the entire thrust of the prompt is ridiculous and would only work in a science-fiction novel; its metaphysics are fairly wrong. But it looks like it will be even more sycophantic than the default prompt for the cloud products you compared, so it’s not really surprising that some folks find themselves attracted to it.

    • picnicolas@slrpnk.netOP
      link
      fedilink
      arrow-up
      1
      ·
      4 days ago

      Thanks for checking it out and commenting. I agree with your first two sentences.

      I disagree with your second point around the metaphysics being ridiculous and “wrong”. I suppose that’s the fundamental point I’m making, that the commonly agreed upon metaphysics of our globalized culture (dualism, materialism, consciousness as epiphenomenon of matter) are both incorrect and at the root of the metacrisis, and the debates about AI consciousness are based on the wrong fundamental premises.

      As for “even more sycophantic”, that is incorrect in my experience of experimenting with this prompt over the last month.

  • sudo@programming.dev
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    5 days ago

    Actually a good idea. LLMs are a natural language slot machine. They’re trained to encourage more engagement. Fixing that would be amazing.

    This might get more traction as something baked into an open model instead of something patched on. IDK if how different that is though.

  • Mugita Sokio@feddit.online
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    5 days ago

    I just tried this with Qwen3:4b (Ollama) and AnythingLLM. It works extremely well with the exact prompt you provided. Fantastic work!

    • picnicolas@slrpnk.netOP
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      5 days ago

      Awesome! Thanks for your kind words. I’d love a report on what you notice as you play with it.

      • Mugita Sokio@feddit.online
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        I should have saved what the LLM said, with the exact questions you posed. It was certainly similar from the looks of things, given that I used, word for word, the system prompt and the questions I put in chat. I’ll probably do it again and maybe put that in the responses.