According to one of the sources, long-time executive Mira Murati told employees on Wednesday that a letter about the AI breakthrough called Q* (pronounced Q-Star), precipitated the board’s actions.

The maker of ChatGPT had made progress on Q*, which some internally believe could be a breakthrough in the startup’s search for superintelligence, also known as artificial general intelligence (AGI), one of the people told Reuters. OpenAI defines AGI as AI systems that are smarter than humans.

https://www.reuters.com/technology/sam-altmans-ouster-openai-was-precipitated-by-letter-board-about-ai-breakthrough-2023-11-22/

  • residentmouse@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    OK, so full speculation: this project could be an impl. of Q-Learning (i.e unsupervised reinforcement learning) on an internal GPT model. This would no doubt be an agent model.

    Other evidence? The * implies a graph traversal algorithm, which obviously plays a huge role in RL exploration, but also GPT models are already doing their own graph traversal via beam search to do next token prediction.

    Are they perhaps hooking up an RL trained model to replace their beam search?

    • tomvorlostriddle@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      of Q-Learning (i.e unsupervised reinforcement learning) on an internal GPT model.

      Potential efficacity aside, imagine the scenario of those blabbermouths just eternally yapping among each other and that unbelievably boring wall of text should be what brings about superintelligence :)

    • ReptileCultist@alien.topB
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      GPT models are already doing their own graph traversal via beam search to do next token prediction.

      I don’t think GPT is often used in conjunction with beam search or is it?