Bill Gates feels Generative AI has plateaued, says GPT-5 will not be any better::The billionaire philanthropist in an interview with German newspaper Handelsblatt, shared his thoughts on Artificial general intelligence, climate change, and the scope of AI in the future.

  • HiggsBroson@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    11 months ago

    You can finetune LLMs using smaller datasets, or with RLHF (reinforcement learning from human feedback) wherein people can give ratings to responses and the model can be either “rewarded” or “penalized” based off of the ratings for a given output. This retrains the LLM to produce outputs that people prefer.

    • niisyth@lemmy.ca
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 months ago

      Active Learning Models. Though public exposure can eaily fuck it up, without adult supervision. With proper supervision though, there’s promise.

        • niisyth@lemmy.ca
          link
          fedilink
          English
          arrow-up
          3
          ·
          11 months ago

          Bias is inevitable. Whether it is AI or any other knowledge based system. We just have to be cognizant of it and try to remedy it.