• Blue_Morpho@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    5 hours ago

    Current games have a limit. Current models have a limit. New games could scale until people don’t see a quality improvement. New models can scale until people don’t see a quality improvement.

    • FooBarrington@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      4 hours ago

      I’m supposed to be able to take a model architecture from today, scale it up 100x and get an improvement. I can’t make the settings in Crysis 100x higher than they can go.

      Games always have a limit, AI is supposed to get better with scale. Which part do you not understand?

      • Blue_Morpho@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        3 hours ago

        I’m supposed to be able to take a model architecture from today, scale it up 100x and get an improvement.

        You can make Crysis run at higher fps. You can add polygons. (remember ati clown feet?) You can add details to textures. https://research.nvidia.com/publication/2016-06_infinite-resolution-textures

        But really the “game” is the model. Throwing more hardware at the same model is like throwing more hardware at the same game.

        Which part of diminished returns not offering as much profit did you not understand?

        Current models give MS an extra 30% revenue. If they spend billions on a new model will customer pay even more? How much would you pay more for a marginally better AI?

        • FooBarrington@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 hour ago

          But really the “game” is the model. Throwing more hardware at the same model is like throwing more hardware at the same game.

          No, it’s not! AI models are supposed to scale. When you throw more hardware at them, they are supposed to develop new abilities. A game doesn’t get a new level because you’re increasing the resolution.

          At this point, you either have a fundamental misunderstanding of AI models, or you’re trolling.

          • Blue_Morpho@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            3 minutes ago

            When you throw more hardware at them, they are supposed to develop new abilities.

            I don’t think you understand how it works at all.

            Data is collected. Training is done on the data. Training is done on the trained data (deep seek). You now how a model. That model is a static software program. It requires 700 GB of ram to run (deep seek). Throwing more hardware at the model does nothing but give you a quicker response.

            If everyone pays you to use your model, you have no reason to develop a new one. Like Skyrim.