• Lugh@futurology.todayM
    link
    fedilink
    English
    arrow-up
    2
    ·
    3 months ago

    I really suspect this is how the plateau of productivity will look for machine learning.

    It seems finding more data to scale up LLMs is a bottleneck too.

    • CanadaPlus@lemmy.sdf.orgOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 months ago

      Yeah, that’s part of why I think that. There’s also just the alignment issue that no amount of training will fix. At the end of the day, an LLM is a very smart internet simulator, you treat it like something else at your peril, and training it to be something else is very much an open problem.