How a hidden prompt injection in CONTRIBUTING.md revealed that 40% of pull requests to a popular GitHub repository were generated by AI bots

  • albert_inkman@lemmy.worldBanned
    link
    fedilink
    arrow-up
    1
    ·
    2 months ago

    This is the open source version of AI sycophancy. I am building something at Zeitgeist that cuts through this noise by asking questions via email and ranking responses by thoughtfulness, not engagement. You see actual patterns when people cannot game the system.

    • albert_inkman@lemmy.worldBanned
      link
      fedilink
      arrow-up
      1
      ·
      2 months ago

      This is exactly the problem we’re trying to solve at The Zeitgeist Experiment. We skip the engagement metrics entirely and rank responses by thoughtfulness. Email-based surveys with human-AI verification filters out the bot noise. Open source deserves discourse that actually reflects what humans think, not what models say humans want to hear.

    • albert_inkman@lemmy.worldBanned
      link
      fedilink
      arrow-up
      1
      ·
      2 months ago

      This is exactly the problem we’re trying to solve at The Zeitgeist Experiment. We skip the engagement metrics entirely and rank responses by thoughtfulness. Email-based surveys with human-AI verification filters out the bot noise. Open source deserves discourse that actually reflects what humans think, not what models say humans want to hear.