Meta is developing its own web search engine to make itself more independent of Google and Microsoft’s Bing. The technology will primarily be used to feed the company’s own AI chatbot with up-to-date information.

  • Onno (VK6FLAB)@lemmy.radio
    link
    fedilink
    English
    arrow-up
    31
    ·
    4 days ago

    Yeah, good luck with that. The Facebook bots are so bad, they literally hammer sites into the ground, to the point where they’re actively being blocked.

    • purrtastic@lemmy.nz
      link
      fedilink
      English
      arrow-up
      32
      ·
      4 days ago

      Just yesterday I banned Facebook’s user agent that is supposedly only used to generate link previews. It was being extremely aggressive, making 20 requests per second. At the time I thought “I bet they’re actually building their own search index”, and here we are.

    • Boozilla@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 days ago

      The Facebook bots are probably trying to make every lesser site feel bad about itself by comparing them to the much cooler and popular sites.