• The Velour Fog @lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    21 days ago

    I’d gotten really good at discerning a chatGPT bot from a human account just from years of catching bots on Reddit.

    There’s a lot of red flags and tells that would be very hard to completely eradicate. There will always be an uncanny valley.

    • Perspectivist@feddit.uk
      link
      fedilink
      English
      arrow-up
      1
      ·
      21 days ago

      You think you have - but there’s really no way of knowing.

      Just because someone writes like a bot doesn’t mean they actually are one. Feeling like “you’ve caught one” doesn’t mean you did - it just means you think you did. You might have been wrong, but you never got confirmation to know for sure, so you have no real basis for judging how good your detection rate actually is. It’s effectively begging the question - using your original assumption as “proof” without actual verification.

      And then there’s the classic toupee fallacy: “All toupees look fake - I’ve never seen one that didn’t.” That just means you’re good at spotting bad toupees. You can’t generalize from that and claim you’re good at detecting toupees in general, because all the good ones slip right past you unnoticed.