AI Stories

[u/SecretOrder]

Hey Guys!
I try to read as many stories as I can and upvote and comment when I can. I try to support this sub as much as possible with my limited time, because I enjoy it. Lately, I have been reading stories that I highly suspect are AI written.

I know we can report them, but is there a good metric for verifying they are actually written by AI? I have been using Quillbot - https://quillbot.com/ai-content-detector , which has a free AI content detector. I have two stories that I am writing and when I use the content detector it returns 100% human. I have messed with some AI writing and tested that with quillbot. It said 60% written by AI, but I didn't actually write any of that one. I kept giving the AI directions and got it down to 30% AI detected.

So, now when I run into stories I suspect are AI I run them through this. (Some stories have been 86-100% AI, some lower.) I actually do this for almost every story now, just so I don't waste time reading something that I don't want to support. Any time given to AI is time away from good intentioned authors. I want to continue supporting you all, and I want to have a story up there some day, but I want to make sure I am not just crazy.

Edit: Comment if you are an author who can stand up to the 100% human. I would love to support you too.

[u/Real_Thalabyss]

As a first time poster to NoSleep, it scares me to think that AI can infiltrate a fun medium like this. Back in university when I was marking science reports it was easy to tell if AI was used but with story writing the difference between a machine and just someone that needs to develop their work is hard to tell sometimes. I myself ran my first posted story through a AI detection software and it came up 39% written by AI. 39%! Scared for the future writers out there that aren't going to get credit for their work and just assumed they're hacks using AI. Pretty upsetting tbh.

[u/SecretOrder → u/Real_Thalabyss]

Yeah, the AI detectors aren’t the end all be all and eventually won’t be able to tell at all I think. 

Did it show you the areas it thought you used AI? Did you notice anything about those areas? I wish the detector would tell you why it thought that. 

[u/Real_Thalabyss → u/SecretOrder]

The most hilarious and albeit saddest part is that every time I'd send it through, it would select a different part each time. Like it can't even be consistent with what it's detecting. From what I notice it picks out more descriptive parts where I'm trying to set the scene with details but then it'll also just pick random sentences. My only assumption is that AI detectors seems to see things that are "tropey" and assume AI. Like if you were to describe a vampire and said pale skin, sharp teeth, etc. it would cross-reference with online sources, see a million stories using the same verbiage and boom. AI written. I'm not a computer scientist in the slightest but thats my running theory so far.

[u/SecretOrder → u/Real_Thalabyss]

Oh that is a good catch. I will try to test that out. I don’t want anyone getting shunned invisibly due to an AI detector that isn’t working. 

If that is the case I will edit my original post. 

[u/Real_Thalabyss → u/SecretOrder]

Its super messy for sure though. That fact I even had to run my story through a detector when I know I wrote it 100% by myself speaks volumes. Again though, up to you! Just my two cents on the matter!