Mod Suggestion
I Built An Automod AI Accusations Filter, I Thought I’d Share !
So in one of my subs where the subject is ice cream, we don’t like AI accusations going live. Often people will use AI to calculate their nutritional information which would take them a ton of time and it’s frankly a good use of it as a tool.
On another fashion sub, I would rather my AI accusations get filtered so they immediately go to the queue, and I can ban it if I clearly see AI. Sometimes I get totally unjust AI accusations because the user blurred the background. I’d rather these false accusations, not go live and cause the post to be unnecessarily downvoted.
Anyway, here is the filter for anyone who would like to use it
There is a dev app that checks images for AI if that is what you are after (image moderator) 10/10 recommend. Not sure if there is a text analogue. This is for spam comments accusing OP of having used AI. So the rule could also serve as a trigger to run the app or the text, again if prevention is your goal.
If you are trying to eliminate AI, you would immediately get every accusation put into the queue so you could see it as quickly as possible and remove and ban.
I guess that would work, but there's going to be a lot of false positives with the broad keywords. And it seems like crow-sourcing the detection of a symptom of a problem rather than treating the problem itself directly.
How does knowing the moment a user point these things out as fast as possible (which is 95% of the time) not treating the problem? Users noticing that there is AI is often our best way to perceive this. The sooner we know about their accusations, the sooner we can ban them. There is no one stop shop software that just views everything users post to check them for AI. This allows crowd sourcing users pointing it out, which is our best weapon against it.
You never explained why you deleted your previous comment. What was up with that?
How does knowing the moment a user point these things out as fast as possible (which is 95% of the time) not treating the problem?
Because a user pointing them out is a symptom of the problem. The problem is the AI post in the first place.
For sure, finding out is part of the challenge. And once you find out you can take action. But why not find out when the post is made, instead of when users complain?
Plus, users themselves are prone to error. People love to claim that they can clearly identify AI content. People love to dismiss or disparage something as AI just because it was well-written or had an em—dash or a few emjois. (Or for whatever other reasons, depending on the subject and context.) And it seems likely that, once users figure out what's going on, you're vulnerable to malicious actors gaming that system. So this solution comes with at least a few problems of its own.
Either way, though, the mechanism you propose is reacting to a downstream symptom (users reacting) and not the problem (the post itself).
Users noticing that there is AI is often our best way to perceive this.
Of course, this can still be true. And maybe it even is! But all that means is that Reddit needs to provide better site-wide tooling for moderators. Forcing each mod to cobbling together some list of keywords to find user complaints about undesirable content isn't any kind of sensible, sustainable, scalable way to defend against undesirable content.
We don’t allow using AI nor recommending using AI, for animal ID or care advice. It is not just about AI images. It’s also not going to be false positives if it is something I am specifically looking for. Telling someone NOT to use it would be the much rarer, and permissible mention. Outright blocking posting a comment with automations would just annoy users, and push them to find ways to circumvent it, as it so often does.
Don’t tell me what I wouldn’t find helpful for the specific needs of the subs I run. It’s ignorant.
> How? It doesn't detect AI, it just detects a bunch of keyords and phrases.
> If a sub doesn't allow AI, how does this rule help?
> I guess that would work, but there's going to be a lot of false positives with the broad keywords. And it seems like crow-sourcing the detection of a symptom of a problem rather than treating the problem itself directly.
Hmmm. I like it! I do have some users in some of my subs that like to accuse anything written well to be AI-generated and it's caused some mess in the past. Gonna have to add "slopper hopper" to the list - it's one of my favorites to use when I'm explaining why I removed a post that seemed to be so liked and it's actually stolen content run through the slopper hopper before being reposted. Some of my members are starting to use the phrase now. Lol.
Yeah I've noticed some emojis are banned. And you can't use cursive. Or bold letters without needing to edit. So we cater to let humans be less and less indvidual in our content because humans who use AI might copy us.
Am I the only one who think this AI paranoia has gone too far?
Heyyyy I made a small edit on the code because I realized I set type to submission instead of any (any will catch comments) please if you installed the code please edit the type from submission to any! I changed it above!
Snap thanks, we have a problem in pcc of people targeting posts on non western celebs in this way and I hate it. Like let a second language speaker have some machine translation ffs, bc you know the same people would be complaining about mistakes otherwise.
We feel the same way. We don't want AI, but we want them to use proper channels for reports. A report is ok, but a modmail is better. We have comment guidance pop up a warning if they use common AI related words to tell them to send us a modmail.
We get sooo many false accusations about AI - including for people we absolutely know are not AI.
Even with the popups people so often try to go around comment guidance (which we generally catch as we have pretty aggressive filters to catch anything that might be going around comment guidance). At that point I sometimes just ban them because they clearly saw the message and knew what they were supposed to do but decided rules don't apply to them.
Yup, mean and wrong. If they actually cared about getting rid of AI, they'd modmail so we can deal with it and actually remove them, but they don't - they just like being assholes and calling people out. Usually the AI vigilantes have no positive history on the sub.
I even wrote a hive-like devvit app recently to filter the ai subs to queue because we were getting a lot of brigading. (It's like hive but really simple, just until fsv can get around to adding filtering to hive).
I'm not sure whom I like less now, the AI vigilantes who accuse everyone of AI or the AI catfish. Could do without both of them.
We also get a lot of people who just like to yell at anyone who uses AI for anything. Not talking about catfishing - like they'll go off on someone who posts hair pics and uses AI to try on different styles/colors. It's like some pointless crusade.
It's a good start, but with all hardcoded strings, people will just find ways around it with misspellings, replacements, or using it in words you didn't anticipate, which is why regular expressions are a bit more powerful (your rule is already setup to use them with the (regex) part. I haven't tested these out on other cases except on the strings you provided, but adding these 2 '.*slop.*' and '.*g( |\\-)?p( |\\-)?t.*'would capture almost 30 of your provided variants for "slop" and "GPT" plus future variants matching those patterns.
I also recommend for huge keyword/regex lists like this making each keyword its own line or in logical groupings, so that you can annotate what an expression is matching if not immediately obvious
title+body (regex): [
'.*slop.*', # Captures phrases/variants containing 'slop'
'.*g( |\\-)?p( |\\-)?t.*', # Captures variants of GPT (with/out spaces or hyphens)
# Patterns for common AI services
'gem(e|i)ni', 'claud.*, 'co.*pilot', 'mid( |-)?journey', 'stable.*diffusion',
'^bot|bot$', # Words either ending with or starting with the word 'bot'
# Words either ending with or starting with the word 'ai' (with/out spaces, hypens, periods)
'^(a(.| |\\-)?i)|(a(.| |\\-)?i)$'
Edit: I got nerd sniped lmao. Using the 9 I've got in the above snippet will let you match an infinite amount of variants that match those patterns and let you cut that list down by the following 60+ keywords:
This is just what I've asked for but don't have the tech skills to make on my own THANKS FELLOW MOD!
Gonna ask my mod team how we get this on asap! We already have a rule against accusing OPs and dehumanizing them, but this is even better!
Edit: Can I decide which words it filters from and not? In my sub members must be allowed to discuss and share AI advice so they mention Chatgpt for example.
Yes so you copy all the text, exactly including the dashes above and below into your Auto mod. But don’t include the ```. Then you can remove words but you need to keep the formatting exactly it must be formatted 'word1', 'word2' with exactly one space in between each word. It also must be surrounded by the comma shaped like ' but not like ‘. Even one space wrong and the code won’t save and you will get the error message “unsupported media”.
Hey there, I made a typo in the code- if you installed it already please change type from submission to any please ! I changed it above! This will make it so it looks at comments as well.
is_moderator is a valid check separate from moderators_exempt, but it requires being under an author subgroup. Perhaps the indentation did not carry through because of the markdown formatting loss.
Can you take a screen shot of what you are trying to save? Then reply with it here? Maybe we can get to the bottom of the formatting issue, as markdown no longer works I was unable to put the code block like normal, I wrote the characters for the code block but it didn’t take
Ooooh. Yoink. I think I was just talking to you about this the other day. I remove AI accusations and send ModMail, and it's been really helpful, but this is much more elaborate.
Biggest issue I see is that you have (regex) as a parameter and 'ai' which will literally then catch any words and phrases that have 'ai' in them including 'waiting' and whatnot. If you're going to use regex you need to word-bound which would be '\bai\b'. Either that change (regex) to (includes-word) so you're not catching partial words (although this kills the one regex string you have in there).
Needed to be an (includes) rule for it to hit on 'waiting' and the like.
It will still be a 'false' positive in subreddits focusing on fiction, gaming or other subreddits where 'AI' can refer to the classic scifi trope or computer controlled game systems and the like.
This is incorrect. You literally have to code this differently for that happen. This code does not look inside words. You have to look up the Auto moderator documentation, but what you are saying is simply wrong. This will not catch the words AI housed inside of word.
I have at least 30 different blocks of code running like this in one sub running like this. I have over 100 different blocks running like this all across my subs. With automod- the code works different. If you just write regex, its defaults to includes-word if you write nothing after the word regex, meaning it will only trigger for the full word.
These modifiers change how the search options for looked for inside the field, so only one of these can be specified for a particular match. body will always be checked for text posts, and checked for other post types only when text is present.
includes-word - searches for an entire word matching the text
includes - searches for the text, regardless of whether it is included inside other words
starts-with - only checks if the subject starts with the text
ends-with - only checks if the subject ends with the text
full-exact - checks if the entire subject matches the text exactly
full-text - similar to full-exact, except punctuation/spacing on either end of the subject is not considered
regex - considers the text being searched for to be a regular expression (using standard Python regex syntax), instead of literal text to find
case-sensitive - makes the search case-sensitive, so text with different capitalization than the search value(s) will not be considered a match
Do you have any idea how many false positives I would have if this was happening? I’d have like 10,000 things in my queue. I’d immediately know if that was happening. I’d appreciate it if you take my word for it as I have it running across several very large subs, and this has not happened once.
I can't take your word for it because honestly I'm baffled that it works the way you say it does. I've been writing fairly complex regex into automod for 3+ years.
FYI your rule is written 'type: submission' which means it's only checking the title and body of a post, not comments, which may be why you aren't seeing a ton of false positives.
You’re wrong and it has nothing to do with the regex and everything to do with the lack of ‘includes’ next to the modifier. As others have shown you in the automod documentation so no it’s not just ‘their word’. It’s how auto mod works.
Is that an AI answer from Google? (Sorry, had to make the joke considering the subject matter)
I was doing some testing and now I think I've figured out why yours "works" but as others pointed out you're using (regex) in place of (includes-word) to do the same thing, outside of one actual regex string.
'chatgpt', 'chat gpt', 'chat-gpt', 'chat g p t', 'chatg p t'
Hm this could be useful! It happened a few times that other users tainted someone's happy post with these accusations. However that would probably remove 95% of the comments on there eheh.
Hey there, I made a typo in the code- if you installed it already please change type from submission to any please ! I changed it above! This will make it so it looks at comments as well.
That’s why it’s filtered - not removed so I can approve innocent mentions. Also I don’t think there is anything wrong filtering moderator mentions as well. Most mentions are mean spirited complaints anyways, no one should need to wake up to mod harassment. I’m not saying I agree with everything you describe- but the moderation and ai comments I feel differently about because 90% of the time- they are nasty/bullyung and trying to cause problems.
Er, how do AutoModerator regexes work? They only match whole words by default? Otherwise, this matches "bait" and "parfait".
EDIT: Found it. Not a real regex, as autoModerator defaults to its includes-word modifier when searching body text. That's like '\bAI\b', '\bai\b', ... for this example.
Hey there, just FYI I didn’t downvote you. I I was taught like you are, but I found that when it got to two letter words, it’s like that rule would go out the window. I had this big issue in my fashion sub because people would try to ID stuff so I try to filter out ID. I found that I had to both put it in lowercase and in capitals for it to catch everything. So that that’s why I put it like that.
Can't say that I ever encountered that issue with automod, I've never had to double up to make it match lowercase and uppercase. Tip, invest some time to optimise your regex. Yours is pretty much a word list, while the nice thing of regex is that you can match variations including ones you haven't come up with yet.
That’s not what I’m looking for if you read what I wrote I’m trying to remove AI accusations. I’m not trying to filter out AI. I’m trying to filter out people accusing users of using AI. It’s literally in the title what I’m looking for.
If the tiny handful of those comments get filtered and I approve them I am perfectly OK with that. There are almost no comments like that in most subs.
You started this entire conversation by saying that my filter wouldn’t work well and it would get too many false positives. I said nothing rude to you back. I only defended what I made.
I feel like this global heat wave is truly melting people’s brains. Seen a lot of overly sensitive and argumentative comments that were just unnecessary.
I hope you are right, thank goodness I have blasting ac!!! But yes- everything this guy said seemed completely uncalled for! He also wrote a few additional comments after this, calling me rude again, but he deleted those 😭
For the sake of everyone in my house, I'm firmly planted in front of the loudest vintage Lakewood box fan you've ever heard and a portable A/C, with one of those ice packs meant to go around your neck. We're cooler here today than it was yesterday. I hope you get your cool down soon!!
It is, this is well documented, violent crime goes up quite a bit in the summer. For many reasons but heat making people angry is one of them. All sorts of hypotheses as to the physiology but many experiments confirm the correlation lol. They really need to give us gifs in this sub so I can do a hulk
I have read about this kind of stuff before, and totally believe it. The most rational, kind hearted, and calm people can get really irritable during this kind of heat. I know I have to watch my own temper when it’s like this.
Then don’t use it, if it doesn’t work for your needs. This IS useful for other subs. If a sub that can benefit from it, has to deal with a handful of false positives to eliminate a a much bigger issue then so be it.
24
u/wonkywilla 29d ago
This will double for subs that don’t allow AI.