Does Discord Scan your Messages with AI to Ban you?

[@jamesdingus7828]

Saying that scanning your messages by AI is not an invasion of privacy bcus it is not a human, it is the same as saying you didn't kill that man bcus you hired a hitman to kill him

[@ceqell]

AIs and hiring a hitman is NOT the same thing

[@kridayvij]

A hitman is a human, meanwhile an ai is a robot. The ai will not remember your messgaes because it simply does not have enough server storage space to do so. It will not "read' or give you data to any living being, it will simply look for any violations, and then move on. Can you explain how that's invasion of privacy?

[@Ztygs]

You do realize that all messaging apps keep logs etc, right?

[@DexTheTVMan]

​@@kridayvijinvasion of privacy? ez, because they literally scan all your messages

[@Arktik1st]

I think that the “It wasn’t me, it was the bullet that killed him” argument would be more suitable here

[@MaahirMomtaz12]

I don't know how I feel with Discord relying on AI to do all the work

[@RoyaItee]

roblox

[@LegoGoblin]

youtube, twitter, instagram, tiktok, facebook, and every single other social media site has used algorithms (AI) for their work since their beginning.

[@atlandfrisk]

Could be *possibly* beneficial, since humans aren't doing any work. My friend was doxxed on discord and they did nothing against it

[@angelrosepetals]

To clarify, image/video scanning for CSAM detection is VERY common. Almost every platform you use does this, and they should. “AI” (more accurately called machine learning for this use case) is a very important safety tool, and child safety is *the* most important problem trust and safety professionals are combating right now. Privacy warriors will always hate anything that looks at your content, but something has to give for the sake of child safety

[@Cloudwalk9]

To play devil's advocate because this is still a shitty uncomfortable thing, they probably use GPT-4 or something from OpenAI. The ability for modern LLMs to recognize context is remarkable to say the least, and would probably do a much better job than an overworked Discord Trust and Safety employee sifting through millions of reports. The least they could do is only scan when a message is reported. Then this would probably be a good thing. Practically speaking, it would be very expensive to run inference on GPT-4 or any LLM for every single message that's ever sent.

[@PopeMical]

I just really hope I can send the same dumb stuff to my friends without fear that Discord is going to try to start censoring anything that isn't kid friendly. Because it's starting to get exhausting the amount of times I've seen platforms decide that most, if not all the content, needs to be kid friendly.

[@gamrwolf9655]

Yeah I swear discord better not try to go into dms although they most likely will.

[@infinitehexington]

​​@@gamrwolf9655their DM's* Discord isn't a stranger or a person, it's a platform and your DM's are on that platform, by technicality your DM's belong to them, not you.

[@Crow_Rising]

@@gamrwolf9655 As it is being underaged with an account is against the Discord ToS, so it seems kind of silly to try to enforce child friendly content standards, especially in DM's. Why cater to a demographic that specifically isn't allowed on your platform? I can understand cracking down on predatory stuff, but going after any and all content not meant for kids would be a tad extreme.

[@AutisticBarbie]

I’m so tired of protecting the children - discord is wiling

[@Jun.Suzuki]

@@Crow_Rising people 13 - 17 are allowed to use discord though

[@donnelleraeburn9207]

if discord scan messages in pms, alot of discord mods would be in prison now

[@lirachonyr]

that’s good

[@xFroze]

If my gc gets leaked I'm going to jail with my homies dawg

[@jbetrippin]

Yeah cuz I sent one picture of me to my best friend but I can’t find it so I can’t delete it

[@Marder_IFV]

​​@@jbetrippinDamn

[@studsheep]

holy hell i would love to see those news

[@ZirPeanut]

Honestly, discord drama is like finding fish in sea.

[@Elyseon]

More like finding water.

[@infinitehexington]

Impossible?

[@FishbedMyBeloved]

Because you need good bait?

[@okebedoke]

good thing im bad at fishing

[@nightynightlayla374]

“Wow, water is wet!”

[@KaaxItzam]

I am as concerned with this as I was with Mojang playing around with an overreaching censorship and reporting systems in Minecraft. I have a little Discord server with my friends and I know them, and they are all reasonable adults; it should be our domain, where no one external (especially AI) gets to say what we can and cannot say or share (with the exception of you-know-what). If this is a tool that server owners can opt into and turn on or off - then fine, but I fear that it wont be. Eventually, I suspect it will drift into dictating what is or isn't 'misinformation' and propaganda and being extremely kid-friendly to the point they make the service sterile. Not to mention I do not trust AI, which can often hardly understand what a frog looks like, to not be overly sensitive and constantly get false positives. In addition, both Minecraft and Discord are at risk of losing their original spirits and becoming top-down rather than bottom-up I do not understand why western governments and corporations look at CCP tactics, which are universally hated and mocked, and go "this is a good idea!". Its going to destroy them financially too, generalised surveillance is extremely expensive as you need to invest in the technical hardware and manpower needed to keep an eye on people.

[@nickanims]

bro wrote an entire school essay for a youtube comment

[@danieltucker9330]

@@nickanims you call a paragraph and a half a "school essay"?

[@sylv512]

simply don't be a bigot and you won't get censored. how hard is it?

[@kacperkonieczny7333]

​@@nickanimsThat isn't even a quarter of the longest comment I saw on this platform

[@MackieClips]

This is right on the money, my group is in the same boat its just close friends. But fairly enough if the owner could disable the setting then the servers that are in need of bans like his previous video explains could just remove the setting and get away with their nasty activities. So it is a two way street tbh, the good users get screwed up because others decide to break rules. Hence why we cant have nice things xD

[@TheMatthewDMerrill]

This is actually scary because it won't care about the context of a situation. A year or two ago two parents needed to take their kid to the doctor but this was during covid times so they were told to take a picture to send to the doctor. The husband took the picture and sent it to his wife as she was the one dealing with the doctor stuff. Google banned him from all his connected services and reported him to the police. Nothing came out from the police investigation and Google had at the time of the article I read, he was still banned.

[@danielthecake8617]

ok gramps. lets get you back to the nursing home.

[@VitaTheMerm]

Skill issue

[@TheMAZZTer]

I wouldn't really heap on the blame on Google for this one, a lot of it goes to child abusers who made it necessary for Google and others to implement such systems in the first place. The use case of pictures for medical purposes is an edge case unfortunately not factored into such systems. This is at least partly a lesson in why it is important to be internet literate, so you would know it's probably not a good idea to upload such pictures to the cloud. Though I would agree the rest of it is due to the systems not taking into account edge cases that rarely come up anyway.

[@Joe-gz1fr]

> Google detects CP > CP is removed, reported, and the account(s) are banned > Google bad

[@UndefinedFantasticCat]

the problem with ai scanning messages is not even privacy invasion, but the fact that we cannot predict the outcome completely, no one guarantees that ai won't "accidentally" mark a harmless message as child abuse or something... considering jailbreaks are still a thing

[@hi-kt3qr]

ai isn’t used for the csam detections. it’s just file hashes

[@LordTyph]

The privacy invasion alone is pretty bad though.

[@xXrobloxpro123Xx]

i mean, you didn't kill him, the hitman did, but you paid a guy to kill him

[@Microster]

an image/video will only be marked as CSAM if its a frame/part of a video which is CP

[@UndefinedFantasticCat]

@@Microster well, you see... someone can, say, out of spite or just to troll, create cp. with a bunch of innocent images thrown in. exactly to make people suffer, since now those random images are forever considered to be part of cp, thus being marked as CSAM

[@_Syn_Minerva_TWDG]

If discord actually scanned my messages, I’d be serving life and an added 150 years MINIMUM

[@infinitehexington]

🤨🤨🤨

[@theMyRadiowasTaken]

bro if discord was scanning my messages i would be in a mental hospital

[@n1ghtquill.]

​@@theMyRadiowasTakenfr

[@dibel3669]

Ion think that's a good flex 😅

[@n1ghtquill.]

@@dibel3669 Its a flex nonetheless and I'm taking it

[@oryzathefarmer]

Discord has a Social Credits system rn 💀

[@UndefinedFantasticCat]

hey, at least you can still say something bad about government (edit: sorry, not the "something bad about", I meant "anything not completely supportive of")

[@delank4687]

Literally? like what the fuck, am i in korea? do i have to use telegram now? i just want to be able to have complete and full freedom with my close and personal friends only, half of these rules are admitted because discord encourages the "meet friends" type shit. and the little kids migrating to the platform edating in microservers or something. why do the bad guys gotta ruin all our fun

[@TRIMCARROT72571]

I litrly send a ww2 badge from bad country and i didnt get banned

[@TRIMCARROT72571]

History porpuse

[@PatrickSchmalstig]

It's not a social credits system. A social credits system would be publicly viewable by virtually everyone. Only you (and probably Discord) can see your account standing.

[@ASXSFS]

Discord relying on AI to scan messages and photos is becoming a great concern for me, if we send non explicit photos and AI stupidly detects it as one and ban us for it we are so done for, an alternative for discord needs to be made soon cause idk how long they are gonna last for with the sh!t they've been doing lately, especially adding stuff that no one asked for and not fixing stuff on their platform

[@livirus3826]

idk, Guilded seems like a pretty solid alternative. I haven't checked into that place in a while, though

[@GoosePlays20]

Guilded is where I moved to

[@masteralbi6595]

Did you watch the video

[@Preinstallable]

I believe the video said only automatic detection discord does is for CSAM so unless you’re the pedobear you should be fine

[@rohansampat1995]

@@livirus3826 Guilded is the slowest laggy garbage i have ever used . And considering that discord performs TERRIBLY thats saying something.

[@EmApex]

They were already scanning images you sent years ago. I've run into a few issues in the past where I've tried to send a perfectly innocent image and for some reason it gets flagged as NSFW and isn't allowed to be sent, this just seems like an evolution of that

[@GleefulNihilism]

There actually as a big thing just recently of people getting forever-banned without even an explanation email for sending an image that without context looks like just some guy eating popcorn. The kicker was that while that image by itself is fine it was a still from a CP movie, it's just that AI they use knows the movie but can't tell the difference between the relatively innocent stills and the bad ones. So I'll give them credit there. If they have to screw it up, in that particular case at least they screwed it up in the right direction.

[@cunnieseverywhere]

i once found out you could send a mans pp up close and it’d be uploaded with no problem

[@Preinstallable]

😅 I once tried sending an image of a fire axe at Harbor Freight and it thought it was nsfw

[@hellofend4734]

it wouldnt let me send a Vsauce thumbnail 💀

[@ihavetinyweewee]

i tried posting a finger pointing at the camera and it got nsfw marked, but i’ve seen others send real porn

[@gorillamasterofgaming5525]

the funny thing is that these invasive policies are enacted to "protect people" and the bad guys still get away with doing the bad stuff always while the good people give up their privacy for nothing and yet companies and governments still act like this stuff is effective. its almost like an excuse to get people's personal info.

[@canoshizrocks]

Your final sentence is exactly right, that's what this is.

[@ADreamingTraveler]

It's always been that way for decades. They say oh we need to protect the country or protect children so you'd better sign your rights and privacy away forever. Just because of a few bad apples.

[@Sylvainjose-satoyumiyato]

It 100% is an excuse to get people's personal info

[@brunopereira-gx7dp]

technically the dark truth is that big companies want and already do this, the difference is that they buy your data on the darkweb anonymously, that's why strange numbers call your cell phone or scam messages appear in your email, being on the internet already means that some of your data has been leaked.

[@ZephrusZ]

if discord actually scanned my group chat messages I would be in federal prison for life

[@DuckstadLive]

same lmfao

[@batorerdyniev9805]

Copy

[@DarkNia64]

🤨📸

[@DccToon]

i had friends in a group chat that would probably also go to prison if our messages were leaked

[@Eleganttf2]

Skyrim players that enjoys "some" of those "mods" also can relate to this 😜

[@KiwiPoku]

holy shit i did not expect my poorly-researched tweet to spread THIS far and i am SO SORRY for all the panic I've caused. I was NOT aware it spread this far lol. Props to you for clearing things up, you've explained it really well and hell, you've even helped ME understand it better. thank you.

[@jøy_what_riley_loves_the_most]

u r an idiot

[@TheLiverX]

If they want to protect the kids, why wouldn't they create a separate environment specifically for kids? Kids are not allowed to drive cars, should we revoke all adults' licenses because of that?

[@marioalexanderski9598]

Well, for one, at the very least car dependency will be completely gone and people would look for other ways to commute (bikes, walking, public transit) that USA, Canada, Bahamas and Australia suffer from. But yeah, revoking all licenses from adults because of kids being unable to drive is insane IMHO, Mark Twain as said before "Censorship is like telling a man he can't have a steak, because a baby can't chew it.".

[@KodokuSamaa]

Honestly, this is a good point. Why not create a Teen-Discord version and Adult-Discord version? In one you are only allowed to be 13-17 years old, in the latter only 18+ is allowed. Hard concept I guess?

[@Im557]

​@@KodokuSamaabut the predators could fake their age to prey on minors

[@vickayy]

..do you not see how this could end up horribly 💀

[@nestlesubliminals]

This may be silly, but interests me. Me and my friends insult each other jokingly, and all that. If discord scans our group chats, then what, will we get warned? That's bs

[@scribblecloud]

see thats what im saying 😂 most of my friend group is queer and we often make jokes along the lines of "youre gay?? 🤢🤢🤢🤢🤢" and making fun of homophobia and racism and whatnot

[@TeamGalactic-Cyrus]

@@scribblecloud relatable. me and my friends joke about the strangest topics like death and gruesome murder, because dark humor

[@georgenoodles1387]

​@@scribblecloudliterally me

[@Claire25252]

​@@scribblecloudsame but on a higher level for me. Me and some other friends do use slurs but we are all okay with it and open. But discord is going to warn us even though we are all okay with it?

[@hakari-theGambler]

hella relatable bro

[@Muffll.]

I love how u talk about this Privacy & Safety thing for like half a year and i still dont have it.

[@pv_r3]

same

[@Kripahhhhh1402]

I mean, if you don't chat or send anything so often the chance Discord screwed up your account is very low (afaik). It's still good to know that these are exist and may affect some random user.

[@swgclips03]

The coming months and year will be the breaking point for Discord. For the last few years now they've continually tried overhauling certain aspects of their app, having success or failing (in most cases); It is in my belief that Discord will do several controversial changes over the course of now to mid 2024, and it will continue to drive away its former userbase, and attempt to grab all of the new users who are used to social media sites and whatnot. Discord has changed, and will continue to change for the worse. I wish we'd have some alternative, but without millions of active users on an alternative clone, our only protest really is to talk about the bad part and just... Boycott Discord. Either quit using it or cancelling Nitro is all we can do.

[@hellofend4734]

if there was a way for me to like, download my groupchats and servers with friends to archive them, i would jump ship

[@SwordfighterRed]

Element/Matrix really might be the closest thing to it. That's going to be my fallback, at least.

[@SwordfighterRed]

@@hellofend4734 DiscordChatExporter does just that, but I think it needs Windows.

[@Tigerlily242]

I mean there is Telegram I use nowadays but idk if anyone would be on board with that

[@SwordfighterRed]

@@Tigerlily242 Does it do all the things Discord can? I like the ability to screenshare things in Discord (with audio) and all the custom emotes and stuff. That's really the only draw I have to the platform.

[@uncirtyne]

So we just have to *hope* that a system that can automatically ban you detects, for example, that what you're saying is entirely fictitious and all parties involved know that? Like when playing a tabletop game through text.

[@erubianwarlord8208]

yep or find a way to feed it a poison banana that causes the AI to fatally crash

[@JaykPuten]

I don't even use n have never used discord.. Why have I been subscribed and watched so many videos? Seriously quality content is quality... Even if it doesn't apply to anything I care about... If you covered using an esp32 and esp now, or using LoRa(Long Range) modules to make huge area networks, or electronics/computers/Linux... Then you'd be right in my list of videos I usually watch n use in regular life.. Or we'll 2nd amendment stuff... Yet you don't.. and I still watch... Quality deserves to be respected even if it's not on a topic that matters to you

[@IJNAoba9-25-26]

That Facebook Tay comparison was honestly a good one. If discord releases this half-baked, then a select group could take advantage of this, mold it into their perfect specimen, and just watch it attack and strike Discord Users at random like a crack addicted Pitbull.

[@transecho]

That facebook tay comparison is the most logical one because the idiots who keep introducing these new dumb changes were ex-employees from facebook.

[@Mopstorte]

Tay was by Microsoft. Also, the issue was that it learned directly from the interactions with users, while GPT does not learn in real time. It learns through new updates that OpenAI applies to it, and the training data they give it in those updates *can* contain user interactions, but those can be filtered/chosen by them.

[@beepboop6212]

crack addicted pitbull is crazy 💀

[@Cloudwalk9]

We need to think about "self-censorship" and chilling effects. No matter how sophisticated the AI, this is going to have unintended psychological consequences that are very subtle. Imagine on the extreme end, someone confiding in a close IRL friend about s**ual abuse they suffered as a minor. Keep that example in mind and scale it down to the less extreme as you read on. There's a reason GPT-4 on ChatGPT has a cap of 50 messages every 3 hours. It's expensive as fuck just to prompt the most sophisticated LLM currently in existence at mainstream scale in a controlled setting, and it STILL makes mistakes on occasion. None of this is okay and is premature at best, or they're not actually going to scan every single message. LLMs like GPT need a lot of VRAM and can hold only a limited amount of text in memory for context, which requires more VRAM. The entire idea takes a shit on the human condition itself, how we interact, and all of our nuances and subtleties, which the current state-of-the-art is unable to grasp entirely. We all have skeletons in our closet, deeply personal things, or maybe want to shitpost or debate about taboo stuff, in the purported "privacy" of our DMs. Where and how would an AI draw the line, and how are you, a hopefully law-abiding person, supposed to know where that line is drawn, in a black-box surveillance system, and if the next racy message you send will get your account nuked? You might feel a subtle paranoia and think twice about sharing that controversial opinion to your close friend. If a platform ever makes you feel that way with even DMs, then something is very VERY wrong. Let's suppose they do actually scan every message, because the Transformer architecture *was* a revolution in AI, and GPT-4 for example can decipher context pretty well, and can do a decent job of auto-moderation. But, does Discord have the money to scale this? They have to pay for hardware, e.g. GPUs with enough VRAM, to run inference on an LLM for every single message ever sent with a large enough context window size (which requires more VRAM) on a massive platform, for the AI to be fed enough context to make judgements. AND they need even more VRAM to train their model. Businesses love to cut corners. Hey! Let's lower the context window size and save money on VRAM as our platform grows. Yay! More false positives for everyone because the AI can't see more of the conversation. Fuck that.

[@Cloudwalk9]

Personal anecdote I want to add. Ironically the original comment was removed for the exact thing my main comment is talking about, so you'll have to fill in the blanks. When I was 16, my friends and I used to occasionally make edgy jokes about

[@hellofend4734]

you are so fucking right

[@Cloudwalk9]

@@hellofend4734 I feel like in all of the fog and confusion and speculation, the real problems get diluted and become irrelevant. Any victim of the problem are relegated to r/discordapp and ignored. They keep the problem under critical mass to avoid wider backlash later on and let the community eviscerate themselves at first in all of the fervor so they can increasingly get away with bullshit.

[@Cloudwalk9]

Also, anyone who watched the AIDungeon filter shitshow back in 2021 pan out in real time will understand EXACTLY what I'm talking about without having to read the wall of text. The number of false positives left little faith in AI moderation for me (EDIT: Yeah that's one example, and not a good one, ChatGPT still reinforces my point though). Even ChatGPT flags shit routinely. So it's not like the situation improved. Discord hasn't really gone into detail as to how this would be implemented and when and how human intervention would occur. Simple AutoMod-esque flagging of keywords followed by AI scanning and human intervention? Or... what do they have in mind? Can we trust them? Just no. FUCK no.

[@msjademarvel1542]

I'm so fucking angry honestly I loved discord even with the stupid updates but this is way too far I've already gotten two warnings for talking about how I got groomed ON DISCORD

[@preiium7553]

discord employees: boy oh boy! havent seen someone complain about discord in a while. and you know what that means! we need more safety than there already is!

[@UndefinedFantasticCat]

theory: there was none in the first place and they only try to multiply the safety

[@brianbuddy2ACP]

Believing that AI scanning user data isn't an invasion of privacy is like believing that the Earth is flat. It's idiotic.

[@PearlCradle]

I share a server with just my girlfriend. We've been together for over 9 years, and we send some pretty adult stuff to eachother in our own private server (because we're adults in a consenting relationship - we like to send stuff to eachother). This had better not ruin it.

[@MrOpenGL]

That's not a great idea, why don't you use more secure platforms to do that like Signal, since it's just you two?

[@thatonesnake8102]

@@MrOpenGL Its a private discord server nobody can join it without the invite link so it is pretty secure

[@MrOpenGL]

@@thatonesnake8102 Why would you want an AI to scan your nude pics when you can just message you two on a better platform however? Hmm...

[@TheLastYoloFighters]

Its not really secure at all. if there is ever a major data leak at discord or some other similar breach it could leak all of your stuff. Encrypted platforms like telegram or signal would mean you personally need to be breached, vs just some funky stuff at discord.

[@zer0_d4yz]

@@TheLastYoloFighters telegram isnt even encrypted unless you start a secret chat with someone which isnt even available on pc, signal is the way to go, its actually safe by default

[@user-xp8nq5mf9y]

They dont now but they will in the future when the EU passes their bill for exactly this kind of thing. What discord is planing to do in the future is what the EU actually wrote in their law. Things like this are going to be more common on everything in the internet.

[@gabrielarrhenius6252]

Yea, even though it has a pretty big opposition as far as I know, at least with how it is worded. (at least here in sweden)

[@delank4687]

cant wait until they start restricting opinions

[@lightning_11]

I love how they test moderation tools on Canadians because they know Canada won't generate that much load.

[@FreonSB]

Me looking at Discord as it deteriorates itself more and more

[@SuburbaniteUrbanite]

Discord gotta be careful unless they wanna lose a huge portion of their user base to other services such as Telegram.

[@andrrevidanes8060]

Minecraft players: Hey I've seen this one before! Discord users: What do you mean? It's brand new!

[@beegcreeps6615]

I don't think my group chat in discord is surviving this one

[@DuboDuboLubo]

problem is, even with that people will still get messages flagged for nsfw even though its not you could send an extremely terrible thing and not get banned but a picture of an owl for example would get you warned

[@sideswipebl]

Discord could still be scanning every message and I wouldn’t be surprised

[@killerkonnat]

It absolutely does scan videos and NTTS made a video about it with the guy eating popcorn.

[@hopperelec]

@@killerkonnatIt doesn’t scan videos, videos are too large/complex for it to do that for every video upload, but it does scan images. You’re probably thinking this because NTTS mentioned in that video that the image sent was a frame from a longer video, but Discord didn’t scan the entire video it just matched that one uploaded frame with a video which was already scanned years ago by other organizations such as the police

[@Roadent1241]

I thought it was already. Why wouldn't it?

[@raylo555]

I really... Really hope this stuff starts to encourage people to move away from discord.

[@sleepless9003]

But to what?

[@spicybun5302]

Prob Guilded? Although its not as good as Discord but its a close competitor kinda@@sleepless9003

[@onlygoodperson]

@@sleepless9003 hire a dev and make your own platform

[@Cubedex679]

The problem is discord fills a niche that not a lot of people could easily move away from. You can have a server with 30 friends, and channels for different topics, with various different ways to control notifications. And cross platform between mobile and PC, Even voice channels eventually made it to Xbox and PlayStation. No other platform really fills that space that well. The closest one I can think of is Slack, but I know from experience that it's not quite the same.

[@SurmenianSoldier]

​@@sleepless9003matrix

[@rhettorical]

They've been scanning messages for years. I had gotten a warning for sending a friend a link to buy underwear back in 2020. Was honestly shocked that of all of the memes we sent each other, it was an underwear model that Discord said "hey whoa buddy that's mature content" to.

[@Midnight_7520]

you're my go to for info about digital stuff, mostly cause of the smooch at the end of the vids

[@Kripahhhhh1402]

If Discord scanned people's images, I might imagine those people on the server with NSFW channel going to get (at least) warned at some point. Not sure if it's affect images from link as well. Also, wondering if it's affect people talking in other language as well.

[@FevilDraws]

most likely that discord filters channels that have the "NSFW" warning filter on it, basically to keep from warning people with the damn nsfw warning thing despite the channel bein used for the said thing.

[@raineblackstar3522]

Makes me fear they'll go after innocent people. Imagine someone hates you enough to spam report you for something you didn't do and you just randomly get banned from discord. I don't have a lot of trust in this new system...

[@CosmicPelt]

They're basically telling little kids with a vague understanding of good and bad to monitor and govern what we do.

[@Nyaauraa]

I'm surprised that people only now are realizing that Discord scans pictures, it has been doing it basically ever since its inception, at least when it detects something resembling too much "skin" showing. Then again, I doubt that people talk a lot in dms with people they're not friends with, which is basically the only scenario where this would ever be triggered, at least for most people due to the default option only allowing explicit content from people in your friends list, not from people that aren't on your friends list xd

[@Lampe2020]

I actually really like this detailed account status thing (even though it seems to not have been rolled out to Sweden yet), because I somehow sometimes get in trouble (mostly on KZbin) for no reason, I've for example been comment blocked three times this year (two of them in October) on YT because of "Spam, fraud or fraudulent behaviour" (even though I only write pretty harmless comments and normally not above ten/day, spread across a bunch of different videos). Did I get to know what comment got me blocked or even why it did? No. I also got banned off eBay half an hour after registering. All I did was put an item into my shopping cart, see the enormous delivery costs and remove it again. And a while later I get an email that I'm banned for endangering the community. When I asked the support what I did wrong they said I endangered the community. I then asked "And what part of putting an item into the shopping cart and then putting it back without buying it endangers the community?" and I got a response that my account has been unblocked because no dangerous behaviour could be found on my account, followed a few minutes later by a message that my ban is permanent because I endangered the community. I'm still banned off eBay.

[@scribblecloud]

BRUH

[@scribblecloud]

no but seriously though i am very glad it actually tells you if you are in trouble and what you are in trouble for

[@manofyen]

get this man an unban from ebay

[@Lampe2020]

@@manofyen I have already deleted my account as it was useless to me in its state. And because it instantly got re-banned after getting manually unbanned by staff I don't think another unban would last more than a few minutes.

[@gdhuvban]

The turn from "we're nice" to "go f*ck yourself" is so funny for some reason

[@Movedaccountsss4847]

Frr

[@daveeska]

0:41 what is that recomendation vid 💀

[@fiti.]

Just imagine making a sarcastic joke for example "I'm gambling", and getting your account striked or possibly terminated.

[@Kiemi39k]

Did you watch the video? ldeot

[@Kiemi39k]

5:29 you😂

[@reddo3758]

i am a discord degenerate so i see ntts videos the second it uploads.

[@CalWhimsical]

me too

[@malmock]

relatable

[@Vonexery]

same :(

[@BoomyKing]

Same

[@deadweightnero]

amen

[@SpeckyYT]

imagine paying a year of nitro and getting suspended for a year 💀

[@B_Studio841]

Rip

[@shellularity]

Canada's actually a common place for testing launches. The Wii Mini (you know, the red one with no wifi) was launched in Canada way before the U.S.

[@LostSendHelp_YT]

This reminds me of the Chinese social credit sisytom, but just for a gready cooperation

[@Akuba]

Discord destroys itself without an alternative, this is bad.

[@weiwu1442]

welcome to what happens when theres no competition

[@Jun.Suzuki]

are you telling me you dont want discord to fight back against illegal activity on their platform?

[@bmz4]

​@@Jun.Suzukino, that's not what they said. that's a whole new sentence you just made.

[@thegreengrandus]

Gulided:

[@beepboop6212]

@@Jun.Suzuki that statement is not what they said at all yes, a lot of people agree that discord should fight back against illegal activity, but at what cost? reality is about tradeoffs, but this tradeoff (privacy for security) is unacceptable for a lot of people

[@stayfocused6481]

My homie just got a permanent ban for posting some questionable memes in a text channel on a private server. Had no idea that was possible, but it apparently is. Be careful out there fellas.

[@MetaBloxer]

I believe there is a lot of potential in this, though it's certainly not a silver bullet for support issues. But I will also say that privacy is about how data is collected AND used (which is why there's sections for both in privacy policies), so "Only AI can see it." does not negate how much is being collected.

[@SlyEdits]

Whoever edited this video is insanely skilled. Sucks that their socials arent anywhere in the description or on the channel, but whoever you are this vid was fire 🔥🔥🔥

[@new_simsons]

I guess it's ntts

[@matevaRDN]

Discord is slowly becoming roblox.... you cant escape AI moderation....

[@hellofend4734]

certified your account has been banned for three days Reason: Harrassment Offensive item: "gay" moment

[@LucyWoIf]

I honestly like the warning system. Especially that it shows what rule you broke and what the bad content was, will also help being unbanned quickly if its actually something not breaking the rules

[@squiddu]

why does it feel like half the people in these comments didn't even watch the video

[@gamegator1048]

This is kind of like Minecraft adding chat reporting to take away power from java edition/server owners.

[@gnu191]

You can't justify the invasion of privacy.

[@jojomicheldu59]

He's saying that no discord won't ban you but at the end he says that people like me will be banned :/

[@jamiehobson6336]

Ah so what your saying is we have another AI model to corrupt. Will companies not learn to Microsoft's twitter AI bot mistakes? Did they forget the internet has a habit of easily turning nice AI to fascists?

[@silkworm025]

I can't wait to get a suspension because I talked about the classic British dish that sounds like Maggots and Fash. Or because I talked about smoking in a British way. Or that aside, AI can't deal with context properly. I could be quoting something, or telling the story about the time someone got upset that a t-shirt in a store had the colour name in three languages, English, French, and *Spanish*. Also... you just know people who do any sort of roleplay are gonna get shafted by this. Even if it's as innocent as a tabletop RPG, when you're rolling to seduce that pretty barmaid to get information, the AI's not going to understand the difference between that and grooming.

[@fluf201playz]

i like how they are tying to copy the xbox strike system yet the xbox strike system got alot of backlash

[@GTexperience_Channel]

I actually liked the fact, that servers were community managed. That u can now receive bans for saying something that isn't politically accurate in your own server seems very toxic.

[@TNTISGOOD]

Ntts makes everything so easy to understand and adds comedy(just enough) I love his videos and they always keep informed on every scam and misinformation(real story: my vigilance increased by 75% after watching Ntts). Now I am a lot safer! (sorry for such a long message 🤓)

[@TophatDude1]

Oh hell nah- *gets banned*

[@TheAquaAuthor]

Wait, so if I'm in a relationship with someone (legally, don't get any ideas) and we get a little bit spicy on discord, can we get warned for that behavior? I'm so close to moving to Element, I'm this close, I'm so close to done with this company :)

[@almahnak12]

Of course it's people on discord going crazy over being moderated

[@Kiemi39k]

Well yeah... I think this wasn't necessary, now we need to behave :/

[@walmartoyota]

"also let me save this sticking out your gyatt for the rizzler video" 😲😲😲😲😲

[@JewelWildmoon]

On one hand, hopefully this will deal with the creeps joining some of the servers I'm in ever since the mods and owner stopped being active. On the other hand, my ass might get banned if just existing in the server they're in is enough.

[@thatonesnake8102]

What server are you in that has such bad content youd get banned just for being in there

[@IdioticEggnog]

I know this will be a very cringey thing to say but as somebody who roleplays (nothing nsfw, its all just fandom stuff, i know cringe) im still very terrified of the idea of ai messages being triggered in general. Im less worried about things like fights or threas due to warnings, but about the fact that we have multiple CHARACTERS who are children in me and my friends server and I worry this ai will take those characters saying their ages and take it as me, the roleplayer, being that age. I'm hopeful that the ai won't mess up that, but it is something that I worry about. Maybe thats just me being anxious however.

[@naughtykid000]

I'm honestly thinking about deleting tiktok, people have negative braincells and instead of teaching or having a normal convo about why they think what I said Is wrong they just attack you and come at you with aggression

[@NotQuartz]

Discord does scan every message tho. A couple months ago I tried sending my friend a screenshot I took of a manga chapter and it got marked as explicit for seemingly no reason. This was in a dm for a friend that I've been messaging for years...

[@thedecentgamer7818]

That's an optional setting that people can turn on or off to prevent explicit images from being received. But as far as I'm aware (haven't watched the video, just scrolling through controversy in the comments), they're essentially trying to force everyone to have it on at all times, without any options. And it's gonna scan everything, not just images. Oh, and it'll also ban you if it doesn't like what you're sending, instead of just telling you that you can't send it

[@kbfton]

I think Discord keeping an eye on people is good IMO, but the fact that they use AI to do this worries me. AI won't do a good job of knowing what message is purely sarcasm/joke & what's not. Not only that, AI isn't perfect either. A few days ago, I just sent a picture of a meme to my group chat, and I just got a warning from Discord. Whatever you do, I want Discord to implement AI as a tool for Discord mods, not a surveillance tool. Gosh, Discord is now getting more like CCP than ever.

[@YurLocalBomber]

i cant do anything until 2026 💀💀💀🗣️🗣️🔥🔥🥶🥶🥶

[@m_ster3xe30]

Daily dose of someone with a brain, thank you for your uploads love the videos

[@greenturtleplays]

9:22 😭why no text to speech

[@MrRiceKrispyNotTaken]

i will find funny that this new system gets turned into the broken mess that's facebook's auto mod where it flags the things that aren't even bad and ignores basically anything else

[@nightowl6055]

NTTS Could you please stop using discord notification sounds to censor swear words?

[@Xyrothim]

I agree

[@Squant]

I love how most of the comments here are the exact same kind of knee-jerk panic mode reactions and conspiracy theories the video makes fun of. Smart audience.

[@SpartanWax]

No because the TOS is broken way too often.

[@68200]

Now it's time for Discord to actually read the reports and don't reply to everything with Clyde

[@EnBunk]

A naked man fears no pickpocket.

[@user-xp8nq5mf9y]

But he cant come close to schools or parks.

[@alekzazza3337]

​@@user-xp8nq5mf9yor can he...

[@Neo-wc8hs]

And also, let me save this "sticking out your gyat for the rizzler" video for later *sats with 100% seriousness*

[@LisaaP.T.]

Hot take : I kind of like the idea of discord having a thing to scan for photos or sensitive content only for the fact that i myself was -for the sakes of demonitisation or whatever- a victim of suspicious activity off of discord . That being said , i feel like this should be worked on a little more then it was . I just want other people on discord to be safer since i know alot of under aged people who use it . That's the only reason why i agree with things like checking images to see if they are innpropirate .

[@aronaoi]

I give insults and death threats to all my friends as jokes and we all do it in our server. Discord is going to ban us for doing that?

[@andrzej124_]

literally 1984

[@catlover281]

2b2t has essentially turned into 1984

[@nomnomnomturtle2708]

Erm… akschually it’s called Nineteen Eighty Four, not 1984.

[@fluori5890]

Hey. When I saw your channel name I immediately thought it'd be the most barebones and low research channel. I was wrong. It's clear you care about the content you post and don't just say "good enough." so thank you for actually producing content we can learn from :)

[@pls_stap_]

Even though I don't do sus or disrespectful stuff and I personally don't really poke fun at people since I'm kinda uncomfortable with that even though I would know they wouldn't get hurt, but I'm still scared about this because of the possible false positives that it could detect, which may not even be close to a no no word

[@TheGuyWhoIsSitting]

They’ve been doing this for the longest time. Although seems a lot of people are concerned about it being done by computers (we do not have AI yet. You can call it AI but it is not AI in the literal sense.) when this has been common practice even back before discord existed. I’m not saying I like it, but, I’m pretty sure this has been common practice for well over two decades at this point. It’s just that the software is more sophisticated now. But tends to false flag and take everything at face value. Granted even with this knowledge a lot of companies continue to do nothing like Facebook and Twitter pre Elon purchasing it being used by pizza makers to coordinate their sick and twisted actions. Which Facebook at least, openly acknowledged. Not a good look. Either way all of your messages are being stored in their servers. I’m not sure why this is a surprise to anyone.

[@AnonsTreasures]

It's not a surprise it's being stored or logged, it's a concern it will be enforced. Most people engage in bad behavior according to discord's TOS. No one wants that. They've really tried to stick their head in the sand and let people break TOS, take it from me I've had more conversations with Discord staff than most, but if they intend to use AI for trust and safety it shows an intent to become stricter on what they'll turn a blind eye to.

[@Fragmaster_tito]

Literally 1984

[@hellofend4734]

this is just like 1984 fr 😔

[@Jun.Suzuki]

ikr no more grooming minors its a sad day gentlemen

[@Jackpkmn]

I love the line "all complaints are reviewed by humans before you are actioned" because its corpo speak for "a human rubber stamps every one spit out by the automated system without looking at it"

[@icydoesthings0]

it says im suspended until 2025 for a false report saying im underage

[@Pc_taco312]

Everyone is gonna Get banned. We all that one group chat with your friends and We know What’s going on there

[@_terminal]

I think this will do more good than bad.

[@user-eu3dv5hc8p]

yeah ppl should discuss the most innocent and interesting things at least in tg, not on random discord server, bruh

[@AnthraXFPS]

Never clicked a video so fast lol, about a week ago I sent a meme (adult humour but nothing too bad) i get logged out of discord, upon trying to log in im greeted with "this account has been disabled" I email support an they reply saying "You're account has breached our ToS and for this reason we will not reinstate your account" 😂

[@abdoujumper]

0:39 sticking out you gyatt for the rizzler 😂😂😂

[@jordon_]

bro someone sent their id in a public discord channel to try and get full access to a youtuber discord server 💀

[@luna_fm]

Iam a inactive NSFW Artist. Talking lewd language is a daily thing. The Ai won't understand that. I talk NSFW almost 24/7. With lots of profanity in the mix. Ai is too dumb for this. The ai can't tell apart a case of NSFW Artist and a Groomer because both have extremely lewd languages. So the NSFW Artist says he wants to make a noncon piece. Or praises Art of another Artist or is generally lewd talking to other NSFW Artists who are also lewd talking. NSFW Artist sexual themes clash with chat logs i seen of groomers because the same language is among adults however with less malicious intent and blatant NSFW. It clashes when i ask for specific piece of a Character like for example Marina Ida from Splatoon and it goes "Send nudes of Marina" like bruh the ai won't know who the fuck Marina is and just assumes the closest thing in relation it knows. Which makes it assume that Marina is a child or something and not the Splatoon Character Marina Ida. If anything they should try to identify who is a NSFW Artist and then add this as context to the ai, this requires manual research and analysis of the data of that Artist since what they usually say or do would add to the context and prevents mass false positives on NSFW Artists. Meanwhile NSFW Artists and Groomers are two entirely different things and one of them being illegal and despicable... Their language does not differ from one another too much. And that's the problem. Especially with the noncon case since we are talking about a action that is illegal in the real world the ai would assume that i plan to you know. Which leads to another false positive. NSFW Artists and the people that surround them have to be identified and ai moderation personalized to allow these people to continue their ways. Making art depicting illegal acts is not illegal in of itself unless it's glorifying said actions, which it doesn't really do and there's people who are fan of the example i mentioned and would even roleplay the theme with their wife or girlfriend or whatever they have. Which isn't exactly glorifying it just like the art that compelled them to do such a roleplay.

[@elpepeetesech696]

So stop making nsfw art and get an actual job lol

[@sleepless9003]

​@@elpepeetesech696📠

[@luna_fm]

@@sleepless9003 that's a blatant ad.

[@SolomonSamms]

Considering the war crimes I have committed in my homies DMs without being banned it should be obvious this is not true

[@RebootedBlueb]

No more racist jokes with my friend 😢😢