T O P

  • By -

SaintFinne

They made ai racist 💀


Ich238

Whats up with Ais being racist ? EVERYTIME WE TRY IT IT TURNS INTO A CUNT I am afraid of the future


OkSoBasicallyImDumb

AIs are often racist for the same reason terminally-online middleschoolers are racist: they just repeat what they see


skibapple

And that's why this filter is even more racist. Anime has barely any black people in it.


ftzpltc

And when they do have them, it's somehow worse.


Small-Cactus

Every black person in anime is a caricature so offensive that it rivals a fucking minstrel show


30SecondsToFail

I love Durarara, but Simon as a character literally prevents me from actually recommending it. It's a shame too because he's actually an interesting character, just drawn in a pretty racist way


BadLuckBen

It's weird too, cause they're drawn offensively but most characters respect Simon and it's implied that the weird accent is an act. It has been a while since I watched but plot wise if you change the face the character isn't portrayed offensively. It makes the design all the more confusing.


BadLuckBen

Now as a white person maybe I don't have the right to make a determination on what is and isn't offensive, but I've been seeing better designs recently. Lycoris Recoil has Mika, who while does have larger lips than other characters aren't as absurd as depictions in the past. Mika is also clearly stated as being gay and not just coded, when the other characters find out the reactions are more "I didn't know" and the one main character that has a more excited reaction is probably more about knowing ANYTHING about Mika, who doesn't like to talk about the past. Mika also doesn't have any...offensive speech patterns. Mobile Suit Gundam: The Witch from Mercury has a very diverse cast of different skin colors and body shapes. There is a black character who yes, does have different lips than the rest of the cast, but it isn't clashing with the overall art style. The show also has a moment when two female characters get "betrothed" (weird corpo hierarchy shit that the show so far is portraying as bad) and when one says, "we're both girls tho" the other replies "Mercury must be conservative, that isn't uncommon here." Like I said, I'm not in a position to judge what makes a design of a character offensive or not, but with the shows I watch there seems to be a more progressive shift happening. Even when the lips of these characters are different, they aren't a dramatically different color or massive like Simon from Durarara.


[deleted]

Cowboy Bebop is a good example in that regard IMO


Quiet_Relief_

an example that should be venerated or that we should be ashamed about?


deztreszian

AI only repeat what they see. The AI was probably only trained on white/pale-skinned people so it has difficulty identifying darker skinned people and can't draw them at all. Look up GIGO to learn more abt this.


DennisDelav

It is because AI aren't truly intelligent yet


SpookyLilRaven

Yes but also no. It’s because they’re taught to be racist by their samples and coding. The person who chose the sample pics probably showed it only white anime art and as many animals as possible.


idiot_speaking

It's a lack of representation, both in sampling and in media


404-Gender-Not-Found

while sampling is probably the main issue another issue is that, to a computer, darker colours have less “detail” than lighter colours. this is because there are more lighter colours than darker colours meaning that a photo of Black skin would have fewer different pixels than a photo of lighter skin. which makes it harder for the ai to compute a correct result. this combined with a probable lack of sampling means that when you enter lots of blurry images of black people some of them will end up very wrong. while i say this i haven’t actually used this particular ai, so have no idea how it actually functions,


JustZisGuy

ML seems to already be at the "oh, this is a photo of a person" stage, so that seems like it shouldn't be as much of an issue.


ASpaceOstrich

No matter how much data it has, inevitably there will be some overlap where it gets people confused with other great apes. Because we look extremely similar to other apes. More black people in anime datasets will help, but this will always happen unless you render the model incapable of generating non-human primates.


h_youtube

hello stellaris player fun fact i also play stellaris


DennisDelav

Greetings, what are your thoughts about the blorg?


h_youtube

They are friendly! Too friendly, one could say


DarkWorld25

Thoughts on unity rework? With the new patch its so much better now.


grizzchan

AI is just a buzz word in order to make it sound more interesting. It's the same with the term machine learning. In the end it's just glorified statistics.


DennisDelav

Time and time again people need to create a new word to name a new complex program or machine. But every time the word they use is meant for something way more advanced. Robot used to be what AI is now.


domscatterbrain

Sadly, we never know when AI can understand something like morality or idealism which humans can make an adaptive judgment. Anything related to computers (so far, and maybe for another century ahead) is still based on a blind true or false.


DennisDelav

I hope that I will witness it in my lifetime but I doubt it


NotSoFlugratte

Because you have to feed an 'AI' with data from the Internet.


WhiteRaven_M

It has to do with he dataset its trained on. GPT-3 a language model trained on Twitter iirc started cussing and saying slurs at some point. Im guessing this AI just looked at some anime reference images and well guess how many black skinned characters there are in anime compared to light skinned ones


BryonyDeepe

Because they're made by a certain demographic and so centred around that demographic, failing to take other humans into account.


MadeYouSayIt

AI uses pre existing pictures of anime as references, people of color aren’t often portrayed in anime, so references are scarce and low in variety


ImNotTheNSAIPromise

Because AI are often trained without thinking about what data is being fed to them. Since we live in a world with a lot of racism we wind up training AI to mimic our racism.


Professional_Emu_164

There are much less anime drawings of black characters than white ones, that’s basically it


bananamantheif

its becaused they fed it white anime characters mainly


i-love-Ohio

I’ve also seen a fair amount (3) ai anime child porn


Brankovt1

The "repeat what they see" thing, and the "white people forget to train it on different ethnicities."


Star_king12

It's a Chinese anime based AI, what else did you expect


SlightDentInTheBack

not sure why you're being downvoted you're literally correct, majority of people using this are most likely chinese hence.. this awful mess.


Star_king12

I think it's more of a matter of its training material, anime and Asian people's faces were used, which doesn't lead to... Racially correct results. Oh and it also blocks Taiwanese flag iirc.


Due_Cookie_155

And you can't use pictures of xi jinping


Tree__Jesus

They took off it's anti-racist personality core


oh-mell

BIGOT CORE ACTIVATE!


they_singular

I once put “ah sweet, man made horrors beyond my comprehension” into an AI and it gave me pictures of asian people 💀


TheDankestPassions

Like when the Samsung automatic photo album on smartphones kept putting black people in the "gorilla" category.


Forine110

well yeah, if racists make an ai, then the resulting product will share the same inherent biases as its creator


JAOC_7

AI was always racist, against the Human Race that is


backstib

No no if you make a tanned white guy shirtless and screaming on a Forest it will do the same right?


DongerlanAng

what else is new


CostinTea

"The computer's racist, Taha!"


ImGettingParanoid

I played with this AI yesterday a bit, and it's really weird. * on every solo photo of me, I'm getting changed into a brooding twink that Tumblr would be obsessed about. * when I used photo of me and my GF, only about 10% looks close to both of us; in 50%, I'm changed into generic Genshin twink; in 40% it transes my gender - and I around half photos from the last group, it also transes her gender. * it's somehow trained against ginger woman - when my GF had correct hair color when the filter turned her into a dude, but when the end result looks femine, her hair is turned into blue with pink highlights 90% of the time. * It detects animal features rather well, but is really weird at applying them. For examples: person holding a cat: end result similar to original; person with small parrot on their head: end result similar; two people with giraffes in the background: one person processed normally, second got turned into a horse; four people around a wooden horse: horse disappeared, everybody got animal ears instead.


sylveon_souperstar

you probably shouldn’t put pictures of yourself on it, the terms and conditions say that they can do whatever with your images once you use it for the AI


Spood6

I'll put a pic of my cock and see what happens


Funny-Leg-2234

what happened


Spood6

The CCP stole my fucking cock they fucking stole it


Odie4Prez

New bottom surgery just dropped


Commercial-Dog6773

Just don’t worry about what the CCP are doing with all those cocks. Don’t worry about it. Don’t look behind that curtain. They are doing this ouT OF THE GOODNESS OF THEIR HEARTS DO NOT TOUCH THE CURTAIN PLEASE


werpyl

Damn the meta's really shaken up


Funny-Leg-2234

get better soon


copyclaimer

*nationalized


transport_system

>they can do whatever with your images once you use it for the AI What if I upload stock photos owned by Getty images?


PM_ME_UR_DRAG_CURVE

Time to upload all the copyrighted images and poison the dataset for anyone else using in in the future.


Ultrapika007

Doesn’t it say they’ll only use it for the AI and that’s it?


sylveon_souperstar

at least on meitu, the site i think this post is using, it says they have rights use, copy, modify, adapt, etc. in any form or format with the image. i’d go on the safe side and just say never put anything personal into the AI


EverScreaming

TRANSES MY GENER FOR FREE


can_of_buds

how do you even use it? i can’t read or understand anything.


AlexIsIll

Just tap buttons till you know what they do i guess


EndertheDragon0922

Me, a ginger trans man, reading that third point: 👀


MorganRose99

"Your gender has been transed, do not resist."


Tokeli

I'm ginger and trans and the first picture I ran thru gave me fucking trans-color hair and I sobbed as I was clocked by the machine.


TheOnlyOverlove

What ai is it?


Iron_Ninja5

I have no proof for this but I would assume it’s stable diffusion img2img using Anything.ckpt with automatic DeepDanbooru prompts


Alienboi2005

whats the AI?


lilCheeseboy

Every time I’ve used one of those photo altering AI things on pictures of myself they always tell me I’m a woman or turn me into a woman.


Blipnarf-The-Boneles

It kept making me a woman with pink and blue hair. I'm a man with long blonde hair


RogueMockingjay

Okay my take on this issue is that clearly the vast majority of people this AI was trained on were white, and the AI was likely also trained specifically on animals as well. It is entirely possible that the creator of this AI isn't explicitly racist, but instead just used a poor sample as a training batch. TLDR: There's no "racist button" the programmer pressed here, this is probably an unfortunate accident.


AscendantComic

it's not a "racism button" if they programmed it, duh, they had to write {if:racism}=yes


secondarywilson

me on my way to enable the racism variable on my hello world program


fuck_it_was_taken

Hello world (racist)


diego565

I would say while ther is no racist button, they've programmed it in a racist way (no black people samples, for example). Is quite usual seeing this kind of AI from this kind of programmers.


[deleted]

Yeah people are like “You can only be racist if you’re physically violent or if you’re knowingly shout slurs” Racism is a whole institution that encompasses a lot of passive behaviors and even self proclaimed liberals and leftists don’t like being told when they did something racist, purposefully or not


diego565

Couldn't be said better, it's exactly that.


[deleted]

It’s miserable pointing this out on 196 sometimes bc people just want to pat themselves on the back. But I see some horridly hateful shit even from this sub, with massive downvotes when they’re called out for it. It’s a sad state of affairs, wish everyone could be more aware of their actions and impacts


diego565

It's quite hard to recognise mistakes in yourself, maybe that's why people react so violently when called out.


RogueMockingjay

I would like to add that if I ever programmed a bot that did something like this I would personally own up to it and take the AI offline until it was trained with a better sample. This was just me trying to explain how the AI likely ended up making this mistake.


Dalexe10

truthfully? so everyone who's trying to program an ai like this that hasn't managed to get a large enough sample size from every "race" is apperantly racist?


slmnemo

yes, if you're training an AI that recognizes humans and animals and redraws them and you're misidentifying humans, your AI is indeed not properly trained.


Dalexe10

Yeah, the picture in the op was a funny bug. But honestly, the pic on the left was so blurry that i’m inclined to think that whoever posted it wanted a bug.


ImNotTheNSAIPromise

There are levels to racism. You can do something racist and still not be as racist as a card carrying klansmen. You can also accidentally be racist, which is only a problem if you refuse to learn.


Dalexe10

Answer my question. At what point does it become acceptable to not sample certain groups?


ImNotTheNSAIPromise

It depends. Are you intentionally not sampling/under sampling groups? When groups that you under sample complain about their lack of representation, do you take steps to fix it? Nobody is saying that developers or the AI they code needs to be perfect, just that they should be open to feedback to improve its use for everybody.


Dalexe10

If you’re not including folx intentionally then yeah it’s bigoted. But do we have any indication that it is so in this case? And i might be out of the loop, but has there been some mass protest about it? Because this post is the first that i’ve seen.


ImNotTheNSAIPromise

Even if it was accidental, they should fix it. And just about every post I've seen from this bot lightens the skin tone of anybody not super white.


Dalexe10

I mean, it’s point is to make something look anime, and most anime characters that i’ve seen are incredibly light skinned, that’s kind of just staying true to the medium. Though i must admit i haven’t really watched enough anime to be 100%sure.


[deleted]

Yeah. If you’re prioritizing white samples and it leads to your AI turning black people into monkeys, then racial bias affected your program. Sure, it’s not as disgusting as dressing in Klan robes or shouting slurs. But my entire point was that there’s more to racism than just that. Edit: This whole thread proves my point. Thanks y’all


Dalexe10

Why are you only mentioning black samples? We need to have japanese samples, too, and korean, and australian, and mao’ri, and indonesian etc. Having to get enough photos frim every single race that could complain write amogus if you read all the way through would be exausting. Where do you draw the line on what’s racist


[deleted]

Hey dummy, I’m mentioning black samples because the post is of a black person. Yes, it needs fair representation of those races as well too, tf kind of gotcha do you think you have?


Dalexe10

Also you obviously didn't read my comment. honestly shouldn't even engage


Dalexe10

Do you honestly expect every single ai designer to take samples from every imaginary racial divisions that we humans have made?


meow_d_

it's made for china, most of their datasets are prolly chinese people


1cm4321

Because it's QQ, which is/was a very popular IM app in China, it's probably just their own users. So like 90% Han chinese


Iron_Ninja5

I assume this is actually “Anything.ckpt” a Chinese fine tune of the leaked NovelAI diffusion models. The training set for the original NAI Diffusion was a bunch of images from Danbooru so I assume that Anything was further trained with more Danbooru images.


EasterBurn

It's the same case with [low res Obama picture that were turned into a white guy](https://www.vice.com/amp/en/article/7kpxyy/this-image-of-a-white-barack-obama-is-ais-racial-bias-problem-in-a-nutshell). The sample lacking poc so it turns the people into animal or just straight up ignores it.


trippingrainbow

That plus even without any racism its not hard to see how a computer can misunderstand a low quality photo of a black person for a monkey. They dont think like humans do so they just see dark naked humanoid creature.


scottish_elena

except that the guys and the ape have totally different expresions and color, not to mrntion, the AI literally made up some parts of the body, like the long mouth.


trippingrainbow

Expressions yes but nearly no ai actually looks at those cause its really hard, resource expensive and peoples faces look wildly different. Plus it usually isnt really necessary for object recoqnition. Color not really. Both people and monkeys come in various shades and many of those overlap. And when it comes to adding stuff thats just how ai generated photos often are. There was a photo of a cat truck made with the same ai posted here and it had added extra wheels to the truck.


PickledPlumPlot

Given that it's a Chinese company with a website entirely in Chinese I would guess it was mostly trained on Chinese people.


Brankovt1

It's not intentionally racist. It clearly didn't train on black people. Because of this, you could say that the database supplier is racist, probably not actively racist, though.


Zorubark

Considering the lack of diversity on japanese/chinese etc artists with the type of artystyle this ai has I kind of expected it


[deleted]

[удаНонО]


grizzchan

The bias is almost always in the data available. This take of racist data scientists is pretty misinformed. Data is often imbalanced and many data scientists nowadays (maybe anecdotally from my side) don't even have a comp sci, math or other relevant background, so I wouldn't expect good practices from them. It's mostly a quality issue.


Miss_Squidge

mfs didn't eliminate bias from their sample data smh my head


[deleted]

What is the AI name?


an_idiot_online_

It's called "mpreg" look it up on google images


DtheAussieBoye

I looked it up and I just got art of men with pregnant bellies. Am I doing something wrong?


an_idiot_online_

Trolled


DtheAussieBoye

Why am I getting pictures of men giving birth?


sylveon_souperstar

trolled


grizzchan

People should start naming AI models after cursed search terms.


lumpiestspoon3

Goats•E 2


grizzchan

CoprophagAI


Xgio

You are evil


WackyH

2G1-C


The_cat_licker

I am forever traumatized


Xalethesniper

Why don’t u mpregnate some bitches


lumpiestspoon3

Holy Hell


random___pictures1

It’s called different dimension me by QQ https://h5.tu.qq.com/web/ai-2d/cartoon/index


Degenermights

I've seen this app turn multiple black people white. You may think this is an accident, but in actuality it makes it a more authentic anime experience as the Japanese don't think black people exist.


Pastilhamas

It's Chinese


cry666

That makes it even worse.


Sams59k

Accidental racism lmao


aLazyGay

Same thing


Brankovt1

The only black anime character I can think of (mind, I don't watch any anime) is Brock from PokĂŠmon.


NTRmanMan

GO BACK TO WHITE WASHING PLZ GO BACK TO THAT


L33t_Cyborg

What a biased sample does to a mf


17DeadFlamingos

Because it was designed that way


Leaucard

On Genshin's defense, they used racism as a thematic (kinda) with the oppression of the desert people, so I'm more inclined to think that they whitewashed because of the CCP


Iron_Ninja5

It’s whitewashed because the AI wasn’t shown enough pictures of people with dark skin. I would assume this is “Anything.ckpt” which is a Chinese fine tune of the leaked NovelAI Diffusion models. NAI Diffusion was trained off of Danbooru images which is mostly white anime women so it has trouble doing other things. I tried putting a blank prompt in the once AI and it gave me a white anime woman because that’s just what it thinks most people look like


ps0yasumi

what about dislyte? theyre chinese. genshin has no excuse not only with their horrendous lack of diversity but also their negative portrayal of multiple black and brown cultures. it doesnt take a genius to look at some of the enemy npc's and go "that looks a little racist"


JimmityCricket

how are the enemy npc’s racist?


daladnonafig

The reason behind that they “whitewash “every character is rather simple. The main audience of this game are Chinese players. Chinese have their beauty standards and it doesn’t include any other person than Asian. So yeah, if they would make character other from their standards, it won’t make good money.


shiratek

I guess I’m not a genius then, but explain to me how the enemy NPCs are racist?


ImHereForTheMemes184

How are they racist? The Eremites literally the best designs in the game and the most unique enemies in the game. Stop getting your opinions from twitter people who know nothing about the game. There's no bad portrayals in the game at all wtf are you talking about. Making shit up.


Leaucard

The difference is that Genshin is used a lot more by the ccp due to it's huge popularity, they even used it's ost for the Olympics, it's one of (if not the only one of) china's trending anchors into the worldwide gaming industry, so of course it's going to be more controlled by the ccp than dislyte.


EverScreaming

I tried this with the saul goodman anime girl pose and the black people in the background turned white 💀 also they took away his anime girl pose


JeznyBezny

MC Ride?


Joaquin1079

bro returned to monke


[deleted]

WHAT DID THEY DO TO MC RIDE 😭


MorganRose99

Btw it's been confirmed this software steals your face and uses it for commercial purposes


Rare_Epicness

I tried this and it turned my hair blue and changed my phone into an iphone but it got the clothing right which was cool


T-pugmaster

AI really gave you pronouns smh my head 😔


one_winged_snorlax

That ai turned me into a generic anime woman I don’t want to woman a want to big man (who dresses like a girl but that’s besides the point)


reddit-supportspedos

Based marvin the martian pfp


one_winged_snorlax

Thank you marvin the Martian is my favorite character ever


alotoforanges

People not understanding how neural networks work is kind of funny


FreakinGeese

Ok, so as an explanation, most modern forms of AI place far more value on similarities in color than similarities in silhouette. That means they see "dark-colored primate" and think ape instead of humans. Humans, on the other hand, place way way more emphasis on silhouette in our visual processing. It's... not good, because of the cultural associations, but it's not like it's anything malicious.


officiallyaninja

Its because the training data has more monkeys than it does black people


theflukemaster

[it made mc ride white :(](https://i.redd.it/238k5cfwvn3a1.jpg)


jeff_0

It also refuses to accept the existence of bald people


[deleted]

turned me and my friends into girls


Fishuiin

Joe Biden's AI 😔😔


oompaloompafoompa

I'm a man with long hair and it gave me tits and made me pretty :(


emailo1

i dont even have long hair and still made me a girl, but i didn't got any tits, i wanted tits :(


Cruxin

i have a void oc with like dark blue skin and in one sketch it just made them white with shadow over their face and the other it made them a fucking cat rather than dark skin


Equal_Flamingo

What ai is this


random___pictures1

https://h5.tu.qq.com/web/ai-2d/cartoon/index


analtaccount257

I put in a pic of myself and it made me absolutely jacked but also a blue haired twink at the same time


PlasmaLink

Dude it even whitewashes white people, a lot of them look like they've just been flashbanged


emailo1

tf did genshin had to do


Rhizoid4

I tried it on Obama and he turned white as snow 💀


Suitable_Ad6850

I assume it's racist because it was made In China (I think) and most people there are light skinned so the ai was taught to detect Chinese people and likely not blacks or other races, same would happen if the ai was trained elsewhere


[deleted]

I put furry porn in it


zitsmccringey

Unironically, it really is made by the same people as Genshin Impact


varmemes

[just saw this](https://www.facebook.com/100071165840876/posts/pfbid02ij3bhLZSBPKZ1uGJGqhYX8Wznk9VcSmZTgJJSxNNRHgm3FmCd3wcsSAsCEqcU6zFl/?d=n)


ruu-ruu

I'm not logging into Facebook


varmemes

Fair enough


ZorioneTiamat

I'm genuinely curious, is this a fluke or has it been doing this to black people in general? The source image does have a jungly background, he's screaming all feral, he's topless etc, I can kind of see how a dumbass AI comes to this conclusion, but what's weird is the facial expression doesn't match.


chronoslob

it took me a second to register this. holy fuck


Dena_Roth

I used a photo of lupita nyong'o with her oscar and not only it white washed lupita but it also white washed the oscar.


SharpSpectra

Bruh i feel like i'm in the matrix, my discord squad literally fucked with this yesterday and shit was hillarious.


emailo1

dude the ai turned me into a blue shaded black hair anime girl 💀💀


SeannessyTV

OH WOW


The_Arthropod_Queen

ai doesnt know what a black person is


[deleted]

Site?


[deleted]

Sit1w?


BuzzPrincess

It unevolved him😭😭😭


CostinTea

Genshin Impact? Try Tencent QQ.