A New Tool Lets Artists Add Invisible Changes To The Pixels In Their Art Before They Upload It Online

A new tool lets artists add invisible changes to the pixels in their art before they upload it online so that if it’s scraped into an AI training set, it can cause the resulting model to break in chaotic and unpredictable ways.

The tool, called Nightshade, is intended as a way to fight back against AI companies that use artists’ work to train their models without the creator’s permission. Using it to “poison” this training data could damage future iterations of image-generating AI models, such as DALL-E, Midjourney, and Stable Diffusion, by rendering some of their outputs useless—dogs become cats, cars become cows, and so forth. MIT Technology Review got an exclusive preview of the research, which has been submitted for peer review at computer security conference Usenix.

AI companies such as OpenAI, Meta, Google, and Stability AI are facing a slew of lawsuits from artists who claim that their copyrighted material and personal information was scraped without consent or compensation. Ben Zhao, a professor at the University of Chicago, who led the team that created Nightshade, says the hope is that it will help tip the power balance back from AI companies towards artists, by creating a powerful deterrent against disrespecting artists’ copyright and intellectual property. Meta, Google, Stability AI, and OpenAI did not respond to MIT Technology Review’s request for comment on how they might respond.

Zhao’s team also developed Glaze, a tool that allows artists to “mask” their own personal style to prevent it from being scraped by AI companies. It works in a similar way to Nightshade: by changing the pixels of images in subtle ways that are invisible to the human eye but manipulate machine-learning models to interpret the image as something different from what it actually shows.

Continue reading article here

More Posts from Octiainyourpocket and Others

octiainyourpocket

4 years ago

my one skill is expertly manipulating the shape of the eggs I’m cooking so that they fit perfectly onto my toast every time

219K notes View Post

octiainyourpocket

4 years ago

on self love + care:

1. "I treat myself like I would my daughter. I brush her hair, wash her laundry, tuck her in goodnight. Most importantly, I feed her. I do not punish her. I do not berate her, leave tears staining her face. I do not leave her alone. I know she deserves more. I know I deserve more." (i know i deserve more, michelle k)

2. “Don’t forget to love her. The little girl you used to be. Perhaps She lies within you. Untucked. Sleeping peacefully.” (nurture, kiana llanos)

3. "These days I wake up crying

holding myself in my arms

rocking myself like a mother

repeating

it's all right- i'm here." (rocking, nuela archer)

4. "There’s a little girl in my head & she screams 'unloved! unloved! unloved!' every moment of my life (@star-eaters)

"There’s a woman in my head now & she holds the little girl and says “I will take care of you and we will be alright” when the little girl screams and together they are learning how to trust each other" (@antidecay)

33K notes View Post

octiainyourpocket

1 year ago

I got, in a row: Anxious transfemme Arsonist gay steampunk princess I mean

from now on your tumblr nickname is whatever you get from this sexual identity generator ☆

the bots are bisexual i repeat the bots are bisexual

48K notes View Post

octiainyourpocket

5 years ago

In fact, you became the very thing you sought to destroy.

19K notes View Post

octiainyourpocket

2 years ago

not to minimize the gravity of war, but i need more people to know about:

Bicycle Warfare

bicycles have several advantages over horses & fuel-powered vehicles, with the result that bicycle infantry has in fact played a significant role in 20th century warfare...

it turns out that warfare sometimes involves battalions of bicycle-riding soldiers. (and while i personally am sick of war films, I'm willing to make an exception here because there really needs to be a movie about this.)

7K notes View Post

octiainyourpocket

4 years ago

i am a:

⚪️ man

⚪️ woman

🔘 person with adhd

and i am seeking:

⚪️ men

⚪️ women

🔘 meals that can be prepared in under 5 minutes

75K notes View Post

octiainyourpocket

1 year ago

How did you give yourself an EAR INFECTION eating pussy

im just gonna screenshot from a text i sent my friends after the doctors visit

86K notes View Post

octiainyourpocket

4 years ago

Scripts for Talking to Doctors

We aggressively believe that patients shouldn’t have to do a bunch of emotional labor to get their needs met by their healthcare providers, but the reality we live in means this is an important skill to have as a spoonie.

Luckily, we have some new resources for you!

💊 This super long thread on code words to use with doctors [CW exaggerated ableism/use of slurs], kicked off by the Cliff’s Notes on “How To Negotiate Your Disability Without Curling Into A Ball And Weeping More Than Once Or Twice A Week *Or* Murdering The Entire Universe (More Than Once Or Twice A Week).”

Covered topics:

Getting pain meds without being labeled as a drug-seeker.

Getting mobility devices despite enormous stigma.

Getting a “medibuddy” or advocate in with you when your doctor likes enforced isolation tactics.

Taking notes and being organized without ruffling any feathers.

Introducing “googled” information with a little fibbing.

Tactical crying.

…and basically being manipulative as hell, because sometimes that’s really, frustratingly necessary in order to get past ableist gatekeeping.

💊 This response to a request for help talking to a surgeon and getting him “to take me and my mysterious health issues seriously while still coming off as a ‘good patient.’”

💊 Our archive of advice under the “Dealing with Doctors” tag (yeah, we’re mad this has to exist, too.) And to those about to enter appointments… we salute you.

12K notes View Post