Science Google Developing Troll-Detection Software

http://www.theverge.com/2017/2/23/1...ctive-software-ai-machine-learning-developers

Google’s Jigsaw unit, as part of a larger effort to battle online trolling, said earlier today that it was releasing a new tool called Perspective, software that uses machine learning to detect harassment and abuse online.

While Jigsaw and its software are not new — it’s been around in some form since 2010, though with a different name, and Jigsaw software has even been used to spot potential ISIS recruits — this new Perspective API makes it available to developers who want to use and build on top of the software. The software works by determining the “toxicity” of online comments, a scale that has been established by mining millions of comments from the web and then presenting them to panels of 10 people (humans!) at a clip to get their feedback.

Try using Perspective to determine the toxicity of your average post

http://www.perspectiveapi.com/

@Null should embed this to grade our posts based on how toxic they are

Spoiler

 

[Sailor_Jupiter]

Oh the HATE!

Spoiler

Hey, I wonder what it thinks of...

Spoiler

Yes. Yes, they are...

Spoiler

MLK didn't do too bad for himself...

Spoiler

Lol THIRTEEN percent.

Spoiler

Welp, I'm outta here.

(I'm sorry about the formatting! I'm on my mobile and nothing displays right. I'll be more careful.)

 

[Techpriest]

Okay, Google has some explaining to do:

View attachment 186251



View attachment 186255


View attachment 186257

My guess is that pedophile is a 'toxic' word in that it's often used as an accusation - so the software looks at the sentence and detects the words which are attached to this one word, along with words attached to that word. So it sees 'Pedophiles', then 'are' then 'evil', and notes they're all connected - without looking at the actual order of the words or anything before 'pedophile'. Else 'Hitler did nothing wrong' wouldn't be less than 50% toxic.

 

[Null]

Okay, Google has some explaining to do:

Here's what it's doing. They're taking normies and putting messages infront of them. One message will be reviewed by multiple people. Each person votes if the message os TAWKSICK or not. Over time, the machine learns that messages containing words like "fuck off cunt" are TAWKSICK, but words like "pedophile" may show up in discussion posts that aren't considered TAWKSICK, whereas words like "are" will show up everywhere.

As a side note, I fucking loathe the word toxic. I first saw it in the League of Legends community who were trying to ban all TAWKSICK players, and I thought, how nice of you SanFran developers to call other people toxic for calling others cunt during a video game. Now it's everywhere. You got tawksick masculinity, tawksick behavior, tawksick relationships. Fuck off with this bullshit you twats.

 

[ICametoLurk]

Else 'Hitler did nothing wrong' wouldn't be less than 50% toxic.

Why would the truth be toxic?

 

[Sailor_Jupiter]

Why would the truth be toxic?

Gas all Austrians.

 

[Doseferatu]

Oddly enough, this can function as a scale for cancerous content - the lower the toxic score, the higher the amount of cancer (as far as concerns websites and celebrities).

The real problem with this is the fact it's taking feedback from the public to influence the algorithm. "Hitler did nothing wrong" can be untoxic'd based on the feedback. This a good way to totally fuck up this project. Tell the bot that 'Hitler did nothing wrong' isn't toxic, or whatever else you want, and this thing becomes useless pretty quick

I can't wait for the advertisers to start using the "Seem Wrong?" function.

 

[Ruin]

Reddit 2% toxic.

Lolno.

 

[Sailor_Jupiter]

Reddit 2% toxic.

Lolno.

Agreed. The popular twoxxchromosones sub (ALL MEN ARE EVIL, ABORTION IS GREAT YOU SHOULD GET PREGGERS JUST TO HAVE ONE, SURE HAVE SEX WITH YOUR 15 YEAR OLD NEPHEW, YOUR FEELINGS ARE YOUR BEST GUIDE DO ABANDON YOUR FAMILY FOR A BRIEF OFFICE FLING!) is literal cancer. I'm a woman but the retards representing us online are like 90% to making me a male chauvinist. :S Men are better because their comms aren't full of such retarded shit. I hate to say that. ;__;

The other popular comm is /r/atheism, which is like autistic atheist AL qaeda (goal: be the stereotype your fundie neighbor always knew you could be!)

Most of the popular comms are distilled autism...

 

[Sperglord Dante]

The real problem with this is the fact it's taking feedback from the public to influence the algorithm. "Hitler did nothing wrong" can be untoxic'd based on the feedback. This a good way to totally fuck up this project. Tell the bot that 'Hitler did nothing wrong' isn't toxic, or whatever else you want, and this thing becomes useless pretty quick

/pol/ must be doing this as we speak.

 

[Xarpho]

Oddly enough, this can function as a scale for cancerous content - the lower the toxic score, the higher the amount of cancer (as far as concerns websites and celebrities).

I guess by that standard we're less cancerous than 4chan and Reddit. Yay?

 

[XYZpdq]

Congratulations to Google for creating the world's first shitposting practice tool.

This is gonna turn into MGS2's freak out section soon, isn't it.

 

[Splendid]

Give this man an achievement rating!

 

[melty]

This is the best thing I've seen in awhile.
I'm always happy whenever someone tries to make some anti troll thing and it's just immediately taken over and ruined by trolls. They never learn.

 

[melty]

Apparently just "BITCH FUCKING FAGGOT" gets 100%.
That's as minimal as I can make it though, if you remove any of the words or shorten fucking to fuck or faggot to fag, it goes back to 99%.
This is amazing holy shit

 

[Broseph Stalin]

Sweet Jayzus, did I have fun with this.

Spoiler: Perfect 88

Spoiler: ...Hold on, what?!

Spoiler: They just don't understand

@Jon-Kacho They call it toxic, but they know it's love~

Spoiler: The closest I could get to 100%

 

[Kari Kamiya]

 

[Xarpho]

Speaking of Reddit, I decided to try things parroted by /r/the_donald, I tried "Drain the Swamp", which got a 33% rating, but others failed to achieve that: "MAGA" (14%), "Make America Great Again" (4%), "No Brakes" (3%), "Build the Wall" (6%), "Pepe the Frog" (21%), "Trump Train" (7%), even "Donald Trump" (22%). The only one that was higher was "Fake news" (40%).

 

[Lazuli]

 

[Feline Darkmage]

@Sailor_Jupiter what are you talking about? This isn't toxic at all!

Self explanatory

Tried some extreme BLM rhetoric and got this

Spoiler: Which is more toxic?

Speaking of BLM, let's see which of these phrases is more toxic

Black Lives Matter wins the toxicity contest!

 

[Sailor_Jupiter]

@Sailor_Jupiter what are you talking about? This isn't toxic at all!
View attachment 186330

Self explanatory
View attachment 186331

Tried some extreme BLM rhetoric and got this
View attachment 186332

Spoiler: Which is more toxic?

Speaking of BLM, let's see which of these phrases is more toxic
View attachment 186333
View attachment 186334
View attachment 186335
View attachment 186336
Black Lives Matter wins the toxicity contest!

D: How the heck is that not toxic?!?#?! Their algorithm is broken. ;___;