News Quality Evaluation

  • March 3rd, 2018
  • Client: Monday Note SAS, (Frederic Filloux, Paris, France), Upwork
  • Job: For a research project about news quality, misinformation, fake news, etc, we are looking for a group of freelancers interested in news media. Our project is named Deepnews.ai (formerly News Quality Scoring) is currently under development between Stanford University and Paris. Its goal is to surface good journalism from the web by using machine learning algorithm. To that end, we need to label “good” or “bad” (well, we are more subtle) thousands of stories. This human scoring is an essential part of the process. The resulting data set will be used as a  “validation set” to train the algorithm. The job consists in assessing a series of articles, about 250 per tester. The principle is pretty straightforward: You access a Dropbox folder, copy the directory on your PC, read and rate story (1 for “good”, 0 for “bad”). We expect testers to spend between 1 and 3 minutes per evaluation. We are looking for people genuinely interested in news and journalism and able to exercise a critical judgment on a piece of editorial. This is an important work. More explanation in these G-slides https://docs.google.com/presentation/d/1eb29TFjIl3Swihp_dNLbgJof_rEPUkp9oaCBY47tCmY/edit?usp=sharing
  • Skill Requirements: Intermediate Skill Level
  • Completed: March 4th, 2018


Finished Work and/or Samples:

Final News Quality Evaluations: https://www.dropbox.com/sh/4apydlo3rqqrglp/AAA6a5eZQAxmVrSidF-Wp2cGa?dl=0

DROP BOX LINK IS FOR VIEW ONLY!

Create a website or blog at WordPress.com

Up ↑

Design a site like this with WordPress.com
Get started