Our method

Six steps, run on the project’s computing infrastructure, turn each video into an analysable format. Follow each step below to see how it works in detail: the models used, the decision thresholds and the reliability indicators.

The methods paper (PDF)

  1. 01

    Detect

    The channels’ feeds are read every six hours, their full list every week. The videos of the last seven days go ahead of everything else.

    The detail
  2. 02

    Extract

    The video, its metadata and its comments are extracted. The audience is measured again at day 1, 7 and 30, then every month.

    The detail
  3. 03

    Transcribe

    The voice is isolated from the music, speakers told apart, speech transcribed in the language spoken, then cut into sentences.

    The detail
  4. 04

    Classify

    Each sentence is classified as political or not, then assigned to nine themes by nine classifiers whose reliability is published.

    The detail
  5. 05

    The people named

    The public figures, parties and media of a closed list are recognised in the sentences and counted video by video.

    The detail
  6. 06

    Summarise

    A local language model writes the record of each video of the week, checked against the transcript, then the synthesis and the arguments.

    The detail
  7. 07 · Around the steps

    The corpus

    Three countries, seven orientations, the channels chosen and coded by the team.

    The detail
  8. 08 · Around the steps

    The eleven steps

    The full diagram, from the task queue to publication, step by step.

    The detail
  9. 09 · Around the steps

    Arguments by theme

    A model reads a sample of each theme’s sentences and draws out the arguments.

    The detail
  10. 10 · Around the steps

    Vanished videos

    The removal is noticed, dated, explained when the platform says why; the record stays.

    The detail
  11. 11 · Around the steps

    Coverage and limits

    What is transcribed, what is not yet, the known limits, the corrections log.

    The detail
Project paper