A Feline Union explainer · games, data and labour

The Second Use: who gets your movement after you've made it

You push a stick to the left because a teammate needs room to get through a door. That is the first use of your movement, and you chose it. On a streamed game, the movement, its timing and its hesitation arrive on someone else's computer. What else it does there is the second use. Who chooses that one?

Microsoft's Muse, 20257 yearsof continuous human play, about 500,000 sessions, used to train an AI that generates game scenes and controller actions.
reCAPTCHA, by 2008440 millionwords transcribed by people who were only trying to log in.
GTA VI on Xbox Cloud19 Nov 2026the biggest game of the decade starts running on Microsoft's machines instead of the player's.
The question

The player knows why they moved. Who decides what else the movement does?

01 · The honest version

The screen that told you

PuTTYgen makes the keys people use to log in to servers securely. When it makes one, it shows a blank box and asks you to move your mouse around inside it.

PuTTYgen will collect enough randomness just from the fine detail of exactly how far the mouse has moved each time Windows samples its position.

PuTTY user manual, PuTTYgen

You don't need to understand cryptography to do it. You control the broad sweep of your hand. The tiny wobbles you can't control are what the program wants: they are hard to predict, and unpredictability is what a secure key is made of.

Notice what the program doesn't care about. It doesn't care whether you drew a circle, whether you drew it well, or what kind of person draws circles clockwise. It takes the movement and puts it to a use that has nothing to do with what the gesture meant to you.

And it tells you so, on the screen, before you start. That is the honest version of the second use.

02 · reCAPTCHA, 2007–

The screen that didn't

For years, logging in to a website meant typing two warped words to prove you were human. One of the words checked you. The other came from a scanned book that a computer couldn't read. You were reading it for the computer.

440 millionWords transcribed by 2008, across more than 40,000 websites, at better than 99 percent accuracy. Luis von Ahn and his colleagues reported it in Science.

Google bought reCAPTCHA in 2009. Later the words became house numbers from Street View, then pictures of traffic lights, crosswalks and buses. Google's own description of the product put it plainly:

Channeling the time spent solving CAPTCHAs into digitizing text, annotating images, and building machine learning datasets.

Google, reCAPTCHA product page, 2018

The person on the login screen had one purpose: get in. The second purpose was real and valuable, and it was not on the screen. In 2015 a user sued, saying Google "extracts free labor from users" without telling them it profits from the transcriptions. The court dismissed the case in 2016.

So the law had looked at the question once and let it go. The question didn't go away. It moved to where people spend far more time than on a login page.

03 · One second of play

One movement, four records

Picture a cooperative mission. One player holds a door. A second approaches, stops, and steps aside. A third gets through. Two teams can finish the same mission in the same time by very different decisions.

What can be recordedWhat it tellsWhat it can't tell
The game stateThe door was open, the teammate was coming, the corridor was narrow.Which of those the player noticed.
The input traceThe stick went left, came back toward centre, then went left again.Why the player changed their mind.
Timing and networkWhen each command arrived, and how steady the connection was.The moment the player decided. A server's clock includes the trip.
The accountWhich account played, and for how long.Who was holding the controller on a shared couch.

The records mean more together than apart. A hesitation on screen could be good teamwork, a late packet, or a player looking at their phone. The network record separates some of those. The game state turns a tiny correction into a decision. None of it holds the player's private reason.

A cloud game has to handle all of this just to work: your controller sends inputs to a server, the server runs the game and streams back the picture. Microsoft Research published a system called Outatime in 2015 that went further. It guessed your next inputs and drew the frames for them before you pressed anything, to hide up to 120 milliseconds of lag.

Xbox lists what it collects in Microsoft's privacy statement: which games you play, your progress, your achievements, "play time per game, and other play statistics", and performance data about consoles, accessories "and your network connection".

Running a game on your inputs, collecting categories of measurements, and keeping a synchronized trace for something else are three different things. The first two are public. The third is where the second use lives.

04 · The second use, in print

Seven years of other people's hands

In February 2025, Microsoft researchers published a paper in Nature about a model they called Muse. It was trained on recorded matches of Bleeding Edge, an online game from Microsoft's own studio Ninja Theory.

7 yearsOf continuous play, in about 500,000 recorded sessions from 60,986 matches, played between September 2020 and October 2022. About 1.4 billion frames, with the controller actions that went with them.

The model learned to produce both halves of play: what the player would see, and what the player's hands would do next. Give it a moment of a match and it continues the match, inputs included. Xbox said it could help bring old games back to life on new hardware.

Data used for training the model were covered by an end-user license agreement to which players agreed when logging in to play the game for the first time.

Kanervisto et al., Nature, 19 February 2025

The researchers removed Xbox user IDs. They did not need to know who the players were. They needed what the players' hands did, in the moment, against the state of the game. That is exactly the record from the door.

Medal's founder explained why gamers' clips are worth so much. People upload their best and worst moments, the ones with real decisions in them. "You get this selection bias towards precisely the kind of data you actually want to use for training," he said.

05 · Three roles in one second

Subject, supplier, contributor

"The platform learns how you play" sounds like the whole story. It misses most of it. In one second of play, a player can be three different things.

Two very different things can be valuable in the same trace. One is unpredictability. For that, your good judgment is beside the point: an expert and a beginner both make irregular movements. And a server measuring that irregularity also picks up the network's jitter, so not every millisecond of it is human.

The other is judgment. Here the value is the pattern: thousands of moments where players stepped aside, waited, or abandoned a plan that wasn't working. A correction means something because of what came just before it and what the other players did next.

Privacy law mostly protects the subject. It asks what can be known about you. The supplier and the contributor raise a different question, about consent and credit: who gets to use what you made?

06 · Play that did science

When the door means DNA

Games have already done real science, with the science out in the open.

In both, the designers gave particular moves a scientific meaning, and told the players. The players got credit, in one case on the author list.

The second use doesn't need any of that. In it, the door can simply be a door. Imagine a cancer lab that has to share scarce scanner time between several research teams. A way of resolving conflicts learned from millions of players at millions of doors could be tested against the lab's current method. If it worked, players would have contributed to cancer research without a single tumour ever appearing in the game.

The reverse matters too. If a simulation only used a random number that was partly made from player movements, the players supplied randomness. Calling them cancer researchers would be too much. Telling the two apart is how you know what the players were really owed.

07 · The scale

A hundred million minutes

Think of a streamer asking their chat for a document. One viewer recognises the reference, another finds the original, a third notices the date is wrong. The chat works because knowledge is spread unevenly, and the right question reaches the one person who already knows where to look. The chat can also push back on the question.

A player in an ordinary game can't push back on a purpose nobody told them about.

1.67 million hoursOne minute each from 100 million players. That is time, not judgment. A million nearly identical traces can repeat the same mistake, and one well-placed correction can save everyone else a week.

People argue about whether a network like that could be a step toward general AI. Three different claims get mixed together, and each needs different proof:

  1. The network can solve a specific task. Give it a problem with a checkable answer and compare it with the usual method. Borderlands Science already did this.
  2. An AI can direct work across people and tasks. Test whether it picks useful contributors, handles disagreement and catches errors on problems it hasn't seen. If it works, the answer belongs to the combined system, people included.
  3. The model learned something general. Test it on new tasks after the crowd is disconnected. Doing better with millions of people plugged in says nothing about what it can do when they leave.

The question of who decides survives every answer. A narrow, ordinary system can still get valuable work out of people who only ever see a game.

08 · Money

The economy beside the game

An economy inside a game doesn't have to be run by the company that made the game. It can run beside it, in somebody else's currency, and the game only has to let it in. That has happened three times already, at scale.

This is where play becomes work. In play-to-earn, a movement has a price. It is paid in a token someone else issues, at an exchange rate someone else sets, with no minimum wage underneath it. The player is the supplier, the contributor, and now an unpaid worker who can lose what they earned overnight.

Rockstar knows the shape of this. In November 2022 it told the people running role-play servers for GTA V that crypto and NFTs were an enforcement priority. In August 2023 Cfx.re, the company behind FiveM, the main platform for those servers, became part of Rockstar. It blocks its own casino in more than 50 countries where gambling laws forbid it.

Facilitating the use, sale, or promotion of cryptocurrencies or crypto assets (e.g. "NFTs," "tokens" or "meme coins").

FiveM Creator Platform License Agreement, banned methods, updated 10 September 2026

That ban is real, and it sits beside bans on cashing out real money, real-money gambling and selling in-game currency. It is also a licence term, written by the company that profits from the platform and can rewrite it. "The FiveM business is a profitable business for us," Take-Two's chief executive told investors on 10 November. "It does create an economic opportunity." And Counter-Strike shows a parallel economy grows wherever items can change hands, whatever the terms say.

91.1%Of Ontario online gamblers now use licensed sites, the province's regulator reported in May 2026. That count covers licensed online casinos. Loot boxes are not gambling under Canada's Criminal Code, and no Canadian court has said otherwise. A token economy running inside a game shows up in neither count.

That is where this meets thirtytwo.fyi, which followed Ontario's gambling market into the emergency department. A harm nobody counts can grow for a long time before anyone sees it.

09 · Grand Theft Auto VI

Tomorrow, on someone else's machine

On 10 November 2026 Xbox announced that Grand Theft Auto VI streams on Xbox Cloud Gaming from 1 a.m. Eastern on 19 November, on Xbox Series consoles and on the old Xbox One. The game is bought separately. Cloud playtime can now be bought without a Game Pass subscription.

Stream Grand Theft Auto VI through XBOX Cloud Gaming on the XBOX One.

Xbox Wire, 10 November 2026

Rockstar brings the audience. Microsoft runs the machines. For a household that keeps its older console, deciding to play puts the game on Microsoft's computer instead of their own, and every push of the stick arrives there first.

"develop and train our AI models"One of the uses Microsoft's privacy statement lists for personal data, under improving and developing its products. Its Xbox section lists play statistics and network performance among what it collects.

Nothing Microsoft or Rockstar has published says GTA VI's inputs are being kept, joined to the game state, or used for anything but running the game. The announcement mentions no research and no AI. What the record does show is the same company training a model on seven years of its own players' hands, under a licence they clicked once, in a game it owned.

The same pattern runs through school and family life. A child opens an assignment because a teacher asked; Teams tells the teacher whether they "opened a file, visited a channel, attended a meeting (and for how long)". A child asks for more Xbox time because a friend is still playing; Family Safety lets them ask, and lets the parent see their activity. Each time the child's own purpose makes sense on its own, and the software also turns the act into something someone else can count.

The empty frame above is the second use. It isn't on the screen, so there is nothing to picture.

10 · The question

The second use

Line up everything in this explainer and one pattern runs through it.

The first use is yours

  • Move the mouse to make a key
  • Type the word to log in
  • Step aside so a teammate gets through
  • Slide the tiles because the puzzle is fun

The second use is chosen by someone else

  • A secure key, told on the screen
  • A digitized library and a labelled dataset, not told
  • A model that plays like people, under a licence clicked once
  • A price on your movement, paid in someone else's token

PuTTYgen and Borderlands Science show the second use can be done honestly: the purpose on the screen, credit for the people who did the work. reCAPTCHA and Muse show it can also be done quietly, under a licence agreement, with nothing on the screen but the game.

This is the third part of a set. thirtytwo.fyi is about what gets sold into your senses. LifeLog is about what gets kept about you. This one is about what gets taken from you when you move: your sense of where your hand is, how hard you're gripping, when you hesitate.

If agency is how we direct our own energy, choosing the move is only half of it. The player knows why they moved. Who gets to decide what else that movement does?

Pass it on

Before you press start

Share the explainer

Most players think about what a game shows them. Fewer think about what it keeps.

Keep reading

The record

  1. Tatham S et al. PuTTY user manual, chapter 8: Using PuTTYgen
  2. von Ahn L, Maurer B, McMillen C, Abraham D, Blum M. reCAPTCHA: human-based character recognition via web security measures. Science, 2008
  3. Google. reCAPTCHA product page, archived 2 January 2018
  4. Rojas-Lozano v. Google, Inc., N.D. Cal. No. 15-cv-03751, order granting motion to dismiss, 3 February 2016
  5. Lee K et al. Outatime: using speculation to enable low-latency continuous interaction for mobile cloud gaming. MobiSys, 2015
  6. Microsoft. Privacy Statement, Xbox section and "How we use personal data"
  7. Kanervisto A et al. World and human action models towards gameplay ideation. Nature, 19 February 2025
  8. Microsoft Research. Introducing Muse, 19 February 2025
  9. Kardar F. Empowering creators and players with Muse. Xbox Wire, 19 February 2025
  10. Baker B et al. Video PreTraining (VPT): learning to act by watching unlabeled online videos. OpenAI, 2022
  11. Bruce J et al. Genie: generative interactive environments. Google DeepMind, 2024
  12. Bellan R. General Intuition lands $134M seed to teach agents spatial reasoning using video game clips. TechCrunch, 16 October 2025
  13. Cancer Research UK. Play to Cure: Genes in Space, February 2014
  14. McGill University, Gearbox Software and Borderlands Science players. Improving microbial phylogeny with citizen science within a mass-market video game. Nature Biotechnology, 2024
  15. MCV. Around $5bn in Counter-Strike: GO skins gambled during 2016, January 2017
  16. ESPN. Washington State Gambling Commission orders Valve to stop skins gambling, 5 October 2016
  17. US Federal Trade Commission. CSGO Lotto owners settle FTC's first-ever complaint against individual social media influencers, 7 September 2017
  18. Thomson Reuters Foundation. Stung by losses, Filipino players ditch Axie Infinity crypto game, April 2023
  19. The Record. More than $625 million stolen in DeFi hack of Ronin Network, 29 March 2022
  20. UPI. FBI attributes the Ronin theft to the Lazarus Group, 15 April 2022
  21. TechCrunch. Class action against Roblox over Robux gambling sites, 18 August 2023
  22. Colvin v. Roblox Corp., N.D. Cal. No. 23-cv-04146, order of 26 March 2024
  23. MP1st. Rockstar issues official statement on GTA RP servers, 18 November 2022
  24. PC Gamer. Rockstar buys the makers of the GTA Online FiveM mod, 11 August 2023
  25. PC Gamer. Grand Theft Auto Online's casino update is inaccessible to more than 50 countries, July 2019
  26. Rockstar Games. FiveM Creator Platform License Agreement, updated 10 September 2026
  27. Take-Two Interactive. Q2 fiscal 2027 earnings call transcript, 10 November 2026
  28. Alcohol and Gaming Commission of Ontario. Number of Ontarians choosing regulated online gaming sites surges to 91%, May 2026
  29. Chambers and Partners. Gaming Law 2025: Canada
  30. Xbox Wire. Grand Theft Auto VI comes to Xbox One and Xbox Series X|S through Xbox Cloud Gaming on November 19, 10 November 2026
  31. Microsoft Support. Digital activity data in Insights, Teams for Education
  32. Microsoft Support. Roles, permissions and data sharing in Family Safety

The paintings on this page are illustrations. They carry no evidence; every figure rests on the sources above.

Share

Share this card