Skip to main content
GamesRadar+ GamesRadar+ GamesRadar+ The Games, Movies, TV & Comics You Love
Sign in
  • View Profile
  • Sign out
flag of UK
UK
flag of US
US
flag of Canada
Canada
flag of Australia
Australia
  • Games
  • TV
  • Movies
  • Hardware
  • Video
  • News
  • Reviews
  • Guides
  • Deals
  • More
    • PS5
    • Xbox Series X
    • Nintendo Switch
    • Nintendo Switch 2
    • PC
    • Platforms
    • Tabletop Gaming
    • Comics
    • Toys & Collectibles
    • SFX
    • Newsarama
    • Retro Gamer
    • Newsletters
    • About us
    • Features
Total Film
Gaming Magazines
Gaming Magazines
Why subscribe?
  • Subscribe from just £3
  • Takes you closer to the games, movies and TV you love
  • Try a single issue or save on a subscription
  • Issues delivered straight to your door or device
From$12
View
Trending
  • Prime Day Deals
  • Superman
  • Donkey Kong Bananza
  • Switch 2 stock
Recommended reading
No Man's Sky
Survival Games No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
Games "They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Xbox Gamescom 2023 logo featuring a stylized city skyline in green
Xbox "What happened with Microsoft was clear": Former Square Enix exec says Game Pass, "a service with barely any growth," didn't cause layoffs – competition with AI did
Xbox - Future Owns
Games Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
Hardware "Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Halo Infinite
Games Xbox executive producer offers "best advice I can" to those caught up in Microsoft's latest lay-off spree – AI prompts to "help reduce the emotional and cognitive load that comes with job loss"
  1. Games

Microsoft's CaptionBot doesn't understand video games

Features
By Andy Hartup published 14 April 2016

When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.

Caption Contraption

Caption Contraption

This is Microsoft CaptionBot. It's a prototype tool (which ANYONE can visit, so go and give it a try) for labelling images. Apparently, CaptionBot can recognise any image and describe it "as well as any human". It's a truly astonishing piece of tech, and represents 1000s of hours of work by some of the smartest, most dedicated people on the planet. Naturally, then, the GamesRadar+ team immediately tried to use it for mischief...

As a team, we fed it a bunch of video game images to see what CaptionBot made of them. The results are shown over the next few pages, and they're all hilarious. We kinda feel bad laughing at such a smart, innovative piece of technology, but we can't help it. And the more we posted, the more under-confident CaptionBot seemed, making us feel rather like the playground bully, flushing the nerdy kid's head down the toilet and... oh my god, we're monsters. Ho hum. Take a look at what CaptionBot things about video games...

Page 1 of 14
Page 1 of 14
Crash Bandicoot

Crash Bandicoot

CaptionBot says: "I'm not really confident, but I think it's an orange vase"

We say: "See what you're trying to do there, CB, but no"

Page 2 of 14
Page 2 of 14
Destiny (Oryx)

Destiny (Oryx)

CaptionBot says: "I'm not really confident, but I think it's a glass display case"

We say: "Go home, CaptionBot, you're drunk"

Page 3 of 14
Page 3 of 14
Assassin's Creed

Assassin's Creed

CaptionBot says: "I'm not really confident, but I think it's a person wearing a hat"

We say: "Sure, close enough mate"

Page 4 of 14
Page 4 of 14
Dark Souls 3

Dark Souls 3

CaptionBot says: "I'm not really confident, but I think it's a close-up of an umbrella"

We say: "That's... not even close"

Page 5 of 14
Page 5 of 14
Far Cry Primal

Far Cry Primal

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a cow and he seems :-|"

We say: "That's actually pretty good, CB. Loving the fact you recognised how sad he looks"

Page 6 of 14
Page 6 of 14
Mario and Luigi

Mario and Luigi

CaptionBot says: "I'm not really confident, but I think it's a woman getting ready to hit the ball"

We say: "Sure, Luigi has a feminine figure, but not sure what you're talking about when you say 'the ball'. Are you feeling ok?"

Page 7 of 14
Page 7 of 14
Silent Hill 2

Silent Hill 2

CaptionBot says: "I can't really describe the picture"

We say: "Yeah, fair play, it's pretty troubling. Hey, why are you curled up in a ball and rocking back and forth?"

Page 8 of 14
Page 8 of 14
Pokemon (Pikachu)

Pokemon (Pikachu)

CaptionBot says: "I'm not really confident, but I think that's a close up of two giraffes near a tree"

We say: "It... it is not"

Page 9 of 14
Page 9 of 14
Ratchet & Clank

Ratchet & Clank

CaptionBot says: "I'm not really confident, but I think it's a birthday cake"

We say: "If this was a birthday cake... it'd be incredible. Best birthday ever!"

Page 10 of 14
Page 10 of 14
Animal Crossing (Mr Resetti)

Animal Crossing (Mr Resetti)

CaptionBot says: "I'm not really confident, but I think it's a close-up of a toothbrush"

We say: "That would be the most terrifying toothbrush ever. And everyone in the world would probably agree that tooth decay is better than putting this near your mouth"

Page 11 of 14
Page 11 of 14
Sonic The Hedgehog

Sonic The Hedgehog

CaptionBot says: "I'm not really confident, but I think it's a person on a surfboard in a skate park"

We say: "Um..."

Page 12 of 14
Page 12 of 14
Street Fighter 5

Street Fighter 5

CaptionBot says: "I'm not really confident, but I think it's a person holding a hotdog"

We say: "Wildly inaccurate, although - to be fair - there is a hotdog stand in the background"

Page 13 of 14
Page 13 of 14
Uncharted 3

Uncharted 3

CaptionBot says: "I'm not really confident, but I think it's a man standing next to a fire and he seems :-|"

We say: "Correct. Also, you would be too, if you'd just escaped a plane crash"

Page 14 of 14
Page 14 of 14
CATEGORIES
PC Gaming Wii-u Nintendo PlayStation PS4 Xbox Xbox One Platforms
Andy Hartup
Andy Hartup
Social Links Navigation
See more Games Features
Read more
No Man's Sky
No Man's Sky boss assures fans Hello Games "did not have a secret room hiding deaf kids" following the survival game's unfortunately auto-captioned Switch 2 trailer
The Witcher 4 screenshot with Ciri using sword and sorcery to fight an ancient monster
The Witcher 4 first look - State of Unreal 2025 Live Coverage
System Shock
"They pressed the AI button, it might have been a bad idea, but in truth there's no un-pressing that button," says Epic CEO, immediately after Epic shows a "conversation" with an AI that embarrasses us all
Xbox Gamescom 2023 logo featuring a stylized city skyline in green
"What happened with Microsoft was clear": Former Square Enix exec says Game Pass, "a service with barely any growth," didn't cause layoffs – competition with AI did
Xbox - Future Owns
Xbox is hiring to "secure the future of game preservation," and this time it's no AI Quake nightmare
Photo of the new Xbox handheld, the ROG Xbox Ally X
"Pick your lane and stick to it": Former Blizzard president says it's "tough to see Xbox confused" amid "this is an Xbox" branding: "They have to figure out what needs to change... and fast"
Latest in Games
Diablo 4's Nyrelle looks at a crystal in Vessel of Hatred's trailer
"I actually felt heard": Diablo 4 content creators tease exciting things to come for the ARPG after a call with Blizzard, following seasons of complaints about nerfs, endgame, and more
Donkey Kong Bananza Donkey Kong and Pauline looking frightened facing off against Grumpy Kong
Donkey Kong Bananza's director replayed every game in the series when he was assigned to the Switch 2 game: "That motivated me to incorporate past memories along with new ideas"
Subnautica 2
Subnautica 2 leak confirmed by Krafton, highlighting the cause of the survival game's delay and publisher's plans to "enhance the content volume and level of polish before launching"
DK punches through gold Banandium chunks in Donkey Kong Bananza
Donkey Kong Bananza will have some framerate drops, director admits, but he's fine with that: "We prioritized fun and playability"
a marcus bobblehead from the upcoming borderlands 4
Borderlands 4 has "well over 200" collectibles that are so well hidden, Gearbox boss Randy Pitchford expects "most players will never see any of them"
An orange car in The Crew.
Prominent European politician agrees that "a game, once sold, belongs to the customer, not the company" as Stop Killing Games faces resistance from European publishing group saying its demands aren't "proportionate"
Latest in Features
David Corenswet as Superman with Krypto the dog and a robot in the Fortress of Solitude.
James Gunn's Superman has finally found the cure to superhero movie fatigue: just make them more like comics
David Corenswet as Superman
Superman’s surprise message from Krypton twist changes everything we know about Kal-El’s origins in the DCU
Abraham's Boys: A Dracula Story
New indie horror Abraham's Boys: A Dracula Story is Frailty meets There Will Be Blood with a haunting focus on family – and I have no complaints
Superman shows off his strength on the cover of Superman Unlimited #2.
Here's how to start reading Superman comics once you've seen the new movie
David Corenswet as Superman in James Gunn's Superman
Superman ending explained: your biggest questions answered on Lex Luthor, the Justice Gang, and what it sets up for the DCU
The Sims 4 Enchanted by Nature
After 16 years of The Sims 3, The Sims 4 Enchanted by Nature might just be the whimsical expansion pack that pulls me away from EA's iconic 2009 life sim for good
  1. Zion Wright grinds along a wooden balustrade in in Tony Hawk's Pro Skater 3 + 4's San Francisco level
    1
    Tony Hawk's Pro Skater 3 + 4 review: "A nostalgic, must-play hit for fans"
  2. 2
    College Football 26 review: “Thanks to rivalries and dynasty, this is the greatest show on turf”
  3. 3
    Mecha Break review: "This mech battler makes up for lacking customization with a varied roster that lets me live out my Evangelion fantasy"
  4. 4
    Death Stranding 2: On the Beach review: "This tarpunk delivery epic is more Metal Gear Solid than ever, for better and worse"
  5. 5
    Rematch review: "As with Rocket League, the just-one-more-game pull is magnetic"
  1. David Corenswet as Superman inside the Fortress of Solitude in James Gunn's Superman.
    1
    Superman review: "A triumphant reinvention and a promising start for the DCU"
  2. 2
    Jurassic World Rebirth Review: "An unscary sequel that needed a little more time in amber"
  3. 3
    M3GAN 2.0 review: "A bold sequel with a slightly underwhelming conclusion"
  4. 4
    28 Years Later Review: "Enough terror, splatter and suspense to satisfy”
  5. 5
    Predator: Killer of Killers review: "Great characters, thrilling action, and gorgeous Arcane-esque animation"
  1. Lee Jung-jae as Gi-hun in Squid Game season 3
    1
    Squid Game season 3 review: "A staggeringly excellent final season wraps up one of the greatest Netflix shows ever"
  2. 2
    Ironheart review: "A relic of Marvel's content-at-all-costs era"
  3. 3
    Star Trek: Strange New Worlds season 3 review: "The show's most assured run of episodes to date"
  4. 4
    Doctor Who season 2, episode 8 spoiler review: 'The Reality War' is "a mix of the good, the bad, and the truly baffling"
  5. 5
    Doctor Who season 2, episode 7 spoiler review: 'Wish World' is "an exciting and ambitious" start to the season finale, with hints of WandaVision

GamesRadar+ is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site.

  • About Us
  • Contact Future's experts
  • Terms and conditions
  • Privacy policy
  • Cookies policy
  • Advertise with us
  • Review guidelines
  • Write for us
  • Accessibility Statement
  • Careers

© Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.

Please login or signup to comment

Please wait...