Microsoft created a bot to auto-caption photos and it's going hilariously wrong

Before you go, we thought you'd like these...

Microsoft takes down Twitter bot after it becomes racist within a day

Mere weeks after Microsoft had to shut down its Tay chatbot for sending offensive tweets, the company might be in for another AI-related embarrassment.

This time, the culprit is Captionbot, an AI experiment that tries to recognize what's on a photo and come up with a text caption. Launched in late March, Captionbot actually does a pretty good job in many examples, but it's also horridly wrong in others, and social media does not forgive such transgressions.

SEE ALSO: Microsoft wants you to love its bots

In one example, Captionbot mistakes the First Lady Michelle Obama for a cellphone. In another, it thinks the famous blue/black/white/gold dress is a cat wearing a tie.

It's not just that Captionbot is sometimes wrong -- it'd be absurd to expect it to always be right in a world where even humans struggle to understand what's in a CAPTCHA image. But things get awkward when it's not only wrong, but weird. Check out some examples below.

11 PHOTOS
Bot tries to identify images, fails comically
See Gallery
Microsoft created a bot to auto-caption photos and it's going hilariously wrong
Photo courtesy: Microsoft
Photo courtesy: Microsoft
Photo courtesy: Microsoft
Photo courtesy: Microsoft
Photo courtesy: Microsoft
#captionbot thinks Michelle Obama is a cell phone. https://t.co/FtC6tP6Ben
I was hoping to get a definite answer from https://t.co/b5DYRwRxWz but it's raised a lot more questions https://t.co/WVz4gC9kLi
captionbot.ai nailed it https://t.co/BROvlNbgIT
Captionbot.ai 's view of my avatar: https://t.co/OUctTxhx0p
omg captionbot https://t.co/3ePdM2y6LV
of
SEE ALL
BACK TO SLIDE
SHOW CAPTION +
HIDE CAPTION

As funny as Captionbot's failures are, we have to hand it to Microsoft for sometimes getting things amazingly accurate as well.

Have you seen any particularly bad or good examples of Captionbot in action? Share them in the comments.

Read Full Story

People are Reading