Microsoft’s next AI experiment: ‘CaptionBot’ identifies images

18/04/2016

Microsoft has unleashed another AI experiment on the web, this time hoping for better results than its rogue Tay Twitter bot.

The company launched CaptionBot.ai, which can analyse a photo in seconds and describe it.

Powered by Microsoft's Cognitive Services, the bot looks over any images and gives rudimentary descriptions of what it can see using a Computer Vision API, an Emotion API and a Bing Image API.

This is the same base software Microsoft has used for its How Old Do I Look? system.

To actually create the captions, this system has been coupled with the language system from Tay, Microsoft's attempt at a chat bot that was shut down after a vulnerability led to it tweeting racist and sexist remarks.

The photo captioning system is not completely accurate, but attempts to describe the person in an image, what they're doing and their emotions in the moment. It can also recognise animals and describe landscapes,

But still needs some work:

captionbot.jpg

The app is available here

<< Back to today’s Digital Intelligence news

Copyright ©2000-2019 Digital Strategy Consulting Limited | All rights reserved | This material is for your personal use only | Using this site constitutes acceptance of our user agreement and privacy policy