John Pace
  • Home
  • About
  • Contact

​​
​
Data Scientist, husband, father of 3 great daughters, 5x Ironman triathlon finisher, just a normal guy who spent a lot of time in school.
Let’s explore data science, artificial intelligence, machine learning, and other topics together.

Does Microsoft Word use Deep Learning?

5/1/2020

0 Comments

 
Picture
Hi, I'm Clippy. Remember me?

​A few days ago, I was writing a document in Microsoft Word and found something very interesting. I inserted a picture and noticed it automatically created a caption for the image. I was really impressed. Image captioning is not an easy process. You have to combine convolutional neural networks (CNNs) with recurrent neural networks (RNNs), particularly Long Short Term Memory (LSTM) RNNs. Putting those models in production in the standard word processing program is a great example of artificial intelligence in our every day work and how AI is being integrated into all parts of our lives.

Picture
Image from https://raw.githubusercontent.com/yunjey/pytorch-tutorial/master/tutorials/03-advanced/image_captioning/png/model.png

​The image above is a workflow for image captioning. First, you input the image. Next, use a CNN to get a feature vector. Finally, use the feature vector as input for the LSTM. That's all there is to it (too bad each of those steps is not trivial).


Here is a fun video I made to demonstrate how the process works in Microsoft Word. Try it out for yourself!
​
​

If you have questions and want to connect, you can message me on LinkedIn or Twitter. Also, follow me on Twitter 
@pacejohn, LinkedIn https://www.linkedin.com/in/john-pace-phd-20b87070/, and follow my company, Mark III Systems, on Twitter @markiiisystems
​
#artificialintelligence #AI #machinelearning #MLDL #microsoftword #neuralnetworks #imagecaptioning #recurrentneuralnetworks #rnn #convolutionalneuralnetworks #cnn #lstm #longshorttermmemory #microsoft #microsoftword #microsoftoffice #office365
0 Comments



Leave a Reply.

    Archives

    November 2020
    September 2020
    August 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    May 2019
    April 2019
    March 2019
    April 2018
    March 2018
    January 2018
    November 2017

    Tweets by pacejohn
Proudly powered by Weebly
  • Home
  • About
  • Contact