Dushyantsinh is a program manager in developer ecosystem team in India. In his current role he is responsible for building and nurturing communities and influencer programs to help developers be successful and Google to build user-centered products.View the profile
Bill is a senior program manager and a regional lead at the Developer Relations team in Google, responsible for managing developer programs in China. Bill has been working in the high-tech industry in the U.S. for 33 years, including as a Lead PM at Microsoft for ten years before joining Google in 2008. Bill has organized many technology conferences and helped building 27 GDG communities in China since 2009, and he is a frequent speaker at many technology conferences in the U.S. and China. He is a recipientView the profile
Sebastian has been at Google since 2007, where he currently leads Developer Ecosystem teams across Asia, the Middle East and Africa. His mission is to make Google technologies the tools of choice by developers and startups. Sebastian previously worked as a strategy consultant for various firms, as well as in business development at Dell. He holds an engineering Master's degree from Centrale-Supélec and an MBA from Collège des Ingénieurs.View the profile
About the talk
AIY efforts at Google puts AI into various maker toolkits, to make things more playful and, more importantly, to help you solve real problems that matter to you and your communities. Join this session to learn how you can use these kits to start adding natural human interaction to your maker projects. It will feature demos on the Voice and Vision Kits, and some amazing AIY experiments built by the makers community around the world.
Everyone welcome to the Ary introductory session. Everybody had a good lunch today. Yes, okay, as you can see on the screen the name of this obsession is called the introduction to Ary but what is a r y what developers like you make us all around the world to make application support artificial intelligence by yourself. That's the name of it where they came from my colleagues think about coordinations. My name is Sebastian joining me. We will give you a full introduction of the current DIY product line.
So. Let me introduce my college. Thank you, baby. Hello. My name is Christian and part of a Google developer relations team in India. I'm really excited here limit Sebastian to give you a quick overview of what is a y. Thank you Sean. So I thank you very much for being here in person or watching this on YouTube. I'm Sebastian with his very complicated. Last name. I join Google recently just about 11 years ago. And with my team's what we do around the world, especially in Emerging Markets as we help developers and startups build better mobile and web applications
today. I want to talk to you about aiy. But before this, let's talk about DIY do-it-yourself. Do you know what this is? It's not even so it's actually a musical instrument which makes very nice sounds. But no it was not invented in prehistoric times. It was actually created in the r2000 in Switzerland. Switzerland is actually the country while I'm if you should be based. Well, that is what I'm not in one of the other UFOs which week old planes. Can I travel quite a bit to visit my teams? Do you know what this is all so it's a window into DIY
culture. Let me take you through a very brief history of humankind appetite for DIY and if you read the book sapiens a brief history of humankind, you'll know what I'm talking about. Are human ancestors, we're already building tools as funny, you know weapons instruments using Stone and woods. Let me skip a few generations of humans. We're still using wood to create think this is one of my brothers might see us as my sister Lydia some thirty years ago, and I'm sure you could lay your hands on. Knott's fast forward to the
what I told the electronic Sage you remember in the 90s how desktop computers. I'm not even talking about laptops, but desktops were so expensive. Show hands maybe to see who built computers with a few of you and not the only one who's too old for this animated image can see how I do use an overhead projector and it just meant old LCD screen to build a cheap homemade video projector, but then obviously my mom got annoyed because all the electronics where everywhere in the living room. Okay, so I went outside and that's
me reusing garbage bags $1 of garbage bags to build a solar balloon. I can almost blew me off not quite but I'll get there one day. But the appeal daktronics was just too strong. So my siblings and I got back inside and one of my brothers the other one ring with three princess homemade 3D printer. This is my other brother. The one on the right in the museum. As I said DIY isn't from very very early on. It's wholesome Google's DNA remember from the Paris office and I mentioned Paris because I'm actually French and this engineer came here. I thought he had built using toppled
drink is 20% Innovation time since then. This has become two years ago, but we called the Daydream VR platform it Google. His what's interesting. Now, the mega culture is all about Hardware on one side physical objects, and you may have heard of make a make a ferret since 2006. You may have makerspaces around you and if there's none in your city where you live then why don't you start one of these makerspaces? The great thing about this make a culture is that you learn through doing with your hands you make mistakes. So what does it matter? That's a very good way to learn to try
new things and learn from each other with that you can trade without technology. It doesn't matter what your background is. In fact, it's even better when you can mix and match different domains to find you not applications of this technology take a look at it was a hat what has happened in the past. He is you have now have my control is like a Raspberry Pi the clown has become Tifa lithium batteries have to come cheap, but did you know that lithium batteries are cost has decreased by 80% in eight years of the past eight years and I'm sure you had
your own that way. It doesn't have to be it doesn't have to be and this is why with a I want do it yourself artificial intelligence that we introduced last year. You can have fun. Just the idea of this make a culture is before anything else to have fun. Using in this case artificial intelligence. We want to put a I literally in your hands. So you you said that you can solve real problems. I don't like it's are open source that combine hardware and software and then to
dry integrate a are directly on the device themselves. DSM says I mentioned previously is it safe to keep it low cost using readily available components that you can find almost anywhere on the planet. And the kids are very easy to assemble. Just how long does it take to assemble one of these kids 15 to 20 minutes 15 13 minutes more than these kids. You shine bill, but off they just a few minutes will demo some of these kids to show what you can do with them. So the voice get in the
vision kit the stay with us in the coming weeks and months. They'll be no more space. Now, let's take a look at what some of you have have already created in this example. I'm going to show you in just a few seconds and 16 year old with no programming experience used to come up with the following use case. Let's play the video about 20 seconds. shop for New York Yankees baseball hat So what's actually happening now? Okay. So what actually happened was that when it said done. It's just sent link to my email after
finding it on eBay. So it'll find results online. Send links in an email to me and I'm going to receive those so then I can quickly click and buy something. What happened here with Lawrence into a high school kid was shopping for a product. I don't even have went off the window device that done to let me take you through the code is just the beginning. Emailed a run off the when the device it done. So let me take you. through the code is just the beginning
I was searching on eBay for Radford result results. emailed the code is just In the beginning I'm shopping for some baseball cap. through the code is just the beginning of the video that old email and format oldest in an email subject line. That's it. Nothing. It's just connect to the server to email 7 just send a send the email and get the device to say done. That's it. There's nothing more it will work. Now, it's your time to do things with a i y enough I have just don't now to come and Stage to do a demo with the with the voice kids. So thank you
very much for listening and welcome to come back on stage. Make a Sebastian. My name is Michigan part of developing relations teams that Google and like everybody excited about the possibility of AI has in front of us. His only becomes more meaningful and more impactful when all of us can have access to his wonderful platform. Hey Google. Do you have been sharing a work in advancement in the field of artificial intelligence by Building Products sharing to a research papers and now the kids we are taking to
even though people yet. It is strong enough for you to solve some really good problems. So, let's see how to install some of those things and thinking about this kid together. What makes sense to be of putting this in front of people and of course voice was one of the things that was very evident of the voice how fun it would be mentioned in the note yesterday about wavenet going to talk about the capabilities of are white with Cloud speech API and Google Assistant API, but that's cause this much more than this.
The Voice Kids was launched some time and attention. He has a combination of few software and some of the hardware there. It was marketed along with Raspberry Pi Foundation to see what are the feedback we can get from the existing maker community and try to improve our offering we lost the second version of Voice Kids sometime in January who can a female get in carpet all those feedbacks and make it all in one box company if you if you go to a y website and look at why skip this is what I know. You'll probably find that. But what does it contain garlic
from a hundred point of view? It has Raspberry Pi zero. It has Weiss Vonage which is basically a piece of Hardware which understanding a lot of a lot of audio processing for yourself for you. And of course one of his different different company, and he doesn't my does exotic the microcontroller General input output of what's happening with your wife get at any point of time. And in front of you is basically runs on raspbian Linux. It uses Google Assistant API and uses Cloud speech if this is just scratching the surface of the white. Skip
How can you get started very straightforward three step process Step 1 Step 2 step 3 is not your Solution by yourself. If you open the kid, this is what it looks like busting in sure. You have all the right components like all the different different on the website just verify that you have all those companies ready with you before you start assembling together. Once you verify the next step what you need to do is build an engine together. When's it going to snow put the engine together then
now you're building a classy. So you basically take the cardboard and can give it a structure of a speaker. When's the cardboard can you put the engine inside of you for the kind of know that's what if I invoice wanted inside it. That's a Superfund Site first time. It took somewhere around 15-20 minutes, but I'm sure you guys are feeling much much in advance that me and you could try to even faster do it in a nice fun way out of it. Steps to is basically set up your device at this point of time. What you want to do is that now I have my device or my wife
and I lift my voice to it. Let me see if everything is working fine. If everything is working fine then. So before you start do you want what kind of snow and sure that you have everything is running for you? So things like let's say you're connected to network. This could be either a wide Network. Listen to work out. If your teeth ring from your phone to Central you have some sort of in connection because a voice needs to connected to Voice kid needs to be connected to Internet. It's using underneath using Google assistant and speech
API for recognition for first Let me see if I'm online. Looks like I'm all set from an intern point of view. Let's see if my speakers if my audio is working fine. What is working fine Center? Seems, okay. Let me see if it recognizes my voice. Testing 1 2 3. Testing 1 2 3. I'm almost at the good thing is that why is it comes with some of the pre-built demos as well? It's good to see if there was looking fine before going to start building the ocean. So if you go to the Dollar Tree and look at Fightin voice examples, which is he
and I'm just going to Try this Library. Hey Google, what's the time right now? It's 150. Thank you. What I was doing is that I was just testing if things are working fine. Now things are kind of seems to be. Okay. Let me see a second. If it can build something and I'll let you go back to presentation. Can you go back to slides? Yeah, it's it's always good to see if device is working fine before going to start building by yourself. I have a typical shopping experience.
Genesis 2 demo Sebastian did show correct. He was showing the code which was mostly about you know, kind of no giving a command to something and then it was time to identify a text and it was calling one of the API which was from eBay, I believe and then trying to basically said some of the result and send it is an email. I'd like to mimic similar Behavior. And let's see if I could. demagogue what I'm doing at this point of time. I'm just going to ask for maybe shop for something. Correct. Did the Mother Day is coming up Mother's Day is
coming up and I won't be in time, but I don't want to send something to my mom when I was thinking, you know, what could be an interesting thing. You know if I can find a smartwatch using at my wife skit Hey Google shop for smartwatch. So if you look at what it did and it basically recognize my SmartWatch is available for me to California. What is it now at this point of time I could take this out and either send an email like what Sebastian was mentioning or if I have a smart display
device I could physically you know what your dad are kind of a nice visual list. Can we move it to slides? What essential thing you could do that what I was trying to emphasize series that you know, there's a lot of things possible with the the device that you could play around with it. You could also not just look at the soft as as the one side of it, but it would also experiment with some of the things on Hardware taking the old toys and and got no putting the voice kids
or the other day. I like it's into it and in real life with the body's bring life to those toys for The Voice kids stomachs. So kind of not giving voice and I'm kind of New Vision to Roomba vacuum cleaner so you could tell them to go to the difference. Bother you could be completely custom voice actions. What is that? You could get a second Twitter Auto follow the discussion with DIY projects with that to know more about what's happening on Vision kit.
Thank you. Thank you. But let me continue with the second of Florida Line in the Ary product family wishes. You can see it's the vision kit. It is a relatively new product and it's just being released end of last year, and we've had a new version update the first quartile soon as you can see launch in December of last year. It has the latest the Raspberry Pi zero and the wh the header it's a saw that on the board. So it's much easier. It comes with the Raspberry Pi camera version 2 and the Google mini and that's where all the
way Google put into the product. It's on the air-conditioning software on the Box by self. So. Let's go through the list of materials that do sound get a photo of a voice kids Seminole CR250R bore the camera and help you do division recognition, and it has the connections to the cable connector. Gpio connector Bellevue to encrypt the signals. Okay to add more Security application. Download software site as well as decodable to form allows you to fold into device. The operating system the same in the Olympics the rest being offered a assistant
mobilenet software applications. Tallahassee building software for facial recognition as well as general object recognition. So all these software is on the device you ready to use. Antelope comes off its component. Let me get into a bit more detailed because this is a relatively new product of Pi zero is the fare for the long as I said the Raspberry Pi zero has the building Wi-Fi and Bluetooth so you can connect if you want. Gpio connector which allows
it to connect directly with a flex cable to the black people connect to the pi camera as well as the additional accessories like the LED and the device you can have it the general song. They're on the floor somewhere side. It runs on the same Raspberry Pi Linux Raspberry Pi operating system on top of that contain three, we can process the first is defensive 3 seconds are in a circle has the object detection software. So where is Lisa software? I'm bored. And with all these hardware
and you threw the ATI false write on application interface with these components. So this is how everything fits together. Okay, let me go through the same process to Shawn matian incomes of the voice kit. So first thing is you a sample of the box that has diesel pass board. Whatever as you can see on the screen is off. The process beauty is relatively easy. You basically hook up the Raspberry Pi which division are the table together stuck together and then folded to call box being served this module into the middle almost like I can
do this in front of my building is about 47 minutes second timer 20 minutes. So it's very simple if I have a video tutorial of how to assemble it on YouTube. Okay. Alright. So what's up with that? You don't congratulations in less than hour you be able to just like that does not necessarily need to hook up to internet through the connection is all you need to just stop a power supply and facial recognition software with building for the device. It will automatically run the software. So right
Vision with me and as you can see the top LED blue light as you can see the blue light indicating the camera is capturing my face if I shoot through the camera with a smiley face happy face the light color of the He will change it to you if I'm showing a frowny face. It will go back to Blue. Tell me what you see right to change the color. Let me say this in. So what happened? It is a wizard Dai tensorflow model. Where's the facial recognition app to make a facial
recognition software just like that. So hook up the power and you can do facial recognition is called OK it's a part of a product we ship was the device assembly very easy setup. It's very easy to make your own music and please switch the screen to the output of my other device. So that you can see right now I'm running the roads being software operating system and there's a window showing the software by starting a simple demo, which is the object classification and as you will see on the screen
on the right hand side. It will have the camera the video image you coming by the camera. And on the table, I have a apple and a banana and also a cook at this is some random object dream of starting putting on the screen, which one is by the object classification software that we put on the device now, I'm a banana. And you should see the left hand of the screen. It will say this object a banana. Not only it will recognize. It's an apple. In fact of a circus a granny smith apple.
Coca-Cola can I don't know what it will say for the earlier is that was telling me it's looking bad red color. It looks like looks like this. And as you can see I left the side. It is the opposite of recognition is recognized it it says it's a banana. The number off of that is the so-called a conference call similar to an Apple which is a granny smith apple. Okay, so just call this number these kind of feedback from the software you can use to make a lot of application. Okay. Let's switch it back to the So this I mean as this image on the screen
as you can see very similar, right? It recognizes objects along with a conference call. You can use this number to help you design your applications. So exactly what can you do with a vision kit? They always think it is also severely into it and saraity. I caused you can leverage this photo image classification what you just saw a apple and banana and a whole bunch of other stuff. Okay a i machine learning English device by building your own customized building a
pencil. How do you do that? Pictures of all the first number one every machine you building a model train, right? So you get the results you do a so-called exporter model to a frozen graph. Okay does not understood by fishing Planet. How do I OK Google provide this so-called a Barnett model compiler and a customized computer graph. Okay, if you have a binary file How do you use the ATI course? You said that next step and example the computer because of this computer grass. We arrange these inputs into whatever the machine learning test, which basically is a bunch of
okay. So now next step is you need to match this tensor a bunch of Basically, the stuff is the program. Okay, how do you define your face? Object? Okay, as you can see you're right and this is your structure. Okay, and to see if you just let me get the results from the sensor. When do the Georgia score of the UK score whenever you take that into your end result. The score is based on some number about some number change my color back. Okay. So this is exactly what you do income self using your own machine.
Extending a project right software. You can control turn on the lights, you know, you could expand your project and was that control you can do Ramos. It's okay. So how do eyes is a baker because of the most things I want to say to use a r y the power of a all-white really it is connected to many of the services provided by week. Online make a communities around the world. Okay at this is a part of the fun off of Duty makers Ary. Can you put the join a contest
with the Ministry of Education in China is so cool make a contest expense paid trip to China to those of you in the room. You are American makers, please join us. And I'm lucky Tales Hector website. All right resource wise the website is this address, and also next weekend in the Bay area of there that you make a spare those off you in the area. You can get to the kids from the biggest thing that you need to either kill yourself involved in suspending all applications of
AI in traffic issues. And finally two summary and I will say the things you guys going to do right Management Services. We have scissors control devices. Okay, you computer applications in The Leverage. We will very soon publish a global exchange and I'll put it on application out that she was the global Dan. We want to thank you for coming in today.
Buy this talk
Access to all the recordings of the event
Buy this video
With ConferenceCast.tv, you get access to our library of the world's best conference talks.