{"id":49386,"date":"2015-03-13T13:21:54","date_gmt":"2015-03-13T17:21:54","guid":{"rendered":"http:\/\/danielschristian.com\/learning-ecosystems\/?p=49386"},"modified":"2015-03-16T11:04:18","modified_gmt":"2015-03-16T15:04:18","slug":"inside-googles-massive-effort-in-deep-learning","status":"publish","type":"post","link":"http:\/\/danielschristian.com\/learning-ecosystems\/2015\/03\/13\/inside-googles-massive-effort-in-deep-learning\/","title":{"rendered":"Inside Google\u2019s massive effort in Deep Learning"},"content":{"rendered":"<p><strong><a href=\"https:\/\/medium.com\/backchannel\/google-search-will-be-your-next-brain-5207c26e4523\" target=\"_blank\">Part 3: Google Search will be your next brain<\/a><\/strong> &#8212; from medium.com by Steven Levy<br \/>\n<em>Inside Google\u2019s massive effort in Deep Learning, which could make already-smart search into scary-smart search<\/em><\/p>\n<p><em>Excerpt:<\/em><\/p>\n<p style=\"padding-left: 30px;\">But about ten years ago, in Hinton\u2019s lab at the University of Toronto, he and some other researchers made a breakthrough that suddenly made neural nets the hottest thing in AI. Not only Google but other companies such as Facebook, Microsoft and IBM began frantically pursuing the relatively minuscule number of computer scientists versed in the black art of organizing several layers of artificial neurons so that the entire system could be trained, or even train itself, to divine coherence from random inputs, much in a way that a newborn learns to organize the data pouring into his or her virgin senses. With this newly effective process, dubbed Deep Learning, some of the long-standing logjams of computation (like being able to see, hear, and be unbeatable at Breakout) would finally be untangled. The age of intelligent computers systems?\u2014?long awaited and long feared?\u2014?would suddenly be breathing down our necks. And Google search would work a whole lot better.<\/p>\n<p style=\"padding-left: 30px;\">This breakthrough will be crucial in Google Search\u2019s next big step: understanding the real world to make a huge leap in accurately giving users the answers to their questions as well as spontaneously surfacing information to satisfy their needs. To keep search vital, Google must get even smarter.<\/p>\n<p style=\"padding-left: 30px;\">This is very much in character for the Internet giant. From its earliest days, the company\u2019s founders have been explicit that Google is an <em class=\"markup--em markup--p-em\">artificial intelligence company. <\/em>It uses its AI not just in search?\u2014?though its search engine is positively drenched with artificial intelligence techniques?\u2014?but in its advertising systems, its self-driving cars, and its plans to put nanoparticles in the human bloodstream for early disease detection.<\/p>\n<p style=\"padding-left: 30px;\">&#8230;<\/p>\n<p style=\"padding-left: 30px;\">Indeed, as of now, all Google\u2019s deep learning work has yet to make a big mark on Google search or other products. But that\u2019s about to change.<\/p>\n<p>&nbsp;<\/p>\n<p><em><strong>Also see the other parts in this series:<\/strong><\/em><\/p>\n<p><a href=\"https:\/\/medium.com\/p\/33bc09852dc9\" target=\"_blank\"><strong>Part 1: The never ending search<\/strong><\/a><\/p>\n<p><em>Excerpt:<\/em><\/p>\n<p style=\"padding-left: 30px;\">Google\u2019s flagship product has been part of our lives for so long that we take it for granted. But Google doesn\u2019t. Part One of a study of Search\u2019s quiet transformation.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/medium.com\/p\/eba8700263bf\" target=\"_blank\"><strong>Part 2: How Google knows what you want to know<\/strong><\/a><br \/>\n<em>Eight times a day Google asks test subjects about their information needs. Their replies can be sobering.<\/em><\/p>\n<p><em>Excerpt:<\/em><\/p>\n<p style=\"padding-left: 30px;\">Google search really isn\u2019t threatened by competition from other search engines. But the people on the search team constantly worry that they may be falling short in satisfying the needs of their users. To address that problem, of course, Google needs to know what those needs are. One way to do this is by examining the logs to see what queries are unsatisfied. But there are lots of things people want to know that they aren\u2019t asking Google about.<\/p>\n<p style=\"padding-left: 30px;\">How does Google know what those needs are?<\/p>\n<p style=\"padding-left: 30px;\">It asks them.<\/p>\n<p style=\"padding-left: 30px;\">Every year since 2011 Google has run an annual study to learn what people really, really want to know, whether it\u2019s something Google provides or not. It\u2019s called Daily Information Needs, but the psychologists at Google involved with the project just call it DIN.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/medium.com\/backchannel\/the-deep-mind-of-demis-hassabis-156112890d8a\" target=\"_blank\"><strong>Part 4: The Deep Mind of Demis Hassabis<\/strong><\/a> &#8212; from medium.com by Steven Levy<br \/>\n<em>Google\u2019s prize AI prodigy tells all.\u00a0In the race to recruit the best AI talent, Google scored a coup by getting the team led by a former video game guru and chess prodigy<\/em><\/p>\n<p><em>Excerpt:<\/em><\/p>\n<p style=\"padding-left: 30px;\">From the day in 2011 that Demis Hassabis co-founded DeepMind\u2014with funding by the likes of Elon Musk\u2014the UK-based artificial intelligence startup became the most coveted target of major tech companies. In June 2014, Hassabis and his co-founders, Shane Legg and Mustafa Suleyman, agreed to Google\u2019s purchase offer of $400 million. Late last year, Hassabis sat down with Backchannel to discuss why his team went with Google\u2014and <a class=\"markup--anchor markup--p-anchor\" href=\"https:\/\/medium.com\/backchannel\/google-search-will-be-your-next-brain-5207c26e4523\" target=\"_blank\" data-href=\"https:\/\/medium.com\/backchannel\/google-search-will-be-your-next-brain-5207c26e4523\">why DeepMind is uniquely poised to push the frontiers of AI<\/a>. The interview has been edited for length and clarity.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><em>Addendum on 3\/16\/15:<\/em><\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/moz.com\/blog\/deep-learning-machine-learning-future-of-seo-whiteboard-friday\" target=\"_blank\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-49419\" src=\"http:\/\/danielschristian.com\/learning-ecosystems\/wp-content\/uploads\/2015\/03\/DeepLearning-Moz-March2015.jpg\" alt=\"DeepLearning-Moz-March2015\" width=\"100%\" height=\"100%\" border=\"0\" srcset=\"http:\/\/danielschristian.com\/learning-ecosystems\/wp-content\/uploads\/2015\/03\/DeepLearning-Moz-March2015.jpg 772w, http:\/\/danielschristian.com\/learning-ecosystems\/wp-content\/uploads\/2015\/03\/DeepLearning-Moz-March2015-142x150.jpg 142w\" sizes=\"(max-width: 772px) 100vw, 772px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Part 3: Google Search will be your next brain &#8212; from medium.com by Steven Levy Inside Google\u2019s massive effort in Deep Learning, which could make already-smart search into scary-smart search Excerpt: But about ten years ago, in Hinton\u2019s lab at the University of Toronto, he and some other researchers made a breakthrough that suddenly made [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"footnotes":""},"categories":[435,356,298,37,63,482,124],"tags":[],"class_list":["post-49386","post","type-post","status-publish","format-standard","hentry","category-analytics","category-artificial-intelligence-agents-llms-and-related","category-data-related-items","category-future","category-google","category-intelligent-systems","category-intelligent-tutoring"],"_links":{"self":[{"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/49386","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/comments?post=49386"}],"version-history":[{"count":5,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/49386\/revisions"}],"predecessor-version":[{"id":49420,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/posts\/49386\/revisions\/49420"}],"wp:attachment":[{"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/media?parent=49386"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/categories?post=49386"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/danielschristian.com\/learning-ecosystems\/wp-json\/wp\/v2\/tags?post=49386"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}