Improving Google Patents with European Patent Office patents and the Prior Art Finder

Posted by Jon Orwant, Engineering Manager

Cross-posted with the US Public Policy Blog, the European Public Policy Blog, and Inside Search Blog

At Google, we're constantly trying to make important collections of information more useful to the world. Since 2006, we’ve let people discover, search, and read United States patents online. Starting this week, you can do the same for the millions of ideas that have been submitted to the European Patent Office, such as this one.

Typically, patents are granted only if an invention is new and not obvious. To explain why an invention is new, inventors will usually cite prior art such as earlier patent applications or journal articles. Determining the novelty of a patent can be difficult, requiring a laborious search through many sources, and so we’ve built a Prior Art Finder to make this process easier. With a single click, it searches multiple sources for related content that existed at the time the patent was filed.

Patent pages now feature a “Find prior art” button that instantly pulls together information relevant to the patent application.

The Prior Art Finder identifies key phrases from the text of the patent, combines them into a search query, and displays relevant results from Google Patents, Google Scholar, Google Books, and the rest of the web. You’ll start to see the blue “Find prior art” button on individual patent pages starting today.

Our hope is that this tool will give patent searchers another way to discover information relevant to a patent application, supplementing the search techniques they use today. We’ll be refining and extending the Prior Art Finder as we develop a better understanding of how to analyze patent claims and how to integrate the results into the workflow of patent searchers.

These are small steps toward making this collection of important but complex documents better understood. Sometimes language can be a barrier to understanding, which is why earlier this year we released an update to Google Translate that incorporates the European Patent Office’s parallel patent texts, allowing the EPO to provide translation between English, French, German, Spanish, Italian, Portuguese, and Swedish, with more languages scheduled for the future. And with the help of the United States Patent & Trademark Office, we’ve continued to add to our repository of USPTO bulk data, making it easier for researchers and law firms to analyze the entire corpus of US patents. More to come!

Conquer the back to school blues with Google tools

August is both an end to the lush freedom of summer and the beginning of another year of student life. As a rising senior at the University of Florida, this time is both exciting and anxiety-inducing. Even though I’m looking forward to many aspects of the school year, there are certain things about college—from book budgets to calculus study sessions—that can make it a headache.

But this fall, I feel more prepared to face the daily student grind. This summer, I had the chance to intern on the communications team at Google and got the inside track on some tools and tricks to make school a snap. For example, did you know there was an extension for Chrome that helps you stay focused on your work? Yup, didn’t think so! So I thought I’d share some of my new favorite tips—my “Survival Guide for Student Life”—to help make it easier for all students to get through the coming months.

Easy ways to coordinate your social and extracurricular life

• Google+ Hangouts enables you to video chat with up to nine friends from your desktop, mobile phone or tablet. A great feature for when your club needs to discuss some last minute changes for the upcoming meeting.
• Stay on task with Hangout Apps like Symphonical, which provides a digital wall of sticky notes for virtual brainstorm sessions.
• With Google+ Events, invite all your friends to your get-together and attach a personalized video greeting to the invitation. During the event, photos from the party can be uploaded to the event page in real-time using Party Mode. So if you have to miss a party due to a study session, you can avoid that pesky FOMO (Fear of Missing Out)!
• Let your friends know what you’re up to by sharing your Google Calendar with them. Or create a shared calendar just for your study group.

Stay organized and efficient—and be prepared for the unexpected

• Stop the email flood from the ridiculous number of email lists you signed up for using Gmail’s auto-unsubscribe feature.
• No more sore eyes from crowded inboxes—Gmail's default mode is Priority Inbox so it automatically sorts your important messages for you.
• Cite your sources! Use Google Docs’ research tool to investigate highlighted portions of your essay and then generate a citation.
• Group projects call for collaboration. With Google Drive, you can use shared folders so everyone can access materials without having to email updates to each other.
• Using your laptop or phone, you can send any documents or presentations saved on your Google Drive to Fedex to be printed, thanks to Google Cloud Print.

Get what you need and where you’re going faster

• For those of you starting at university this year, Google Maps has 360-degree panoramic Street View imagery for many campuses around the world to give you a preview of your new stomping grounds.
• Back to school shopping is one of the most fun things about August. Find your way in and out of malls and department stores with indoor Google Maps on Android devices.
• We college students can’t go too long without homemade food. Search for your next flight home with Flight Search. (If flying makes you a bit queasy, track any care packages by typing the tracking code into the Google search bar.)
• Stay informed with Google Now. This feature, available on Android devices running Jelly Bean, can update you when the next bus is coming or provide the weather forecast for Saturday’s big game.

Reading, writing, 'rithmetic and... YouTube

• Don’t break the bank on textbooks. Google Play has millions of FREE (emphasis is important) books readily available such as "Pride and Prejudice" and "Gulliver’s Travels."
• With the new Nexus 7 tablet, you can take your Google Play books, music, movies, TV shows, magazines and apps (like My Majors and doubleTwist Alarm Clock) with you, wherever you go.
• Locate hard-to-find books online or at a library near you with Book Search.
• Put Chrome to work with educational apps. 
• Not a fan of traditional note taking? Chromebooks are a super fast and virus-proof laptop. It starts seconds after you boot it and will last through a whole day of classes.
• A fair portion of us students aren’t fans of mental math. Type any equation into the Google search box to get the answers you need. It can graph functions as well.
• We know we spend too much of our time watching funny videos on YouTube, but there are video channels that can actually help us learn more about a variety of subjects—from astrophysics to world history. Find more educational channels at YouTube EDU.

I’m resting a bit easier now that I know there are tools that make student life a bit less overwhelming. Here’s hoping you, too, feel armed to face the fall semester—and beyond—with Google in your backpack.

Posted by Jenise Araujo, BOLD Intern, Communications Team

Teaching the World to Search

Posted by Maggie Johnson, Director of Education and University Relations

For two weeks in July, we ran Power Searching with Google, a MOOC (Massive Open Online Course) similar to those pioneered by Stanford and MIT. We blended this format with our social and communication tools to create a community learning experience around search. The course covered tips and tricks for Google Search, like using the search box as a calculator, or color filtering to find images.

The course had interactive activities to practice new skills and reinforce learning, and many opportunities to connect with other students using tools such as Google Groups, Moderator and Google+. Two of our search experts, Dan Russell and Matt Cutts, moderated Hangouts on Air, answering dozens of questions from students in the course. There were pre-, mid- and post-class assessments that students were required to pass to receive a certificate of completion. The course content is still available.

We had 155,000 students register for the course, from 196 countries. Of these, 29% of those who completed the first assessment passed the course and received a certificate. What was especially surprising was 96% of the students who completed the course liked the format and would be interested in taking other MOOCs.

This learning format is not new, as anyone who has worked in eLearning over the past 20 years knows. But what makes it different now is the large, global cohort of students who go through the class together. The discussion forums and Google+ streams were very active with students asking and answering questions, and providing additional ideas and content beyond what’s offered by the instructor. This learning interaction enabled by a massive “classroom”, is truly a new experience for students and teachers in an online environment.

Going forward, we will be offering Power Searching with Google again, so if you missed the first opportunity to get your certificate, you’ll have a second chance. Watch here for news about Power Searching as well as some educational ideas that we are exploring.

Building the search engine of the future, one baby step at a time

Larry Page once described the perfect search engine as understanding exactly what you mean and giving you back exactly what you want. It’s very much like the computer I dreamt about as a child growing up in India, glued to our black-and-white TV for every episode of Star Trek. I imagined a future where a starship computer would be able to answer any question I might ask, instantly. Today, we’re closer to that dream than I ever thought possible during my working life—and here are some of the latest steps we’re taking today to make search even more intelligent:

1. Understanding the world
In May we launched the Knowledge Graph, our database of more than 500 million real-world people, places and things with 3.5 billion attributes and connections among them. The feedback has been phenomenally positive and we want to extend this feature to people outside the U.S. So starting today, you’ll see Knowledge Graph results across every English-speaking country in the world. If you’re in Australia and search for [chiefs], you’ll get the rugby team—its players, results and history.

We’ll also use this intelligence to help you find the right result more quickly when your search may have different meanings. For example, if you search for [rio], you might be interested in the Brazilian city, the recent animated movie or the casino in Vegas. Thanks to the Knowledge Graph, we can now give you these different suggestions of real-world entities in the search box as you type:

Finally, the best answer to your question is not always a single entity, but a list or group of connected things. It’s quite challenging to pull these lists automatically from the web. But we’re now beginning to do just that. So when you search for [california lighthouses], [hurricanes in 2008] or [famous female astronomers], we’ll show you a list of these things across the top of the page. And by combining our Knowledge Graph with the collective wisdom of the web, we can even provide more subjective lists like [best action movies of the 2000s] or [things to do in paris]. If you click on an item, you can then explore the result more deeply on the web:

So far we can produce hundreds of thousands of lists involving millions of items, and we’ll keep growing to match your curiosity. A quick preview:



2. Putting your info at your fingertips
Sometimes the best answer to your question isn’t available on the public web—it may be contained somewhere else, such as in your email. We think you shouldn’t have to be your own mini-search engine to find the most useful information—it should just work. A search is a search, and we want our results to be truly universal. So we’re developing a way to find this information for you that’s useful and unobtrusive, and we’d love your feedback. Starting today, we’re opening up a limited trial where you can sign up to get information from your Gmail right from the search box.

So if you’re planning a biking trip to Tahoe, you might see relevant emails from friends about the best bike trails, or great places to eat on the right hand side of the results page. If it looks relevant you can then expand the box to read the emails:

We’re working on some even more useful features. For example, if you search for [my flights] we will organize flight confirmation emails for any upcoming trips in a beautifully easy-to-read way right on the search results page:

3. Understanding your intent
Often the most natural way to ask a question is by asking aloud. So we’ve combined our speech recognition expertise, understanding of language and the Knowledge Graph so that Voice Search can better interpret your questions and sometimes speak the answers back as full sentences. This has been available on Android for a few weeks and people love it. It’ll soon be available on your iPhone or iPad (iOS version 4.2+).

You just need to tap the microphone icon and ask your question, the same way you’d ask a friend. For example, ask “What movies are playing this weekend?” and you’ll see your words streamed back to you quickly as you speak. Then Google will show you a list of the latest movies in theaters near you, with schedules and even trailers. It works for everything from celebrity factoids to the height of Kilamanjaro and more. When Google can supply a direct answer to your question, you’ll get a spoken response too.



These are baby steps, but important ones on our way to building the search engine of the future—one that is much more intelligent and useful than it was just a few years ago. It’s a very exciting time to be working in this field.

Posted by Amit Singhal, SVP Google Search

The self-driving car logs more miles on new wheels

Technology is at its best when it makes people’s lives better, and that’s precisely what we’re going for with our self-driving car project. We’re using advanced computer science to try and make driving safer and more enjoyable.

Our vehicles, of which about a dozen are on the road at any given time, have now completed more than 300,000 miles of testing. They’ve covered a wide range of traffic conditions, and there hasn’t been a single accident under computer control.

We’re encouraged by this progress, but there’s still a long road ahead. To provide the best experience we can, we’ll need to master snow-covered roadways, interpret temporary construction signals and handle other tricky situations that many drivers encounter. As a next step, members of the self-driving car team will soon start using the cars solo (rather than in pairs), for things like commuting to work. This is an important milestone, as it brings this technology one step closer to every commuter. One day we hope this capability will enable people to be more productive in their cars. For now, our team members will remain in the driver’s seats and will take back control if needed.

And while these team members are commuting, many of them will be testing our algorithms on a new type of vehicle we’ve added to the self-driving car family over the past few months to help us refine our systems in different environments and on different terrain: the Lexus RX450h.

With each breakthrough we feel more optimistic about delivering this technology to people and dramatically improving their driving experience. We’ll see you on the road!

Posted by Chris Urmson, Engineering Lead

The tree versus the shadow

Character is like a tree and reputation like its shadow. The shadow is what we think of it; the tree is the real thing. —Abraham Lincoln

When I was looking for investors for my startup in 1997, I was a lot more interested in the values and character of my potential investors than in the name of the firm on the door. My first investors were not from Sand Hill Road or Palo Alto, but were people I knew would support my company (and me) in the ways we most needed help.

As an entrepreneur, you want to know if your investors will be there for you, help you do the right things, and encourage you to persist and evolve when things seem dark. Perhaps most of all, you want to know they’ve been there before, and that they’ll be calm and confident when things go wrong—when giving up sounds like a pretty good option.

At Google Ventures, we try to be the kind of hands-on investors that quietly help to build companies. We try to be the kind of investors we sought as entrepreneurs ourselves. Starting a company can be a lonely business, and it helps to know you’ve got someone on your side who has been through it before.

Today, we're launching a new Google Ventures blog as an experiment, hoping it will help you get to know the people and companies at Google Ventures a little better. We’ll share how we think about things and why, if you’re an entrepreneur, you might want to talk to Joe, Rich, Kevin and the rest of the team.

Posted by Bill Maris, Managing Partner, Google Ventures

(Cross-posted from the Google Ventures Blog)

Speech Recognition and Deep Learning

Posted by Vincent Vanhoucke, Research Scientist, Speech Team

The New York Times recently published an article about Google’s large scale deep learning project, which learns to discover patterns in large datasets, including... cats on YouTube!

What’s the point of building a gigantic cat detector you might ask? When you combine large amounts of data, large-scale distributed computing and powerful machine learning algorithms, you can apply the technology to address a large variety of practical problems.

With the launch of the latest Android platform release, Jelly Bean, we’ve taken a significant step towards making that technology useful: when you speak to your Android phone, chances are, you are talking to a neural network trained to recognize your speech.

Using neural networks for speech recognition is nothing new: the first proofs of concept were developed in the late 1980s(1), and after what can only be described as a 20-year dry-spell, evidence that the technology could scale to modern computing resources has recently begun to emerge(2). What changed? Access to larger and larger databases of speech, advances in computing power, including GPUs and fast distributed computing clusters such as the Google Compute Engine, unveiled at Google I/O this year, and a better understanding of how to scale the algorithms to make them effective learners.

The research, which reduces the error rate by over 20%, will be presented(3) at a conference this September, but true to our philosophy of integrated research, we’re delighted to bring the bleeding edge to our users first.

--

1 Phoneme recognition using time-delay neural networks, A. Waibel, T. Hanazawa, G. Hinton, K. Shikano and K.J. Lang. IEEE Transactions on Acoustics, Speech and Signal Processing, vol.37, no.3, pp.328-339, Mar 1989.

2 Acoustic Modeling using Deep Belief Networks, A. Mohamed, G. Dahl and G. Hinton. Accepted for publication in IEEE Transactions on Audio, Speech and Language Processing.

3 Application Of Pretrained Deep Neural Networks To Large Vocabulary Speech Recognition, N. Jaitly, P. Nguyen, A. Senior and V. Vanhoucke, Accepted for publication in the Proceedings of Interspeech 2012.

A new way to visualize the global arms trade

Did you know that 60 percent of all violent deaths are due to small arms and light weapons? Small arms, such as revolvers, assault rifles and light machine guns, and ammunition represent a multi-billion dollar industry, and three quarters of the world’s small arms lie in the hand of civilians—more than 650 million civilian arms. As part of the Google Ideas initiative on illicit networks, we’ve created an interactive data visualization of global small arms and ammunition trading to better understand and map the global arms trade.

The tool was produced by Google’s Creative Lab team in collaboration with the Igarape Institute. More than 1 million data points on imports and exports of small arms, light weapons and ammunition between 1992 and 2010 and across 250 states and territories across the world were provided by the Peace Research Institute Oslo (PRIO) small arms database. The visualization reveals patterns and trends in imports and exports of arms and ammunition across the world, making it easy to explore how they relate to conflicts worldwide. More of the implications of this data are discussed in this video from the INFO summit hosted by Google Ideas last month:



You can explore these data points by zooming in and out of the globe, clicking on any country to readjust the view, and using the histogram tool at the bottom to see trading patterns over the years. You can see, for example, that the scale of the global trade in ammunition rivals the scale of trade in actual weapons, an insight underexplored by policymakers today in conflict prevention and resolution.

We built this visualization using the open source WebGL Globe on Google’s Chrome Experiments site; since it is open sourced, we hope to see others use the globe as a platform for bringing other complex datasets to life.

Update 8/16/12: This post has been updated to reflect more accurate numbers.

Posted by Scott Carpenter, Deputy Director, Google Ideas

Giving you a better Google

We work every day to create a more seamless, beautiful user experience—to give you a better, easier-to-use Google. This means continuously improving the products we offer, and recognizing when users of one product might have a better experience with another. Over the past year, we’ve made changes to around 50 products, features and services—donating, merging and shutting things down so we can focus on the high-impact products that millions of people use, multiple times a day. Today, we’re announcing a few more changes:

• We introduced Google Apps for Teams in 2008 to allow people with a verified business or school email address to collaborate using non-email applications from Google like Google Docs, Google Calendar and Google Talk. Over time, we realized that Google Apps for Teams was not as useful for people as we originally anticipated. Beginning September 4, 2012, we'll start converting existing Google Apps for Teams accounts into personal Google Accounts, and shutting down Google Apps for Teams. This change does not affect other editions of Google Apps.
• We launched Google Listen through Google Labs in August 2009, to give people a way to discover and listen to podcasts. However, with Google Play, people now have access to a wider variety of podcast apps, so we’ve discontinued Listen. People who have already installed the app can still use it, but after November 1, podcast search won’t function. You can access your podcast subscriptions in Google Reader in the “Listen Subscriptions” folder and download them from the Import/Export tab.
• Google Video for Business is a video hosting and sharing solution that allowed Google Apps for Business and Google Apps for Education customers to use video for internal communication. Starting this fall, we’ll migrate all videos hosted on Google Video for Business over to Google Drive, which has similar storage and sharing capabilities. All migrated videos will be stored for free and will not count against a user’s Google Drive storage quota.
• Finally, Google maintains 150+ blogs and other communications channels about our products and services, and so over time we'll also be closing a number of Google-created blogs that are either updated infrequently, or are redundant with other blogs. This doesn't mean that we'll be sharing any less information—we'll just be posting our updates on our more popular channels.

Technology has the power to change people’s lives. But to make a difference, we need to carefully consider what to focus on, and make hard decisions about what we won’t pursue. This enables us to devote more time and resources giving you products you love, and making them better for you.

Posted by Max Ibel, Director of Engineering

Our roots go global: Apply for a RISE Award today

The application for the 2013 Google RISE (Roots in Science and Engineering) Awards is now open. Given once a year, Google RISE Awards are designed to promote and support education initiatives in two key areas: Science, Technology, Engineering, Mathematics (STEM) and Computer Science (CS). Google grants awards of $5,000 - $25,000 USD to organizations around the world working with K-12 and university students in these fields.

This year, our community welcomed more than two dozen organizations from around the world, from Denmark to Uganda and California to Romania. The RISE grants have helped these groups to scale their reach by allowing for more scholarship recipients, to deepen their impact by providing hands on robotics kits, and to ultimately inspire their students by creating a community for CS outreach.

Now, the RISE Awards have expanded to include applicants from Latin America and the Asia Pacific region, bringing our total to six continents and 243 countries. All eligible nations are listed on our website.

The growth of technology is undoubtable, and the impact technology will have on our future is equally undeniable. We believe it’s our duty to support students who have the uncanny ability not only to consume technology, but also to create it. We believe that inspiring the next generation of computer scientists will enrich the lives of not only individual students, but also the communities and countries they live in.

Show us what you can do to get students excited about STEM and CS! Submit your application by September 30, 2012. Awardees will be announced by January 2013.

Posted by Roxana Shirkhoda, K-12 Education Outreach Specialist