Google's Voice Command for Playing Music

Google's voice search feature still has a long way to go. If you say "play music" or "play some music" in the Google Search app for Android, Google starts the Play Music app and opens the "I'm Feeling Lucky" radio, which is based on your listening history. I think it makes more sense to continue playing your music and use the current queue instead of creating a new playlist.

Google still doesn't support basic voice actions like "next song", "skip", "pause" or "stop the music". If you say "next song", Google only shows the search results and a list of songs from Next, an American R&B musical group.

You can say "play Alicia Keys" and Google will shuffle Alicia's songs:

You can also say "play blues" and Google will start the Blues radio. If you say "play hip hop", Google Play Music will show a list of search results for "hip hop".

That's what happens if Play Music is the default app that handles music voice actions. You can change it by saying "play Coldplay" or something similar, quickly tapping the icon next to the app's name, picking one of the music apps and tapping the selected app (I could choose between Google Play, Google Play Music, TuneIn Radio and Poweramp, but your list will be different, depending on the apps you've installed). The next time when you use a music-related voice action, the app you've picked will handle it. Most apps will show a list of search results or start playing music.

{ via +Google }

Konami Easter Egg in Google Voice Search

There's a cool Easter Egg in Google Voice Search: if you say "Up, Up, Down, Down, Left, Right, Left, Right", Google will answer: "Cheat mode unlocked, unlimited free Google searches". This is the Konami cheat code originally used for Nintendo games.

You can try this Easter Egg in the Google Search app for Android and iOS and in the Google Search site if you use Chrome for desktop.

The Konami code was also used as an Easter Egg in Google Reader, Google Docs (create a new document and press "Up, Up, Down, Down, Left, Right, Left, Right", then type ba and press Enter), Play Games and even for the Chromebook Pixel.

{ via Search Engine Land and Pierre Far }

Camera Voice Commands for Android

The Google Search app for Android added voice commands for taking photos and recording videos. Just say: "take a photo", "take a picture", "record a video", "take a video", "shoot a video" and the camera app will launch in the proper mode.

"The first home run in T-ball, the surprise proposal, or just that gorgeous sunset... Sometimes the perfect photo passes you by as you fumble with your phone to open the camera app. Now with the Google Search App on Android, you can just tap the microphone or say 'Ok Google,' then 'take a photo' or 'take a video'," informs Google.

OK Google in Desktop Chrome

Google Voice Search works in Chrome for desktop, not only in Android and iOS. Just click the microphone icon from the search box and you can tell Google what do you want to know, assuming that you have a microphone.

Now you can bypass the microphone icon and use the hotword "OK Google" when you're using Google search or the new tab page. You need to install this extension first.

"Chrome will listen for you to say 'Ok Google' and then send the sound of the next thing you say, plus a few seconds before, to Google," informs the options page. By default, Google stops listening after 5 minutes to reduce battery consumption on a laptop.

Hotword detection works offline and doesn't send the recording to Google's servers until you say "OK Google". You need to open a Google search page or go to the new tab page first, assuming that you have the updated new tab page which uses the Google homepage. The extension only works for google.com, not for other Google domains:

You can tell if Google is listening by checking the microphone icon from the search box:

Now Google handles Voice Search queries differently. In addition to providing voice feedback and using the previous query for disambiguation, Google now changes your query and removes unnecessary word. For example, if you tell Google "show me some Brad Pitt movies", Google will show results for [Brad Pitt movies].

Keyboard Shortcut for Google Voice Search

If you use Chrome, you've probably noticed the small microphone icon from Google's search box. It lets you search Google using your voice and it's now just as good as the voice search feature from Google's mobile apps.

There's even a keyboard shortcut for this feature: Ctrl+Shift+. (or ⌘-Shift-. for Mac). Yes, that's a dot, full stop or period.

"Say your question and hear an answer back on your desktop Chrome browser. All you will need is a built-in or attached microphone. Also, be sure to have the volume up on your computer to hear your answer loud and clear. Please note Voice Search with spoken answers back is available for US English only," informs Google.

"Open the Chrome browser and go to http://www.google.com/. You'll see a small gray microphone on the right-hand side of the search box. Click the microphone or press Ctrl+Shift+Period (Mac: ⌘-Shift-Period) with your cursor in the search box to start voice search. When the large red microphone icon appears, begin speaking. You can press ESC or click the red button to cancel. As you speak, Google will interpret your voice input. Afterwards, your results show up just as if you had typed the search term," mentions a help center article.

{ via Mike Downes }

Conversational Voice Search in Chrome for iOS

Chrome for iOS has been updated and now includes the enhanced version of voice search that was available in the Google Search app. The upgraded voice search is more accurate, answers more question, has spoken feedback and it remembers your previous questions, so you can ask "how many calories are in an apple?" and then "what about an orange?".

The microphone icon has been removed from the address bar and it's now placed prominently next to the keyboard. If you start using the keyboard, the voice search button is replaced by some keys that are useful when you enter a web address: ":", ".", "-", "/" and a ".com" button.

Google now shows the words from your question as you speak, so you can see much faster if Google's speech-to-text engine understands what you're saying.

You'll hear the answer and Google will also show a card with more information. Spoken feedback can be disabled from the settings page: go to the voice search section and disable "speak answers back". "The answer can be a fact, weather condition, stock price, flight status, sports score, currency conversion, mathematical calculation, and more. Spoken answers are only supported in English at this time," informs Google.

Voice search is more useful as a Chrome feature than as a feature of the Google Search app, especially if you're already using Chrome. You don't have to open a new app and you can see the results for multiple questions because Chrome has tabs.

For some reason, Chrome for Android still includes the old voice search, but that should change in the near future.

Google's Calorie Counter

Google can now answer questions about nutrition, but it's strange to see that this feature only works if you use voice search in Android, iOS or Chrome. "You will be able to quickly and easily find extensive nutrition information for over 1,000 fruits, vegetables, meats and meals in search. From the basics of potatoes and carrots to more complex dishes like burritos and chow mein, you can simply ask, 'How much protein is in a banana?' or 'How many calories are in an avocado?' and get your answer right away," informs Google.

It works for general questions like 'how many calories are in carrots' or for queries like 'carrots calories'.

By default, Google shows the number of calories in a medium carrot, but you can pick a different serving size: 1 slice, 100 grams, 1 cup grated and more. For now, you can't enter a custom serving size.

You can also disambiguate your query. If you search "tuna calories", you can select from bluefin, skipjack and yellowfin. Unfortunately, the list is incomplete and you can't select canned tuna.

Google shows a knowledge graph card with information from Wikipedia and nutrition facts, so you can quickly find the amount of saturated fat, cholesterol, protein or vitamins and minerals without clicking a search result.

And it's not all about calories. You can also ask: 'how much protein is in an egg?', 'how much cholesterol is in chicken?', 'how much saturated fat is in butter?', 'how much sugar is in Coca Cola?', 'magnesium in an apple', 'vitamin C in parsley'.

The feature only works in English and it's gradually rolling out, so it may not work for you. Try it in Android's Google Search app, Google's app for iOS or in Chrome (click the microphone icon from the search box).

Introducing Voice Actions for Android in the UK, France, Italy, Germany and Spain

Last year in the US, we introduced Voice Actions, a series of spoken commands that let you control your Android phone or tablet with your voice. You can call businesses and contacts, send texts, browse the web and complete other common tasks, all just by speaking into your phone.

Today, we’re pleased to announce that users in the UK, France, Italy, Germany and Spain can now use Voice Actions in British English, French, Italian, German and Spanish.

To use Voice Actions, tap the microphone button on the Google search box on your home screen, open the Voice Search app, or press down for a few seconds on the physical search button on your phone to activate the “Speak Now” screen. You can see how it works in this video.

Speak any of these commands to perform a Voice Action on your phone:

• send text to [contact] [message]
• call [business]
• call [contact]
• go to [website]
• navigate to [location/business name]
• directions to [location/business name]
• map of [location]

And of course, you can still conduct a Google search using your voice.

Use Voice Actions to get directions, or send a text using just your voice

Voice Actions is available on phones and tablets running Android 2.2 and higher. If you don't have Voice Search on your phone yet, you can download it from Android Market - if you do have Voice Search, you can just start using Voice Actions.

We think Voice Actions helps you get things done on your phone faster and easier. Give it a try, and let us know what you think!

Posted by Bertrand Damiba, Product Manager

Google Adds Voice Search, Visual Search and Results Prerendering

Two of the most important Google mobile services: voice search and visual search will now be available from your computer.

Voice search, a feature that's built into Android, also works in Google Chrome and allows you to search using your voice. Chrome added support for the Speech Input API back in April and it's the only browser that implemented the API. Right now, Chrome's speech input feature is only available for English.

"We first offered speech recognition on mobile search, but you should have that power no matter where you are. You should never have to stop and ask yourself, 'Can I speak for this?' — it should be ubiquitous and intuitive. So we've added speech recognition into search on desktop for Chrome users. If you're using Chrome, you'll start to see a little microphone in every Google search box. Simply click the microphone, and you can speak your search," explains Google. The feature is gradually rolled out, so you may not see it yet.


Google Goggles is a full-fledged visual search engine that's trapped in a mobile application. But why do you have to buy a smartphone to use Google Goggles when you could simply upload an image to Google and find related pages and images on the Web? "Search by Image" does more than TinEye, the "reverse image search engine" that lets you find an image on the Web.

"Google uses computer vision techniques to match your image to other images in the Google Images index and additional image collections. From those matches, we try to generate an accurate 'best guess' text description of your image, as well as find other images that have the same content as your search image. Your search results page can show results for that text description as well as related images," mentions Google.

You can drag and drop an image to the search box, paste an image URL in the search box or click the camera icon and upload an image. Google generates a hybrid results page that shows both related images and Web search results for the equivalent text query.


Google also a developed two extensions for Chrome and Firefox that let you right-click on an image and use it as a query. "With these extensions, you can initiate a search on Google using pictures on the web. You can discover photos of places, learn more about art pieces, identify landmarks, and more."

While voice search and visual search are useful, the most impressive search feature launched by Google today is Instant Pages. The new feature only works in Chrome 13+ (available in Canary/Dev Channel and soon in beta), but it will radically improve your search experience. Chrome prerenders the top search result if it's likely that you will select it, so you no longer have to wait for the page to load. You might remember a feature called "prefetching" that was first supported by Firefox. Prerendering is a lot more powerful than prefetching.

According to a Chrome developer, "prefetch is Firefox style prefetching of resources specified (just populating the cache). In Chrome, with prerender, we don't just download the URL specified, but render the whole page including running all the JavaScript and downloading and rendering all the embedded resources."

For most users, Instant Pages will look like magic. They'll search for [nytimes] or [amazon], click the first result and be surprised to see that the page loads instantly. Google says that this feature saves 2-5 seconds on a typical search.

But Chrome's prerendering is not limited to Google searches. Any Web developer can use it by inserting a link element with a special value for the "rel" attribute. "Sometimes a site may be able to predict with reasonable accuracy which link the user is most likely to click on next -- for example, the 'next page' link in a multi-page news article. In those cases, it would be faster and better for the user if the browser could get a head start loading the next page so that when the user clicks the page is already well on its way to being loaded," suggests Google.

Word of Mouth: Introducing Voice Search for Indonesian, Malaysian and Latin American Spanish

(Read more about the launch of Voice Search in Latin American Spanish on the Google América Latina blog)

Today we are excited to announce the launch of Voice Search in Indonesian, Malaysian, and Latin American Spanish, making Voice Search available in over two dozen languages and accents since our first launch in November 2008. This accomplishment could not have been possible without the help of local users in the region - really, we couldn’t have done it without them. Let me explain:

In 2010 we launched Voice Search in Dutch, the first language where we used the “word of mouth” project, a crowd-sourcing effort to collect the most accurate voice data possible.The traditional method of acquiring voice samples is to license the data from companies who specialize in the distribution of speech and text databases. However, from day one we knew that to build the most accurate Voice Search acoustic models possible, the best data would come from the people who would use Voice Search once it launched - our users.

Since then, in each country, we found small groups of people who were avid fans of Google products and were part of a large social network, either in local communities or on online. We gave them phones and asked them to get voice samples from their friends and family. Everyone was required to sign a consent form and all voice samples were anonymized. When possible, they also helped to test early versions of Voice Search as the product got closer to launch.

Building a speech recognizer is not just limited to localizing the user interface. We require thousands of hours of raw data to capture regional accents and idiomatic speech in all sorts of recording environments to mimic daily life use cases. For instance, when developing Voice Search for Latin American Spanish, we paid particular attention to Mexican and Argentinean Spanish. These two accents are more different from one another than any other pair of widely-used accents in all of South and Central America. Samples collected in these countries were very important bookends for building a version of Voice Search that would work across the whole of Latin America. We also chose key countries such as Peru, Chile, Costa Rica, Panama and Colombia to bridge the divergent accent varieties.

As an International Program Manager at Google, I have been fortunate enough to travel around the world and meet many of our local Google users. They often have great suggestions for the products that they love, and word of mouth was created with the vision that our users could participate in developing the product. These Voice Search launches would not have been possible without the help of our users, and we’re excited to be able to work together on the product development with the people who will ultimately use our products.

Posted by Linne Ha, International Program Manager, Google Voice Search

Voice Search for Google Chrome

Voice Search is a Google Chrome extension that lets you search using your voice. It's not developed by Google, but it uses an experimental Chrome feature called form speech input. The feature is enabled by default in the dev channel builds, but it can be manually enabled by adding a command-line flag.

"Voice Search comes pre-loaded with the following default services: Google, Wikipedia, YouTube, Bing, Yahoo, DuckDuckGo and Wolfram|Alpha. You can also add your own user-defined search engines. It also integrates a speech input button for all websites using HTML5 search boxes. This extension requires a microphone. Speech input is very experimental, so don't be surprised if it doesn't work. Also, try to speak clearly for best speech recognition results," suggests the author.


Speech recognition is limited to English and it doesn't work very well, but this extension is a good way to test a feature that will be enabled in the future Chrome releases. If you have a website, it's quite easy to add support for speech input, but it may take a while until Google's Speech Input API specification becomes a standard and all browsers implement it.

{ Thanks, Silviu. }

Voice Search gets personal

When we launched Voice Search more than two years ago, we wanted it to “just work” right out of the box, without an initial setup process. And so, we built speech models broad enough to accommodate a wide variety of people, regardless of gender, age, and accents, or variations in pitch, pace, and other factors. But we always knew we could build a more accurate model by listening to your voice, and learning how you -- as a unique individual -- speak. So today we’re launching personalized recognition.

If you opt into personalized recognition, we begin to associate the recordings of the words that you ask us to recognize with your Google account. We then automatically use these words to build a speech model specifically for you. This speech model enables us to deliver greater recognition accuracy. Although subtle, accuracy improvements begin fairly quickly and will build over time.

The first time you use Voice Search, you’ll be presented with a dialog to turn on personalized recognition. Google takes your privacy seriously, so you can enable or disable personalized recognition at any time through the Google voice recognition settings on your phone. If you’d like to disassociate your voice recordings from your Google Account, you can do so through the Google Dashboard in the Speech section.

The personalized recognition functionality is currently available for English in the United States. We plan to support other countries and languages in the near future. To enable it, you must have Android 2.2 or higher, and download the latest version of the Voice Search app from Android Market. The new app also includes some improvements to name recognition and speed, especially over 3G and EDGE connections.

So go ahead and download the latest Voice Search app, and let’s get personal!

Scan this QR code to download:

Posted by Amir Mané, Product Manager and Glen Shires, Member of Technical Staff

Voice Search in Russian, Polish, Czech and Turkish

Over the past few weeks we have launched Voice Search in four new languages: Russian, Polish, Czech and Turkish. Try speaking queries like “концерты Юлии Савичевой” (tour dates for Yulia Savicheva), “przepis na pierogi” (recipes for pierogi), “obrázky Hradčan” (pictures of the Prague castle), or “istanbul hava durumu” (weather in Istanbul). Note that you can only speak one language into the app at any time and that you’ll need to change your language setting first.

Voice Search is often preloaded on new Android devices. In that case, all you have to do is press and hold the search button and then speak your query. If you have an Android (2.0 or higher) phone but don’t have Voice Search installed, download the “Voice Search” app from Android Market. If you own an iPhone or other smartphone, you can download Google Mobile App with Voice Search from m.google.com

Posted by Amir Mané, Product Manager of Google Speech Technologies

Google Shuts Down GOOG-411

Google announced that GOOG-411, the free directory assistance service launched in 2007, will be discontinued next month. GOOG-411 is available in the US and Canada, where it was launched as a free alternative to the expensive services provided by telephone companies.

The service has helped Google build a large database of voice samples and improved the voice recognition technology. Here's what Google's Marissa Mayer said about GOOG-411:

"The speech recognition experts that we have say: If you want us to build a really robust speech model, we need a lot of phonemes, which is a syllable as spoken by a particular voice with a particular intonation. So we need a lot of people talking, saying things so that we can ultimately train off of that. ... So 1-800-GOOG-411 is about that: Getting a bunch of different speech samples so that when you call up or we're trying to get the voice out of video, we can do it with high accuracy."


2007 was also the year when iPhone and Android were launched. Smartphones turned out to be better suited for voice-powered search because the service was easier to use and it could integrate with the phone. Google launched a mobile voice search app for iPhone in 2008, a built-in search app for Android in 2009, followed by voice input and voice actions this year. The mobile Google Maps app for Blackberry, Symbian and Windows Mobile added support for voice search, which now works in more than 10 languages.

Google no longer focused on GOOG-411 and decided to discontinue the service. "Our success encouraged us to aim for more innovation. Thus, we're putting all of our resources into speech-enabling the next generation of Google products and services across a multitude of languages," explained Google.

A good alternative to GOOG-411 is BING-411 (1-800-BING-411), Microsoft's service that gives you turn-by-turn driving directions, traffic conditions, and weather reports. The service is only available in the US.

Here's one of my favorite Google promotional videos:

{ Thanks, Bill. }

What you say is what you search

Many of you have searched the web by speaking since the launch of voice search in 2008. In fact, one in every four searches from an Android phone in the US is by voice. In certain situations, voice search just works much better than typing. It’s a lot faster than typing on a small phone screen. You can search things even when you don’t know the correct spelling. It’s more fun as you can share what you’re doing with your friends. And it’s safer when you’re walking around. Once you start using voice search, you start discovering all sorts of new ways to use it.

We’ve thought of a few interesting uses for voice search and made some short videos out of them. Check them out on our new YouTube channel. But we know you can do better. What are some of your most frequent or unusual voice search queries? Leave us a comment below or on our YouTube channel.



Posted by Heaven Kim, Product Marketing, Google Mobile

Introducing our new YouTube channel for Google Mobile

By now, some of you may have noticed our new Google Mobile YouTube channel, with a fresh look that includes a video box that rotates along multiple axes (we love the Rubik’s Cube here at Google). As you click on and discover more videos, we hope you’ll have fun checking out all the ways the box can turn.

In our channel’s “featured” section, we highlight some of our mobile search capabilities -- like search by voice, sight, and location -- that really help you take advantage of your phone’s unique technology. Since we understand that these represent new modes of searching for many of you, we’re going to launch some new videos that help illustrate the variety of practical and fun ways that you can use these features. To start with, check out our “Shoot This” series of videos for Google Goggles. Goggles can actually recognize much more than just bar codes and book covers, and these videos really let you take Goggles for a test drive. You can navigate through these videos by clicking on the embedded annotations to fast-forward or rewind.

When looking at “all apps,” you can not only check out any of our latest videos at a glance, but also quickly sort them by mobile platform or by app.
We’ve also made it easier for you to share videos by email or through popular social networking sites.

We hope you enjoy trying out our new Google Mobile YouTube channel. We’ll be adding many more new videos, so please visit youtube.com/googlemobile and subscribe. Also, if you’ve already subscribed to our old channel, note that you need to subscribe to the new one separately.



Posted by Heaven Kim, Product Marketing, Google Mobile

Android Voice Actions

Google updated Android's voice search application and added support for actions. In addition to searching the Web, you can now use the application to send text messages and email messages, find songs and start playing them, call your contacts and local businesses, launch Google Maps Navigation and get directions to a location, visit a site using Google's "I'm Feeling Lucky" feature and more. It's like iPhone's voice control, except that there are more actions available and you need an Internet connection to use it.

"Voice Actions are a series of spoken commands that let you control your phone using your voice. To use Voice Actions, tap the microphone button on the Google search box on your home screen, or press down for a few seconds on the physical search button on your phone to activate the Speak Now screen," explains Google.

Here are some examples of actions you can try after installing the app:
* go to Google News
* map of London
* call [name of one of your contacts]

For some reason, you can't use the built-in app to play music, so you need to install Pandora, Last.fm, Rdio or mSpot before using actions like "listen to Morcheeba". It would be nice to use voice actions to launch applications or to use custom actions defined by other applications.

The new version of the voice search application requires Android 2.2 (Froyo) and voice actions are limited to English (US). Search for [voice search] in the Android Market or use this QR code. If you're not in the US, you want to try the application and you have root access to your phone, you might need to install Market Enabler and fake your location.

Google also released:

* a new version of the Gesture Search app for Android, which adds a motion gesture for starting the application
* a new version of the Google Search widget, with support for query refinements
* Chrome to Phone, which lets you send links and short texts from Google Chrome to a phone that runs Android Froyo. If you've previously installed the Chrome extension and the associated Android app, you should first uninstall them. There's also a Firefox extension that offers similar features.

{ via Google Blog }

Just speak it: introducing Voice Actions for Android

(cross-posted with the Official Google Blog)

Our mobile phones have become modern-day Swiss Army knives. An Android phone is a handheld computer, a music player, a notepad, a GPS navigation unit and more, all rolled into one sleek device that fits in your pocket. Today’s phones do so many things for us that sometimes we don’t even think about how we do them.

Even though our phones do all these new things, the most natural way of interacting with a phone remains what it always has been: speaking. And to that end, we’re pleased to introduce Voice Actions for Android. Voice Actions are a series of spoken commands that let you control your phone using your voice. Call businesses and contacts, send texts and email, listen to music, browse the web, and complete common tasks, all just by speaking into your phone.

To use Voice Actions, tap the microphone button on the Google search box on your home screen, or press down for a few seconds on the physical search button on your phone to activate the “Speak Now” screen. Let Mike LeBeau, the lead engineer for Voice Actions, show you in this video.

(from the Google Mobile YouTube Channel)

Speak any of these commands to perform a Voice Action on your phone:

• send text to [contact] [message]
• listen to [artist/song/album]
• call [business]
• call [contact]
• send email to [contact] [message]
• go to [website]
• note to self [note]
• navigate to [location/business name]
• directions to [location/business name]
• map of [location]

And of course, you can still conduct a Google search using your voice.

While we’re at it, we’re also releasing an updated version of the Google search widget for Android. When you type a local search query, like [italian restaurants] you’ll see suggested restaurants with addresses and ratings. Also, as you type queries, you can refine them further by tapping the pencil icon that appears to the right of search suggestions.

Both Voice Actions and the new Google search widget require Android 2.2 (Froyo), and will be pre-installed with the new Droid 2 phone from Motorola and Verizon. Voice Actions are currently available for U.S. English speakers.

If you have another phone with Android 2.2 (like the Nexus One, HTC Evo or the original Droid), you’ll need to download several app updates from Android Market to get all the latest goodness:

• Voice Search (this app includes Voice Actions)
• Google Search widget
• music apps (e.g. Pandora, Last.fm, Rdio, mSpot)

To get started fast, scan the QR codes for these apps below.

We think Voice Actions help you get things done on your phone faster and easier. Give it a try, and let us know what you think!

Posted by Hugo Barra, Product Management Director, and Dave Burke, Engineering Manager

Update (1:23 PM PST): we previously had not made the below downloads available outside the US, but they are now available. Voice Actions only work with US English speakers right now.

Voice Search

Search widget

Google Search by voice: Now in Times Square!

If you've been to Times Square in New York City over the past couple weeks, on any day from 12:30-2:00pm or 6:30-8:00pm, you may have noticed that Google Search by voice is powering Times Square's largest combined displays -- the Reuters Sign and the NASDAQ sign. Anyone can call 888-376-4336 and say the name of a business or a location that they want to search for, like "museum of modern art" or "pizza". Then, the query and local search results from Google will appear on one of the two electronic billboards. This is all part of Verizon's "Droid Does" campaign and has been developed in partnership with Reuters and R/GA, a digital advertising agency.

On Black Friday, Times Square's gigantic interactive search-by-voice demo will be running for 20 hours straight. So if you're in the area and have a chance to take a break from your shopping, or if you want to see your next shopping destination displayed on a Google map on the huge signs, give the demo a try and let us know what you think. And for those of you that aren't in Manhattan on that day, you can still watch the action via webcam.

I flew out to New York last week to try it myself. R/GA gave me a behind-the-scenes tour of the setup, and I was impressed by how they pulled this off. A caller's voice is sent through the phone system, directly into a small farm of real Droids running voice search that are connected to the big outdoor electronic displays! R/GA developers made use of the Android voice recognition API just like any Android developer can.

It's been quite a ride for the search by voice team -- from launching on the iPhone about a year ago, to our launches on BlackBerry and Android, and on S60 in Mandarin Chinese, to powering billboards in Times Square. We're thankful for the chance to work on technology that excites us and that can help more of you search faster and more easily on your phone. And we hope you've been noticing the ongoing improvements in the accuracy of our voice recognition. We can't wait to show you what we have in store for next year.

Happy Thanksgiving to all!

Posted by Mike LeBeau, Senior Software Engineer

Google Search by voice travels the world, finds Nokia, learns Chinese

(cross-posted with Official Google Blog)

Google Search by voice has grown up quickly. Some might say that search by voice has matured from a toddler to a tween. It's certainly been traveling across the English-speaking world and getting better at understanding a range of accents, from the US, UK, India, and Australia. Today it's taking another big step — we're happy to announce that Google search by voice is available for Nokia S60 phones, and now understands Mandarin Chinese.

Nokia S60 phones are popular around the world. If you have an Nseries or Eseries phone such as the N95 or E71, you're using S60. Many of these phones have 12-digit keypads — good for making calls, but not so easy when you need to type a few words. Many of you have asked if we could build our search by voice feature for these phones, and we've been working on this feature for a while.

The new version of Google Mobile App places a shortcut to Google search on your Nokia phone's home screen, allowing you to search using your voice or by typing. You can search for anything — from "movie times", to "fish 'n chips", to "masala dosa." It doesn't matter if you're in London or Bangalore: we'll use your location to give you nearby results. And Google Mobile App shows search results in the application, so you don't have to wait for a web browser to launch to get an answer.

Although it has taken a little while to get this release ready, we have been planning the launch for some time as you can see from this footage from the archives.



Up until now voice search has only been available in English, but the new version of Google Mobile App for Nokia S60 devices works for Mandarin speakers, too. We're really proud of the work we've done with Mandarin speech recognition, both because it's the most spoken language in the world, and because of the engineering challenge. To get Mandarin speech recognition to work, we had to learn a lot about this fascinating language — the differences between traditional and simplified Chinese, its tonal characteristics, automatic segmentation of text into words, pinyin representations of Chinese characters, sandhi rules, the different accents and languages in China, unicode representations of Chinese character sets...the list goes on and on.

Mandarin speakers can now search by voice for complex queries like 清华大学附近的水煮鱼 (which translates to "water-boiled fish near Tsinghua University"). Although this only works on the Nokia S60 at the moment, we're working on adding support for Mandarin speech recognition to our products on other mobile platforms, such as Android and iPhone. And bear in mind that this is a first version of our system in Mandarin, and it might not be as polished as our English version. For example, if you have a strong southern Chinese accent, it might not work as well as for people with a Beijing accent. However, our system will improve over time, so please give it a try!


Google Mobile App in Mandarin Chinese

Note that the application is for version 3 of Nokia S60 - more recent phones running version 5 (touch screen) are not yet supported.

To download the new version of Google Mobile App on your Nokia S60 phone, visit m.google.com from your phone's browser. For questions and support, visit our Help Forum.

Posted by Elke Michlmayr, Software Engineer