Showing posts with label search by voice. Show all posts
Showing posts with label search by voice. Show all posts
Word of Mouth: Introducing Voice Search for Indonesian, Malaysian and Latin American Spanish

Word of Mouth: Introducing Voice Search for Indonesian, Malaysian and Latin American Spanish

Donal Trung 9:36 AM Add Comment
(Read more about the launch of Voice Search in Latin American Spanish on the Google América Latina blog)

Today we are excited to announce the launch of Voice Search in Indonesian, Malaysian, and Latin American Spanish, making Voice Search available in over two dozen languages and accents since our first launch in November 2008. This accomplishment could not have been possible without the help of local users in the region - really, we couldn’t have done it without them. Let me explain:

In 2010 we launched Voice Search in Dutch, the first language where we used the “word of mouth” project, a crowd-sourcing effort to collect the most accurate voice data possible.The traditional method of acquiring voice samples is to license the data from companies who specialize in the distribution of speech and text databases. However, from day one we knew that to build the most accurate Voice Search acoustic models possible, the best data would come from the people who would use Voice Search once it launched - our users.

Since then, in each country, we found small groups of people who were avid fans of Google products and were part of a large social network, either in local communities or on online. We gave them phones and asked them to get voice samples from their friends and family. Everyone was required to sign a consent form and all voice samples were anonymized. When possible, they also helped to test early versions of Voice Search as the product got closer to launch.

Building a speech recognizer is not just limited to localizing the user interface. We require thousands of hours of raw data to capture regional accents and idiomatic speech in all sorts of recording environments to mimic daily life use cases. For instance, when developing Voice Search for Latin American Spanish, we paid particular attention to Mexican and Argentinean Spanish. These two accents are more different from one another than any other pair of widely-used accents in all of South and Central America. Samples collected in these countries were very important bookends for building a version of Voice Search that would work across the whole of Latin America. We also chose key countries such as Peru, Chile, Costa Rica, Panama and Colombia to bridge the divergent accent varieties.

As an International Program Manager at Google, I have been fortunate enough to travel around the world and meet many of our local Google users. They often have great suggestions for the products that they love, and word of mouth was created with the vision that our users could participate in developing the product. These Voice Search launches would not have been possible without the help of our users, and we’re excited to be able to work together on the product development with the people who will ultimately use our products.

Search by Voice Comes to Google Maps 4.1 for Windows Mobile and Symbian S60 phones

Donal Trung 4:30 PM Add Comment
We understand that typing on phones isn’t as easy or fast as talking into them. As a result, we’re big fans of letting you search in Google Maps for mobile in the most natural way possible -- with your voice! Not wanting the BlackBerry and Android folks to have all the fun, today we’re happy to announce Search by voice in Google Maps 4.1 on Windows Mobile and Symbian S60 phones.

Search by voice lets you easily search for anything by simply speaking your search terms instead of typing them. Just open Google Maps, press your phone’s “call” button, and clearly speak your search term like “Park Plaza.” Search by voice works with all the kinds of searches Google Maps for mobile already supports, including places, addresses (1600 Amphitheatre Parkway), specific businesses (The French Laundry), or types of businesses (sushi restaurants new york).



You may also notice a few other additions, including a redesigned settings page with Search by voice language choices. Choose your preferred language from the supported options, including multiple English accents and Mandarin Chinese. Also, if you find a problem with any information in Google Maps, you can use the “Report a problem” option to let us know.



To get started, install the latest version of Google Maps for mobile 4.1 for Windows Mobile and Symbian S60 by going to m.google.com/maps in your phone’s standard web browser (e.g. Internet Explorer on Windows Mobile). This update is available in all the countries and languages where Google Maps for mobile is currently available.

Visit our Help Center to learn more or tell us your feedback and questions in our Help Forum. Give us suggestions and vote on other people’s on the Mobile Product Ideas page.

Posted by Yuliang Wang and Yifei Zhang, Software Engineers, Google Mobile Team
Google Mobile App for iPad now available in the App Store

Google Mobile App for iPad now available in the App Store

Donal Trung 11:30 AM Add Comment
We’re pleased to announce that a new iPad-friendly version of Google Mobile App is now available in the App Store worldwide. By “iPad-friendly”, we mean that this new version has been designed to show neatly on the iPad’s screen, and that the usual features of Google Mobile App for iPhone, like search by voice and My Location, work well. From the Apps tab, you can also easily navigate to Google’s web-based apps, such as Gmail, which was recently optimized for iPad.

While this first version of Google Mobile App for iPad is essentially the same app we’ve built for iPhone, we’re working on improving Google Mobile App so that it takes advantage of iPad’s features. Stay tuned as we continue to make it and other Google products even better on this new type of device.

To download Google Mobile App to your iPad, iPhone, or iPod touch (requires OS 3.0 or higher), search for “Google Mobile App” in the App Store or just visit http://itunes.com/app/googlemobileapp.

Google Maps 4.0 for BlackBerry adds Search by Voice, Google Buzz, Starring, Labs, and More

Donal Trung 12:10 PM Add Comment

We’ve been rolling out new versions of Google Maps for mobile at a fast pace lately, and the first Google Maps for BlackBerry update of 2010 is a big one. For version 4.0, we’ve added new features to help you find places faster, post from those places with Google Buzz, star them for quick access, and more.

Search by voice
For starters, we’ve added Search by voice to all BlackBerry devices to save your overworked thumbs. Simply press and hold the green “call” button, speak your search, and see your results quickly appear without typing a single letter. Try it now for any search, like the name of my favorite hometown pizza place, “Punch Pizza in Minneapolis.” You can also search by voice for addresses like “802 Washington Avenue Southeast” or search for other another pizza place to try by speaking, “pizza restaurants.” Currently supported languages include multiple English accents and Mandarin Chinese.


Google Buzz
Google Buzz for mobile also makes its debut on BlackBerry phones in Google Maps 4.0 (see availability). Use the Google Buzz layer to see what’s going on around you or to post to the layer yourself. Check out the many ways to explore the Buzz layer in Google Maps for mobile, including sharing pictures, news, and more. From the Maps main menu, select Layers > Buzz to enable the layer; open the menu and select “Post Buzz” to add your own public post from a location or place.


Take your searches and starred places to go.
Just like in Google Maps on Android, the BlackBerry version now provides personalized search suggestions from your maps.google.com search history. If I previously searched for “Punch Pizza” at home, I can simply type “pun” into Maps on my phone to see “Punch Pizza” at the top of the suggested search terms. Make sure you’ve signed in to your Google Account (Menu > Sign In) and have Web History enabled for your account.

Signing in to your Google Account also synchronizes starred items between maps.google.com on your computer (My Maps > Starred items) and phone (Menu > Starred Items). I’ll do my heavy pizza research at home, star several pizzerias I want to try, and browse the list in Google Maps on my phone when I’m ready to eat.

Wait, there’s more!
Also check out other new features added with 4.0:
  • Use Labs to try experimental features like the Scale Bar or Terrain layer (great for hiking enthusiasts!).
  • See nearby businesses at an address or location by selecting a point from the map.
  • Report a problem with the map data or a business listing.
To get started, install the latest version of Google Maps 4.0 for BlackBerry by going to m.google.com/maps in your BlackBerry’s Internet Browser. The update for BlackBerry Enterprise Server administrators and users, including support for BlackBerry OS 5.0 phones, is available here.

Visit our Help Center to learn more or tell us your feedback and questions in our Help Forum. Give us suggestions and vote on other people’s on the Mobile Product Ideas page!

Mobile Search for a New Era: Voice, Location and Sight

Donal Trung 11:30 AM Add Comment
Editor's note: today Google held a launch event at the Computer History Museum in Mountain View, CA. Fresh off the stage, we've invited Vic to highlight the mobile team's announcements, and the unique set of technologies that make them possible. (All [video] links point to event footage that will be viewable later today.)

A New Era of Computing

Mobile devices straddle the intersection of three significant industry trends: computing (or Moore's Law), connectivity, and the cloud. Simply put:
  • Phones get more powerful and less expensive all the time
  • They're connected to the Internet more often, from more places; and
  • They tap into computational power that's available in datacenters around the world
These "Cs" aren't new: we've discussed them in isolation for over 40 years. But today's smartphones -- for the first time -- combine all three into a personal, handheld experience. We've only begun to appreciate the impact of these converged devices, but we're pretty sure about one thing: we've moved past the PC-only era, into a world where search is forever changed.

Just think: with a sensor-rich phone that's connected to the cloud, users can now search by voice (using the microphone), by location (using GPS and the compass), and by sight (using the camera). And we're excited to share Google's early contributions to this new era of computing.

Search by Voice

We first launched search by voice about a year ago, enabling millions of users to speak to Google. And we're constantly reminded that the combination of a powerful device, an Internet connection, and datacenters in the cloud is what makes it work. After all:
  • We first stream sound files to Google's datacenters in real-time
  • We then convert utterances into phonemes, into words, into phrases; and
  • We then compare phrases against Google's billions of daily queries to assign probability scores to all possible transcriptions; and
  • We do all of this in the time it takes to speak a few words
Over the past 12 months we've introduced the product on many more devices, in more languages, with vastly improved accuracy rates. And today we're announcing that search by voice understands Japanese, joining English and Mandarin.

Looking ahead, we dream of combining voice recognition with our language translation infrastructure to provide in-conversation translation [video]-- a UN interpreter for everyone! And we're just getting started.

Search by Location

Your phone's location is usually your location: it's in your pocket, in your purse, or on your nightstand, and as a result it's more personal than any PC before it. This intimacy is what makes location-based services possible, and for its part, Google continues to invest in things like My Location, real-time traffic, and turn-by-turn navigation. Today we're tackling a question that's simple to ask, but surprisingly difficult to answer: "What's around here, anyway?"

Suppose you're early to pickup your child from school, or your drive to dinner was quicker than expected, or you've just checked into a new hotel. Chances are you've got time to kill, but you don't want to spend it entering addresses, sifting through POI categories, or even typing a search. Instead you just want stuff nearby, whatever that might be. Your location is your query, and we hear you loud and clear.

Today we're announcing "What's Nearby" for Google Maps on Android 1.6+ devices, available as an update from Android Market. To use the feature just long press anywhere on the map, and we'll return a list of the 10 closest places, including restaurants, shops and other points of interest. It's a simple answer to a simple question, finally. (And if you visit google.com from your iPhone or Android device in a few weeks, clicking "Near me now" will deliver the same experience [video].)

Of course our future plans include more than just nearby places. In the new year we'll begin showing local product inventory in search results [video]; and Google Suggest will even include location-specific search terms [video]. All thanks to powerful, Internet-enabled mobile devices.

Search by Sight

When you connect your phone's camera to datacenters in the cloud, it becomes an eye to see and search with. It sees the world like you do, but it simultaneously taps the world's info in ways that you can't. And this makes it a perfect answering machine for your visual questions.

Perhaps you're vacationing in a foreign country, and you want to learn more about the monument in your field of view. Maybe you're visiting a modern art museum, and you want to know who painted the work in front of you. Or maybe you want wine tasting notes for the Cabernet sitting on the dinner table. In every example, the query you care about isn't a text string, or a location -- it's whatever you're looking at. And today we're announcing a Labs product for Android 1.6+ devices that lets users search by sight: Google Goggles.



In a nutshell, Goggles lets users search for objects using images rather than words. Simply take a picture with your phone's camera, and if we recognize the item, Goggles returns relevant search results. Right now Goggles identifies landmarks, works of art, and products (among other things), and in all cases its ability to "see further" is rooted in powerful computing, pervasive connectivity, and the cloud:
  • We first send the user's image to Google's datacenters
  • We then create signatures of objects in the image using computer vision algorithms
  • We then compare signatures against all other known items in our image recognition databases; and
  • We then figure out how many matches exist; and
  • We then return one or more search results, based on available meta data and ranking signals; and
  • We do all of this in just a few seconds
Now, with all this talk of algorithms, image corpora and meta data, you may be wondering, "Why is Goggles in Labs?" The answer -- as you might guess -- lies in both the nascence of the technology, and the scope of our ambitions.

Computer vision, like all of Google's extra-sensory efforts, is still in its infancy. Today Goggles recognizes certain images in certain categories, but our goal is to return high quality results for any image. Today you frame and snap a photo to get results, but one day visual search will be as natural as pointing a finger -- like a mouse for the real world. Either way we've got plenty of work to do, so please download Goggles from Android Market and help us get started.

The Beginning of the Beginning

All of today's mobile announcements -- from Japanese Voice Search to a new version of Maps to Google Goggles -- are just early examples of what's possible when you pair sensor-rich devices with resources in the cloud. After all: we've only recently entered this new era, and we'll have more questions than answers for the foreseeable future. But something has changed. Computing has changed. And the possibilities inspire us.