Module 12: Voice Search & Conversational AI Patents
213+ PatentsThis module covers Google's extensive patent portfolio for voice search, speech recognition, conversational AI, and multimodal search. Voice search optimization is increasingly critical as more users search via Google Assistant and smart devices.
Overview
Google's voice search technology spans decades of innovation. This module covers:
- Voice Search & Query Processing - Core voice search systems
- Speech Recognition - Converting speech to text
- Conversational AI & Assistants - Google Assistant technology
- Natural Language Understanding - Understanding spoken queries
- Voice Query Intent - Determining user intent from voice
- Multimodal Search - Combining voice with visual input
Part 1: Voice Search & Voice Query Processing (13 Patents)
The foundation of Google's voice search capabilities.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US7027987B1 | Voice interface for a search engine | 2006 | Voice search hypotheses |
| US8768700B1 | Voice search engine interface for scoring | 2013 | Word hypothesis scoring |
| US8155956B2 | Voice query extension method | 2013 | Query extension |
| US9547647B2 | Voice-based media searching | 2016 | Media voice search |
| US20070005570A1 | Searching for content using voice | 2007 | Voice input system |
| US20200342859A1 | Disambiguating voice search query | 2020 | Voice disambiguation |
| US10346129B1 | Gamifying voice search for children | 2019 | Child-friendly voice |
| US20170068739A1 | Queryless search based on context | 2017 | Context-based voice |
| US20240289407A1 | Search with stateful chat | 2024 | Conversational chat |
| US20240256582A1 | Search with Generative AI | 2024 | Generative responses |
| WO2015090137A1 | Voice message search method | 2015 | Voice message search |
| US9396252B2 | Speech-based incremental search | 2017 | Incremental voice search |
| US20160239497A1 | Context based data searching | 2016 | Context search |
Voice Search Processing Flow
Part 2: Speech Recognition & Audio Processing (32 Patents)
Core speech recognition technology powering voice search.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US4829576A | Voice recognition system | 1989 | Foundational recognition |
| US5867817A | Speech recognition manager | 1999 | Speech decoding |
| US5937383A | Apparatus for speech recognition | 1999 | Frequent segments |
| US6418431B1 | IR and speech recognition with LMs | 2002 | Language models |
| US6456970B1 | Search network minimization | 2002 | Network optimization |
| US6633846B1 | Distributed realtime speech | 2003 | Real-time distributed |
| US7020606B1 | Voice recognition using N-gram | 2006 | N-gram models |
| US7031915 | Dual search acceleration | 2006 | Acceleration |
| US7076428B2 | Selective distributed speech | 2006 | Dialog management |
| US7398209B2 | Responding to speech commands | 2008 | NL commands |
| US7437286B2 | Voice barge-in | 2008 | Full duplex |
| US7577569B2 | Speech recognition + TTS | 2009 | Combined SR/TTS |
| US7720682B2 | Voice input for search | 2010 | Hypothesis search |
| US8005673B2 | Voice recognition device | 2011 | POI search |
| US8200486B1 | Sub-audible speech recognition | 2012 | Sub-audible signals |
| US8417530B1 | Accent-influenced search | 2013 | Accent handling |
| US9263039B2 | Responding to speech | 2015 | NL transcription |
| US9324323B1 | Topic-specific language models | 2016 | Topic LMs |
| US9633660B2 | User profiling for voice | 2017 | Voice profiles |
| US10339929B2 | Speech recognition acoustic models | 2019 | Acoustic models |
| US10360914B2 | Context and multiple modalities | 2019 | Multi-modal SR |
| US10504510B2 | Motion adaptive speech recognition | 2020 | Motion-aware |
| US11216069B2 | Neuromuscular speech recognition | 2021 | EMG sensors |
| US20080052077A1 | Multi-language speech recognition | 2008 | Multi-language |
| US20150255069A1 | Predicting pronunciation | 2015 | ASR pronunciation |
| US20240062748A1 | Age-sensitive ASR | 2024 | Age-specific |
| US20240303711A1 | Conversational interactive search | 2024 | ML conversational |
| US20170358301A1 | Whispered speech assistant | 2017 | Whisper input |
| US20230368812A1 | Speech for digital assistant | 2023 | Assistant detection |
| WO2000041165A1 | Large vocabulary search | 2000 | Vocab search |
| EP0903727A1 | Automatic speech recognition | 2000 | Auto ASR |
Part 3: Conversational AI & Assistants (24 Patents)
Google Assistant and conversational search technology.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US9548050B2 | Intelligent automated assistant | 2016 | Conversational dialog |
| US9971766B2 | Conversational agent | 2018 | NL agent |
| US10713317B2 | Conversational agent for search | 2020 | RL search agent |
| US10878479B2 | Recommendation through conversational AI | 2020 | Conversational recs |
| US11056107B2 | Conversational framework | 2021 | Framework arch |
| US11157490B2 | Conversational virtual assistant | 2021 | Virtual assistant |
| US20130246392A1 | Conversational search system | 2013 | Interactive search |
| US20180218080A1 | Conversational agent for search | 2018 | RL training |
| US20150066479A1 | Conversational agent | 2015 | NL commands |
| US7729916B2 | Conversational virtual machine | 2010 | CVM search |
| US9465833B2 | Disambiguating user intent | 2016 | Intent disambiguation |
| US20240070434A1 | Conversational knowledge base | 2024 | KB interface |
| US12197504B2 | Personalized URL prediction | 2024 | Dialogue monitoring |
| US11899714B1 | Voice conversational search | 2023 | Constraint management |
| US12067021B2 | Caching embeddings conversational | 2024 | Embedding caching |
| US20223267126A1 | Caching Historical Embeddings | 2023 | Search optimization |
| US11748559 | Auto generation conversational | 2023 | Artifact generation |
| US12288570B1 | Conversational AI for video | 2024 | Video navigation |
| US11687730B1 | Conversation goal discovery | 2023 | Neural goals |
| US11587557 | Ontology-based conversational | 2023 | Ontology org |
| US11431660B1 | Collaborative conversational AI | 2023 | Human-AI collab |
| US20240020538A1 | Real-time generative AI | 2024 | Gen AI responses |
| US20250209510A1 | Multi-facet conversational item search | 2025 | Multi-facet filtering |
Google Assistant Architecture
Part 4: Voice Assistants & Voice Control (26 Patents)
Google Home and voice-controlled device patents.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US20170329573A1 | Voice Assistant on Devices | 2017 | Device implementation |
| US9171543B2 | Voice assistant system | 2015 | Complete system |
| US10241752B2 | Virtual digital assistant UI | 2019 | Interface design |
| US10467510B2 | Intelligent assistant | 2019 | Intelligence layer |
| US11282523B2 | Voice assistant management | 2021 | Management systems |
| US10235996B2 | Voice and connection platform | 2019 | Platform arch |
| US10521189B1 | Voice assistant with user context | 2020 | User context |
| US10031722B1 | Grouping devices for voice | 2018 | Device grouping |
| US10755703B2 | Offline personal assistant | 2020 | Offline mode |
| US9304736B1 | Voice controlled with code entry | 2016 | Code entry |
| US20140222436A1 | Voice trigger digital assistant | 2014 | Wake word |
| US9098467B1 | Voice commands based on identity | 2015 | Voice ID |
| US20210104220A1 | Contextually-adjusted audio output | 2021 | Context audio |
| US20180108343A1 | Custom wake-up phrase | 2018 | Custom wake |
| US20180314689A1 | Multi-lingual virtual assistant | 2018 | Multi-lingual |
| US20070043687A1 | Virtual assistant | 2007 | Calendar/location |
| US11164577B2 | Meeting-aware prompts | 2021 | Meeting context |
| US11170286B2 | Holographic virtual assistant | 2021 | Holographic UI |
| US10948563B2 | Radar location keyword activation | 2020 | Location-aware |
| US20240013776A1 | Context-aware auto-activation | 2024 | Auto-activation |
| US20220122593A1 | User-friendly virtual voice | 2022 | UX design |
| US20110040564A1 | Activity information assistant | 2011 | Activity docs |
| WO2024020065A1 | Recommendation + voice assistant | 2024 | Rec integration |
| US20160275949A1 | Voice command for app launching | 2016 | App launch |
| EP3321928B1 | Virtual assistant operation | 2018 | Device operation |
| WO2016187149A1 | Virtual assistant in communication | 2016 | Comm sessions |
Part 5: Natural Language Understanding & Processing (31 Patents)
NLU technology for understanding spoken queries.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US7403938B2 | NL query processing | 2008 | NL automation |
| US6766320B1 | NL-based robust parsing | 2004 | Robust parsing |
| US11093488B1 | NL search with semantic mapping | 2021 | Semantic mapping |
| US10614109B2 | NLP keyword analysis | 2020 | Keyword NLP |
| US8639497B2 | NLP core | 2014 | Rule evaluation |
| US20240020116A1 | Generating NL from code | 2024 | Code-to-NL |
| US9152623B2 | NLP system and method | 2015 | Rule-based NLP |
| US7177798B2 | NL interface with IR | 2007 | IR interface |
| US7702508B2 | NLP of Query Answers | 2010 | Answer processing |
| US12008341B2 | Generating NL from code | 2024 | Code NL gen |
| US11769017B1 | Generative summaries | 2023 | NL summaries |
| US9471666B2 | Supporting NL | 2017 | NL support |
| US5963940A | NL information retrieval | 1996 | Early NL IR |
| US20190197185A1 | Intelligent NL query processor | 2019 | Intelligent NLP |
| US20110071819A1 | NL searching | 2011 | NL doc search |
| US10691685B2 | Converting NL to queries | 2020 | NL to SQL |
| US11875786B2 | NL recognition assistant | 2023 | NL commands |
| US9502025B2 | NL content dedication | 2016 | Voice NL |
| US20160162456A1 | Generating NLP systems | 2016 | NLP generation |
| US20160147878A1 | Semantic search engine | 2016 | Semantic NL |
| US5794050A | NL understanding system | 1998 | Common sense |
| US7027974B1 | Ontology-based NL parser | 2006 | Ontology NLP |
| US11727222B2 | NL document orchestrator | 2023 | Doc orchestration |
| US11398226B1 | Complex NLP | 2022 | Complex queries |
| US8594996B2 | NLP entity recognition | 2013 | NER |
| US10445432B1 | Lightweight multilingual NL | 2019 | Multi-lingual |
| US12141181B2 | Database query from NL | 2024 | NL database |
| US20200218722A1 | NLP-based searching and Q&A | 2020 | NLP Q&A |
| US20160259775A1 | Context-based NLP | 2016 | Context NLP |
| US20200167379A1 | Canonicalizing queries to NL | 2020 | Query canon |
| EP3005168A1 | NL search results for intent | 2016 | Intent NL |
Part 6: Voice Query Context & Intent Understanding (31 Patents)
Understanding what users mean when they speak.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US10540976B2 | Contextual voice commands | 2020 | Context-aware |
| US20100312547A1 | Contextual voice commands | 2010 | Early context |
| US8762469B2 | Voice command context awareness | 2014 | Device context |
| US20060136221A1 | Contextual voice UI commands | 2006 | UI context |
| US20080317219A1 | Context based voice dialing | 2008 | Voice dialing |
| US10156455B2 | Context-aware voice guidance | 2019 | Voice guidance |
| US20140032522A1 | Contextual semantic search | 2014 | Semantic context |
| US9245022B2 | Context-based person search | 2015 | Person context |
| US8762368B1 | Context-based result filtering | 2014 | Result filtering |
| US7627565B2 | Context-sensitive results | 2009 | Result org |
| US7856441B1 | Enhanced contextual search | 2010 | Enhanced context |
| US20222107802A1 | Extraquery context intent detection | 2022 | Intent detection |
| US20190026338A1 | Teachable moments contextual | 2019 | Teachable moments |
| US11081106B2 | Contextual spoken language | 2021 | Spoken dialogue |
| US11373045B2 | ML context and intent | 2021 | ML detection |
| US20140207622A1 | Intent prediction recs | 2014 | Intent prediction |
| US20140337131A1 | Keywords from voice data | 2014 | Voice keywords |
| US20170075988A1 | Automatic query resolution | 2017 | Query resolution |
| US20150088648A1 | Determining commercial intent | 2015 | Commercial intent |
| US8843470B2 | Meta classifier intent | 2014 | Meta classifier |
| US8612432B2 | Determining query intent | 2013 | Intent determination |
| US9009134B2 | Named entity in query | 2015 | NER intent |
| US10216832B2 | Underspecification of intents | 2019 | Underspec handling |
| US20190348030A1 | Audio request resolution | 2019 | Audio matching |
| US20223077874A1 | Missing slots in voice queries | 2022 | Slot filling |
| US11694682B1 | Voice control disambiguation | 2023 | Disambiguation |
| US8868548B2 | User intent from patterns | 2014 | Pattern intent |
| US6954755B2 | Task/domain segmentation | 2005 | Task segments |
| US11551004B2 | Intent discovery prototype | 2023 | Prototype intent |
| US10824818B2 | ML multi-intent slot ID | 2020 | Multi-intent |
Part 7: Multi-Modal & Voice + Visual Search (25 Patents)
Combining voice with visual input for rich search experiences.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US9292112B2 | Multimodal interface | 2016 | Speech + graphical |
| US8095364B2 | Multimodal disambiguation | 2012 | Alternate modalities |
| US9570070B2 | Multi-modal device interactions | 2017 | Multi-modal voice |
| US11257491B2 | Voice for image editing | 2021 | Voice + image |
| US20140330822A1 | Joint image-audio queries | 2014 | Image + audio |
| US20050288934A1 | Multimodal input method | 2005 | Multiple sources |
| US20240095491A1 | Personalized multimodal response | 2024 | Personalized MM |
| US20250111569A1 | Engaging multimodal content | 2025 | Content generation |
| US8073681B2 | Cooperative multimodal response | 2012 | MM output |
| US12111859B2 | Enterprise generative AI arch | 2024 | MM agents |
| US9031293B2 | Multi-modal emotion recognition | 2015 | Emotion MM |
| US12073305B2 | Deep multi-task representation | 2024 | MM events |
| US11307880B2 | Personalized contextual info | 2021 | Voice+text+image+video |
| US20110071830A1 | Lip reading + voice recognition | 2011 | Lip reading |
| US9361886B2 | Speech + non-speech data | 2016 | Combined input |
| US12039431B1 | Multimodal model interaction | 2024 | MM ML |
| US12124508B2 | Multimodal intent discovery | 2024 | Image+text intent |
| US20130090931A1 | Multimodal communication | 2013 | MM comm |
| US20170068739A1 | Context-based queryless search | 2017 | Voice+visual |
| US11908476B1 | Multi-modal memory for AI | 2024 | Speech-to-text MM |
| US20111071830A1 | Lip reading + voice MM | 2011 | Lip+voice |
| US7672931B2 | Voice + proximity search | 2010 | Proximity MM |
| US20240289407A1 | Stateful chat search | 2024 | MM queries |
Part 8: Audio Content Search & Music Search (9 Patents)
Finding content through audio inputs.
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US7680788B2 | Music search engine | 2010 | Song finding |
| US6990453B2 | Recognizing audio samples | 2005 | Audio matching |
| US20160246878A1 | Audio/video ID via fingerprints | 2016 | Fingerprinting |
| US10891948B2 | Audio signal attributes | 2021 | Background noise |
| US9794423 | Query by humming | 2018 | Humming search |
| WO2008127052A1 | Audio fingerprint search | 2008 | Fingerprint index |
| US11711648B2 | Conversation tracking audio | 2023 | Conversation detect |
| EP2463861A1 | Audio playback search | 2012 | Playback search |
| EP3430535A1 | Audio search UI | 2018 | Audio UI |
Part 9: Voice-Based Navigation & Commands (9 Patents)
| Patent | Title | Year | Key Innovation |
|---|---|---|---|
| US6618726B1 | Voice activated browser | 2003 | Voice browser |
| US8296383B2 | Voice command support | 2012 | Command capture |
| US8626511B2 | Multi-dimensional disambiguation | 2014 | Voice disambiguation |
| US9990177B2 | Visual voice-initiated action | 2016 | Visual feedback |
| US20120295708A1 | Gaze + voice input | 2012 | Gaze detection |
| US12039522B2 | Voice recognition transactions | 2024 | Voice payments |
| US9262612B2 | Voice authentication access | 2015 | Voice auth |
| US20120034904A1 | Context-aware voice monitoring | 2012 | Auto monitoring |
| US10002189B2 | Ontology-based voice search | 2018 | Local ontology |
Summary Statistics
| Category | Patent Count |
|---|---|
| Voice Search & Query Processing | 13 |
| Speech Recognition & Audio | 32 |
| Conversational AI & Assistants | 24 |
| Voice Assistants & Control | 26 |
| Natural Language Understanding | 31 |
| Voice Query Context & Intent | 31 |
| Multi-Modal Voice + Visual | 25 |
| Audio Content Search | 9 |
| Voice Navigation & Commands | 9 |
| Additional Specialized | 13 |
| TOTAL | 213+ |
Key Insights for Voice Search Optimization
1. Conversational Query Patterns
- Voice queries are longer and more conversational
- Questions are common ("How do I...", "What is the best...")
- Natural language phrasing matters more than keywords
2. Intent & Context
- Google heavily weights context in voice search
- Location, time, and device type affect results
- User history personalizes voice results
3. Featured Snippets Matter
- Voice assistants read featured snippet content
- Position zero is critical for voice search visibility
- Structured, concise answers get selected
4. Local SEO Integration
- "Near me" queries are common in voice
- Local business information must be accurate
- Google Business Profile optimization is critical
5. Schema & Structured Data
- Speakable schema helps voice selection
- FAQPage schema enables voice Q&A
- HowTo schema enables step-by-step voice instructions
Voice Search SEO Checklist
Content Structure
- Use conversational language
- Answer questions directly
- Include FAQs on relevant pages
Technical SEO
- Implement speakable schema
- Use FAQPage and HowTo schema
- Ensure fast page load (Core Web Vitals)
Local SEO
- Complete Google Business Profile
- Consistent NAP across citations
- Collect and respond to reviews
Content Optimization
- Target long-tail conversational queries
- Provide concise, direct answers
- Use natural language phrasing
Related Modules
- Module 11: Neural Networks & AI Search - AI/ML foundations
- Module 4: Query Understanding - Query processing
- Module 3: Entity & Knowledge Graph - Entity-based search
Pro Tip for Voice Search
The best content for voice search is the content that directly answers questions in a conversational, natural way. Focus on being the single best answer to common questions in your niche.