Voice communication module for automotive instrument panel indicators based on virtual assistant open-source solution - Mycroft AI

Ricardo Hernández Mejía; Francisco Javier Ibarra Villegas; Caín Pérez Wences

doi:10.37636/recit.v6n4e328

Authors

Ricardo Hernández Mejía Posgrado CIATEQ, A.C., Av. Nodo Servidor Público #165 Col. Anexa al Club de Golf, Las Lomas, 45131 Zapopan, Jalisco, México https://orcid.org/0009-0005-2384-1464
Francisco Javier Ibarra Villegas CIATEQ, A.C. Centro de Tecnología Avanzada, Santiago de Querétaro, 76150, Querétaro, México. https://orcid.org/0000-0002-5064-8660
Caín Pérez Wences CIATEQ, A.C. Centro de Tecnología Avanzada, Santiago de Querétaro, 76150, Querétaro, México.

DOI:

https://doi.org/10.37636/recit.v6n4e328

Keywords:

Instrument panel, Virtual assistant, Voice communication module, Mycroft AI, Human centered design, User experience

Abstract

This work was originated from the increasing interest in several industries to implement voice based virtual assistant solutions powered by the Natural Language Processing field of study. This work is focused on the automotive industry Human Machine Interface related products, specifically the Instrument Panel. Nowadays people are constantly using virtual assistants like Google Assistant, Alexa, Cortana or Siri on their electronic devices. Furthermore, 31% of cars have a built-in virtual assistant, for example Ford uses Alexa, Mercedes-Benz and Hyundai use Google Assistant, BMW and Nissan use Cortana, GM uses IBM Watson, Honda uses Hana and Toyota uses YUI. Apart from the proprietary solutions described earlier, there are also contemporary open-source generic solutions available on the market, such as Mycroft AI which stands out from other technologies due to ready to deploy, well documented, simple installation on a Linux PC or RPI SoC, and simple execution. This paper presents a way to use Mycroft AI as an alternative to add artificial intelligence-based voice assistance to applications in the automotive domain. The voice communication module presented here drives notifications related to three different entities: seat belt, fuel level and battery level, all of them are telltales present in any automotive Instrument Panel. Since the Mycroft AI design approach is based on Human Centered Design (HCD), the voice communication module presented here provides real user experience (UX) based design. As a conclusion, Mycroft AI demonstrates great potential as an alternative to add voice assistance to automotive industry Human Machine Interface related products. About future work, due to the fact that Mycroft AI is based on Python, there are many possibilities for connecting and expanding the voice communication module by using countless Python libraries in order to import and process any type of information, in any format or source, for example the information from communication technologies like CAN, LIN, Ethernet, MOST, GPS or any other device or technology in order to create comprehensive automotive solutions.

Downloads

Download data is not yet available.

References

S. Arora, V. A. Athavale, H. Maggu and A. Agarwal, "Artificial Intelligence and Virtual Assistant—Working Model," in Mobile Radio Communications and 5G Networks, Singapore, 2020. DOI: https://doi.org/10.1007/978-981-15-7130-5_12

K. C. Majji and K. Baskaran, "Artificial Intelligence Analytics—Virtual Assistant in UAE Automotive Industry," in Inventive Systems and Control, Singapore, 2021. DOI: https://doi.org/10.1007/978-981-16-1395-1_24

Ford, "Amazon Alexa & Ford® | Alexa Built-In with Ford® Streaming," Ford Motor Company, 2023. [Online]. Available: https://www.ford.com/alexa/. [Accessed 17 May 2023].

M.-B. G. Media, "Mercedes-Benz delivers integration of the Google Assistant," Mercedes-Benz, 16 December 2016. [Online]. Available: https://group-media.mercedes-benz.com/marsMediaSite/en/instance/print/Mercedes-Benz-delivers-integration-of-the-Google-Assistant.xhtml?oid=15181402. [Accessed 17 May 2023].

"Send destinations, start or select the temperature of your Hyundai using Google Home and Bluelink.," Hyundai Motor America, [Online]. Available: https://owners.hyundaiusa.com/us/en/resources/blue-link/using-blue-link-with-google-home.html. [Accessed 17 May 2023].

H. Boeriu, "Microsoft CEO mentions the successful BMW integration of Alexa and Cortana," BMW Group, 24 September 2018. [Online]. Available: https://www.bmwblog.com/2018/09/24/microsoft-ceo-mentions-the-successful-bmw-integration-of-alexa-and-cortana/. [Accessed 17 May 2023].

"Nissan Intelligent Mobility: Nissan presenta su asistente virtual Cortana diseñado para facilitar la vida cotidiana de los conductores," Nissan, 17 April 2017. [Online]. Available: https://mexico.nissannews.com/es-MX/releases/nissan-intelligent-mobility-nissan-presenta-su-asistente-virtual-cortana-dise-ado-para-facilitar-la-vida-cotidiana-de-los-conductores. [Accessed 17 May 2023].

"Hello, OnStar – Meet Watson," General Motors Company, October 2016. [Online]. Available: https://news.gm.com/newsroom.detail.html/Pages/news/us/en/2016/oct/1025-watson.html. [Accessed 17 May 2023].

"Honda Introduces “Cooperative Mobility Ecosystem” at CES 2017," Honda Global, 6 January 2017. [Online]. Available: https://global.honda/newsroom/news/2017/c170106eng.html. [Accessed 17 May 2023].

"Toyota Concept-i Makes the Future of Mobility Human," Toyota Newsroom, 4 January 2017. [Online]. Available: https://pressroom.toyota.com/toyota-concept-i-future-of-mobility-human-ces-2017/. [Accessed 17 May 2023].

S. A. Friedman, P. R. Remegio, T. U. Falkenmayer, R. A. Kyle, R. Kakimi, L. D. Heide and N. N. Puranik, "Automotive Virtual Personal Assistant". Estados Unidos Patent US 2019/0311241 A1, 10 Octubre 2019.

V. Aggarwal and D. Binay, "Proactive Virtual Assistant". Estados Unidos Patent US 2020/0175386 A1, 2021.

Georg Walthart, "Mercedes-Benz presents the MBUX Hyperscreen at CES: New MBUX generation with intelligent new features such as “Mercedes Travel Knowledge”," Mercedes-Benz Group Media, 11 Enero 2021. [Online]. Available: https://group-media.mercedes-benz.com/marsMediaSite/en/instance/ko/Mercedes-Benz-presents-the-MBUX-Hyperscreen-at-CES-New-MBUX-generation-with-intelligent-new-features-such-as-Mercedes-Travel-Knowledge.xhtml?oid=48617114. [Accessed 16 09 2023].

K. Reid, "Private By Design: Free and Private Voice Assistants," makezine, 17 Marzo 2020. [Online]. Available: https://makezine.com/article/home/connected-home/private-by-design-free-and-private-voice-assistants/. [Accessed 14 Octubre 2022].

H. Mousa, "10 Top Open-source Voice Assistants Projects for Developers," MEDevel, 19 Diciembre 2018. [Online]. Available: https://medevel.com/10-open-source-voice-assistants/. [Accessed 14 Octubre 2022].

"List of Top 7 Open Source Voice Assistants," YourTechDiet, 2022. [Online]. Available: https://yourtechdiet.com/blogs/open-source-voice-assistants/. [Accessed 14 Octubre 2022].

S. Bright, "Mycroft-core Alternatives," LibHunt, 2022. [Online]. Available: https://www.libhunt.com/r/mycroft-core. [Accessed 14 Octubre 2022].

J. Montgomery, "Mycroft AI," Mycroft AI, Inc, 2015. [Online]. Available: https://mycroft.ai/. [Accessed 14 Octubre 2022].

T. Wilson, "Entrepreneurs in Consumer Electronics: Steve Penrod of Mycroft AI [Professional Development]," IEEE Consumer Electronics Magazine, vol. 8, no. 4, pp. 74-75, 2019. DOI: https://doi.org/10.1109/MCE.2019.2905542

e. a. N. H. Abdallah, "Smart Assistant Robot for Smart Home Management," in 2020 1st International Conference on Communications, Control Systems and Signal Processing (CCSSP), El Oued, Algeria, 2020. DOI: https://doi.org/10.1109/CCSSP49278.2020.9151809

Mycroft, "Why use Mycroft AI?," Mycroft, 2020. [Online]. Available: https://mycroft-ai.gitbook.io/docs/about-mycroft-ai/why-use-mycroft. [Accessed 22 Enero 2023].

C. M. University, "The CMU Pronouncing Dictionary," Carnegie Mellon University, 20 Noviembre 2014. [Online]. Available: http://www.speech.cs.cmu.edu/cgi-bin/cmudict. [Accessed 14 Octubre 2022].

C. M. University, "Pocket Sphinx," Carnegie Mellon University, 25 Marzo 2014. [Online]. Available: https://github.com/cmusphinx/pocketsphinx. [Accessed 14 Octubre 2022].

C. M. University, "CMU Sphinx," Carnegie Mellon University, 25 Marzo 2014. [Online]. Available: https://cmusphinx.github.io/. [Accessed 14 Octubre 2022].

X. Huang, F. Alleva, M.-Y. Hwang and R. Rosenfeld, "An Overview of the SPHINX-II Speech Recognition System," Proceedings of the workshop on Human Language Technology, no. HLT '93, pp. 81-86, 1993. DOI: https://doi.org/10.3115/1075671.1075690

Google, "Google Cloud STT," Google, 13 Noviembre 2013. [Online]. Available: https://cloud.google.com/speech-to-text. [Accessed 14 Octubre 2022].

Beaufays, Françoise, "The neural networks behind Google Voice transcription," Google, 11 August 2015. [Online]. Available: https://ai.googleblog.com/2015/08/the-neural-networks-behind-google-voice.html. [Accessed 06 June 2023].

"Adapt," Mycroft, 2020. [Online]. Available: https://mycroft-ai.gitbook.io/docs/mycroft-technologies/adapt. [Accessed 20 May 2023].

"Padatious," Mycroft, 2021. [Online]. Available: https://mycroft-ai.gitbook.io/docs/mycroft-technologies/padatious. [Accessed 20 May 2023].

"Mimic TTS," Myrcoft, 2022. [Online]. Available: https://mycroft-ai.gitbook.io/docs/mycroft-technologies/mimic-tts. [Accessed 20 May 2023].

"Google Text to Speech," Google Inc, [Online]. Available: https://cloud.google.com/text-to-speech?hl=es. [Accessed 20 May 2023].

D. Norman, The Design of Everyday Things, New York: Basic Books, 2013.

R. F. Dam, "The 5 Stages in the Design Thinking Process," Interaction Design Foundation, Junio 2021. [Online]. Available: https://www.interaction-design.org/literature/article/5-stages-in-the-design-thinking-process. [Accessed 14 Octubre 2022].

Mycroft AI, "Audio Troubleshooting," Mycroft AI, 16 September 2022. [Online]. Available: https://mycroft-ai.gitbook.io/docs/using-mycroft-ai/troubleshooting/audio-troubleshooting. [Accessed 16 September 2023].

U. S. Goverment, "Federal Motor Vehicle Safety Standards; Controls, Telltales and Indicators," NHTSA, 17 August 2005. [Online]. Available: https://www.federalregister.gov/documents/2005/08/17/05-16325/federal-motor-vehicle-safety-standards-controls-telltales-and-indicators. [Accessed 04 September 2022].