Back to news

October 14, 2020 | International, Big data and Artifical Intelligence

Speech Recognition and AI Help Take the Pressure off Aircrew

Air accidents have decreased in recent years, but when they do occur, the crew's workload is usually at its highest level. Therefore, augmenting crew performance during high workload periods is of great importance and can help maintain flight safety.

Aircrew workloads peak when faced with a combination of unpredictable situations: meteorological conditions; high-density traffic; system failures; and flight operations like take-off, climb, descent, approach and landing. The amount of information and number of actions that need to be processed by the crew may become unmanageable, affecting flight safety. The EU-funded VOICI project addressed this threat by developing an intelligent 'natural crew assistant' for the cockpit environment. The system comprises three main technologies, namely sound recording, speech recognition and artificial intelligence. This includes a cockpit-embedded speech-processing system that understands aviation terminology, as well as an array of low-noise optical microphones and optimised array processing for it. The VOICI system also features a new and more efficient speech synthesis, adapted to aviation terminology and noise levels. For further information see the IDTechEx report on Voice, Speech, Conversation-Based User Interfaces 2019-2029: Technologies, Players, Markets.

Assessed under realistic conditions

Project partners aimed to provide a proof-of-concept demonstrator capable of listening to all communications in the cockpit, both between crew members, and between crew and air traffic control. "The VOICI system should recognise and interpret speech content, interact with the crew, and fulfil crew requests to simplify crew tasks and reduce cognitive workload," outlines project coordinator, Tor Arne Reinen.

Researchers also developed a realistic audio evaluation environment for technology experiments. This facilitated the development of the crew assistant and enabled evaluation of its performance, including the speech capture and recognition technologies for use in a noisy cockpit, together with the intelligent dialogue system with automatic speech synthesis as its main output. The audio testing environment involved a 3D physical model of a Falcon 2000S cockpit, including loudspeaker reproduction of noise recordings from a real flight. "We have demonstrated that the crew assistant is feasible under the very high noise levels of an aviation cockpit," Reinen explains.

Multiple benefits

Speech capture is achieved through both the pilot's headset and an ambient microphone array. Speech recognition using deep neural networks and the dialog system were developed explicitly for the cockpit environment and include aviation terminology and robustness to high levels of background noise. The systems function independently of cloud-based systems and employ dedicated language models for the cockpit scenario. According to Reinen, all the algorithms underlying the dialog system have been implemented and tested: from the Natural Language Understanding unit that understands natural requests to the Dialogue Core which handles the conversation flow. "Particular emphasis has been placed on the ability of the voice assistant to use contextual data," he notes. By reducing crew workload, VOICI will contribute to optimisation of operations, flight safety and crew awareness; better maintenance; reduced cost of operations; and generally higher efficiency and lower stress. "VOICI comprises both small and medium sized enterprises (SMEs) and research institutes, and cooperation within the consortium will contribute to innovation and job creation," Reinen points out.

https://www.onartificialintelligence.com/articles/21880/speech-recognition-and-ai-help-take-the-pressure-off-aircrew?rsst2id=193

On the same subject

  • L'US Army développe un concept innovant de collaboration drones – robots

    December 17, 2020

    L'US Army développe un concept innovant de collaboration drones – robots

    Afin d'accroître l'endurance et la portée de ses drones, l'US Army entend faire collaborer des essaims aériens et terrestres. Des robots pour recharger des drones. L'US Army se penche actuellement sur un concept innovant visant à faire collaborer drones et robots et ainsi accroître les performances de ses essaims de drones. Afin de pouvoir augmenter les capacités des drones déployés au sein de l'essaim, ces derniers se rendront au sol et se poseront sur des robots, qui leur serviront de plateformes de chargement. Une idée astucieuse afin de considérablement augmenter la portée et l'endurance de ces petits aéronefs. Algorithmes et intelligence artificielle. Afin de conduire ce projet, le laboratoire de recherche de l'US Army a notifié à l'université d'Illinois un accord portant sur 4 ans et un budget de recherche de 8M$. L'enjeu est notamment de pouvoir définir une intelligence artificielle assez performante afin que les drones puissent se poser en toute sécurité sur les robots au sol, et que ces derniers parviennent à suivre les aéronefs en vol. Néanmoins, de nombreux aspects sont à prendre en compte eut égard à l'environnement opérationnel dans lequel ces drones seront déployés. Ils devront conserver leur discrétion, tout en évitant les potentiels obstacles, puisque toute la manœuvre sera réalisée de façon automatique. L'aspect essaim sera également à gérer car l'ambition est de pouvoir mener une mission en continu. Il faudra donc faire alterner les drones dans les phases de chargement afin qu'il n'y ait pas d'interruption de missions. Libérer la charge mentale du soldat. A travers ce projet, l'objectif est également de soulager les soldats, aussi bien d'un point de vue opérationnel que logistique. Les militaires n'auront plus à se charger du pilotage du drone ni à gérer le niveau et le remplacement des batteries. L'ensemble se fera automatiquement et permettra aux opérationnels de se concentrer sur des t'ches à haute valeur ajoutée. https://www.air-cosmos.com/article/lus-army-dveloppe-un-concept-innovant-de-collaboration-drones-robots-23979

  • Announcement of an SBIR/STTR Opportunity

    May 22, 2020

    Announcement of an SBIR/STTR Opportunity

    Announcement of an SBIR/STTR Opportunity Under Broad Agency Announcement (BAA) HR001120S0019 Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) May 13, 2020 The DARPA Small Business Programs Office (SBPO) has pre-released the following SBIR/STTR Opportunities (SBOs): "Compact Modular Detector for Water and Food Contaminants", Announcement Number HR001120S0019-07, published at https://beta.sam.gov/search?keywords=HR001120S0019-07 "Near-Term Forecasting of Nonstationary Dynamic Processes", Announcement Number HR001120S0019-08, published at https://beta.sam.gov/search?keywords=HR001120S0019-08 "Organizational Modeling", Announcement Number HR001120S0019-09, published at https://beta.sam.gov/search?keywords=HR001120S0019-09 “Flexible Manufacturing of Fine Chemical Reagents", Announcement Number HR001120S0019-10, published at https://beta.sam.gov/search?keywords=HR001120S0019-10 These SBOs will open for proposals on May 28, 2020 and close on June 29, 2020 at 2:00pm ET

  • BIND 4.0 | Call for proposal

    July 20, 2022

    BIND 4.0 | Call for proposal

    The BIND 4.0 International Open Call for Startups to apply for the chance to put innovation into action with paid contracts with industry leaders, is now active and accepting applications! Who do we Work With? Young companies worldwide developing solutions that can be applied to the Intelligent Industry, Clean Energy & Sustainability, Health Tech and/or Food Tech sectors for our 65+ Corporate Partners based in the Basque Country, Spain. The technologies of interest are wide ranging and not limited to: AI, Cybersecurity, Big Data Analytics, IOT/IIOT, Smart Energy, AR/VR, Machine or Artificial Vision, Collaborative Robotics, Additive Manufacturing, Biobased Solutions, Clean Tech, New Materials, NanoTech, Medical Devices, Smart Sensors, etc. Why BIND 4.0 Open Innovation & Acceleration Program? It is a government sponsored initiative with 6 years of proven track record accelerating over 160 International Startups and catalyzing countless business opportunities. 45K Average Contract Amount 65+ Big Name Reference Clients High Impact Acceleration, Mentoring & Support Zero Equity Taken & No Fee to Participate Please Share our International Startup Open Call. If you'd like us to prepare something targeted to your newsletter or startup portfolio please let us know. Easily share our latest social media posts and upcoming Webinar events via the links below. Key Details and links: Startup Open Call, Accepting Applications Deadline Sep 8, 2022 BIND 4.0 Webinar Presentation with Alumni July 28, 2022 BIND 4.0 Webinar Presentation with Alumni Aug 30, 2022 BIND 4.0 2022 Program Catalogue 2022 Catalogue BIND 4.0 Website For More Resources www.BIND40.com HTML Email Open Call Announcement Link to Email Message LinkedIn Open Call Post BIND 4.0 2022 Open Call Twitter Open Call Publication BIND 4.0 2022 Open Call We Value Collaborative Partnerships. Remember, for our Collaborative Partners with relevant topics and programs, we offer event promotion via our alumni newsletter or social media, targeted startup referrals, plus networking via invitations to innovation events. Have Any Startup Recommendations? Send us a quick email with any Startups that you think could be a good fit for our immersion, acceleration and open innovation program. Send their contact info so we can reach out to them directly and fast track their application based on your referral. Startups can set up a 1:1 Meeting with us, or if you'd rather send them this Link to Apply, the application deadline is September 8th.

All news