A Holographic Checklist Assistant for the Single Pilot

A Holographic Checklist Assistant for the Single Pilot
Single Pilot Operations is a topic with the potential to significantly affect the future of commercial aviation. While financially attractive for airlines, Single Pilot Operations bring forth important safety concerns, especially regarding the lack of human redundancy in the flight deck, an increased workload for the single pilot, reduced situational awareness and a higher risk of human error. It is assumed that potential problems affecting Single Pilot Operations could be addressed by implementing an Augmented Reality (AR) device in the flight deck, by presenting additional information and supporting hints within the pilot's field of view. This paper sets out to demonstrate the conduction of checklists aided by the Microsoft HoloLens. A system, called Pilot Assist, was developed that allows the pilot to conduct checklists interactively with a Microsoft HoloLens. Pilot Assist was developed and demonstrated with a fixed based Airbus A320 simulator at the Technical University of Wildau. By using the HoloLens' speech recognition and spatial mapping capabilities - scanning and recognizing the environment around the user - it is possible to trigger the execution of checklists. The user is then prompted towards the location of each checklist item in the cockpit, where information regarding necessary actions is projected. Pilot Assist is integrated with the aircraft systems, which allows to obtain aircraft status data in real time and automate the progress through the checklists. Pilots, researchers and engineers had the chance to qualitatively assess the Pilot Assist tool. the experts agreed Pilot Assist provides beneficial support during single pilot operation considering the current prototypical nature of the system. They pointed to limitations of both Pilot Assist and the HoloLens itself, but shared optimism as to how this technology and similar applications could indeed impact the future of flight operations.
Publication type:
Conference contribution
2019 Integrated Communications, Navigation and Surveillance Conference (ICNS)
Document status:
Arango, A., & Behrend, F. (2019). A Holographic Checklist Assistant for the Single Pilot 2019 Integrated Communications, Navigation and Surveillance Conference (ICNS), 5A1-1-5A1-10.
    author           = {Arango, Andrés and Behrend, Ferdinand},
    title            = {A Holographic Checklist Assistant for the Single Pilot},
    year             = {2019},
    pages            = {5A1-1-5A1-10},
    isbn             = {978-1-7281-1893-2},
    doi              = {10.1109/ICNSURV.2019.8735185},

Search this title in Google Scholar