Internship: Explainable AI for the qualification of aerospace algorithms

Background Machine learning is increasingly used in aerospace for tasks that have traditionally relied on human experts or on fixed rule-based procedures. For such tasks, data-driven algorithms promise gains in speed, consistency and sensitivity. Before they can be used in practice however, they must be qualified, which means it has to be demonstrated with sufficient substantiation that the algorithm performs its intended function reliably within a defined set of conditions. The qualification approaches used in the sector today were developed for human operators and for conventional systems whose behaviour can be traced back to explicit requirements. They do not translate directly to algorithms whose behaviour is learned from data, and emerging guidance from aviation authorities names explainability as a key ingredient of trustworthy AI, while leaving open how it should be demonstrated in practice. Performance figures on a test set do not show why an algorithm reaches a decision, whether it relies on physically meaningful information, or how it behaves outside the data it was trained on. Explainable machine learning offers a wide range of methods to address this, from feature attribution and saliency methods, to example-based and concept-based explanations, but it is still an open question which of these can provide evidence that is strong enough to support qualification. This project therefore investigates how explainability methods can contribute to the qualification of machine learning algorithms for aerospace, starting from an use case, and provides a comparative assessment of several methods. Assignment The assignment will include the following tasks: • A literature study on the qualification of machine learning algorithms in safety-critical sectors and on explainability methods for machine learning (e.g., attribution and saliency methods, example-based and concept-based explanations, interpretable models, uncertainty quantification), including the ways in which explanations themselves are evaluated. • A use case provided by NLR, for instance automated defect detection, and identification of the substantiation needed to qualify the algorithm, translated into criteria that explanations should meet. • Implementing several explainability methods for the use case and analysing them against these criteria, for example their faithfulness to the model, their robustness and their usefulness to domain experts. • Assessing how the resulting explanations can serve as evidence in the qualification of the algorithm, and formulating recommendations for the use of explainability in qualification. Results The final outcomes of this assignment will be: § A structured assessment, as part of a literature study, of explainability methods for machine learning and their suitability for qualification in aerospace, together with a justified selection of the use case. § An implementation and comparative evaluation of several explainability methods on the selected use case, with recommendations on how explainability can support the qualification of the algorithm. § A technical report, either an MSc thesis following the guidelines of your faculty or an internship report, describing the approach, results, and conclusions of the work. Duration For an MSc thesis, the standard duration of a thesis at your faculty applies (typically 9 months). For an internship, the duration is 6 months. Profile • You are an MSc student in Aerospace Engineering, Computer Science, Artificial Intelligence, Applied Mathematics or a similar master. • You have a strong background in machine learning, preferably deep learning. Knowledge of explainable AI is a plus. • You have experience with programming in Python and with machine learning libraries, for instance PyTor