Publications
-
A practical tutorial on explainable AI techniques
The past years have been characterized by an upsurge in opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although DNNs have great generalization and prediction abilities, it is difficult to obtain detailed explanations for their behavior. As opaque Machine Learning models are increasingly being employed to make important predictions in critical domains,…
-
From 3D point‐cloud data to explainable geometric deep learning: State‐of‐the‐art and future challenges
We present an exciting journey from 3D point‐cloud data (PCD) to the state of the art in graph neural networks (GNNs) and their evolution with explainable artificial intelligence (XAI), and 3D geometric priors with the human‐in‐the‐loop. We follow a simple definition of a “digital twin,” as a high‐precision, three‐dimensional digital representation of a physical object…
-
Automatic detection of color markings and numbers on trees in point clouds from Personal Laser Scanning (PLS) and Terrestrial Laser Scanning (TLS)
In forestry, colored spray paint is used for different purposes, such as marking trees that are chosen for the next harvest or that will be promoted by future silvicultural activities, or for the demarcation of skid/cable roads. Numerous studies have demonstrated the application of Terrestrial Laser Scanners (TLS) and Personal Laser Scanners (PLS) for the…
-
Post-hoc vs ante-hoc explanations: xAI design guidelines for data scientists
The growing field of explainable Artificial Intelligence (xAI) has given rise to a multitude of techniques and methodologies, yet this expansion has created a growing gap between existing xAI approaches and their practical application. This poses a considerable obstacle for data scientists striving to identify the optimal xAI technique for their needs. To address this…
-
Explainable artificial intelligence to support work safety in forestry: insights from two large datasets, open challenges, and future work
Forestry work, which is considered one of the most demanding and dangerous professions in the world, is claiming more and more lives. In a country as small as Austria, more than 50 forestry workers are killed in accidents every year, and the number is increasing rapidly. This serves as a catalyst for us to implement…
-
Reviewing the essential roles of remote phenotyping, GWAS and explainable AI in practical marker-assisted selection for drought-tolerant winter wheat breeding
Marker-assisted selection (MAS) plays a crucial role in crop breeding improving the speed and precision of conventional breeding programmes by quickly and reliably identifying and selecting plants with desired traits. However, the efficacy of MAS depends on several prerequisites, with precise phenotyping being a key aspect of any plant breeding programme. Recent advancements in high-throughput…
-
CLARUS: an interactive explainable AI platform for manual counterfactuals in graph neural networks
BackgroundLack of trust in artificial intelligence (AI) models in medicine is still the key blockage for the use of AI in clinical decision support systems (CDSS). Although AI models are already performing excellently in systems medicine, their black-box nature entails that patient-specific decisions are incomprehensible for the physician. Explainable AI (XAI) algorithms aim to “explain”…
-
Human-in-the-loop reinforcement learning: A survey and position on requirements, challenges, and opportunities
Artificial intelligence (AI) and especially reinforcement learning (RL) have the potential to enable agents to learn and perform tasks autonomously with superhuman performance. However, we consider RL as fundamentally a Human-in-the-Loop (HITL) paradigm, even when an agent eventually performs its task autonomously. View publication
-
On generating trustworthy counterfactual explanations
Deep learning models like chatGPT exemplify AI success but necessitate a deeper understanding of trust in critical sectors. Trust can be achieved using counterfactual explanations, which is how humans become familiar with unknown processes; by understanding the hypothetical input circumstances under which the output changes. We argue that the generation of counterfactual explanations requires several…
-
Be careful when evaluating explanations regarding ground truth
Evaluating explanations of image classifiers regarding ground truth, e.g. segmentation masks defined by human perception, primarily evaluates the quality of the models under consideration rather than the explanation methods themselves. Driven by this observation, we propose a framework for evaluating the robustness of safety-critical systems that a deep neural network with an explanation method. These…