{"id":1047,"date":"2020-11-24T11:06:45","date_gmt":"2020-11-24T11:06:45","guid":{"rendered":"https:\/\/nilg.ai\/?p=1047"},"modified":"2022-10-06T15:00:41","modified_gmt":"2022-10-06T15:00:41","slug":"explainable-ai-in-healthcare","status":"publish","type":"post","link":"https:\/\/nilg.ai\/en_us\/202011\/explainable-ai-in-healthcare\/","title":{"rendered":"Explainable AI in Healthcare"},"content":{"rendered":"<p><img decoding=\"async\" class=\"aligncenter wp-image-1050 size-large\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/pexels-tara-winstead-8386434-1024x683.jpg\" alt=\"\" width=\"1024\" height=\"683\" \/><\/p>\n<p><span style=\"font-weight: 400;\">Transparency is of utmost importance when AI is applied to high stake decision problems where additional information on the underlying process beyond the output of the model may be required. Taking the automation of loan attribution as an example, a client that has a loan denied will surely want to know why did that happen and how it could have been avoided.\u00a0 In this blogpost, we give you some examples of algorithms for Explainable AI, with a focus on Healthcare. This is the first part of our special \u201cAI in Healthcare\u201d month where we give special focus to the state of the art applications of Artificial Intelligence in Health.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">This kind of insight may not be as easy to obtain as one would think, given that the main issue of deep learning models is that there is a lack of explicit representation of knowledge, even when the technical principles of the models are understood, thus the rising interest in explainable AI.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Furthermore, official regulations such as the General Data Protection Regulation (GDPR and ISO\/IEC 27001) were created in the EU for ensuring that the widespread of automation techniques, such as deep neural networks, is made in a trustworthy manner hampering their use in business carelessly. This does not mean that these approaches have to explain every aspect in every moment, instead, the results should be traced back by demand, as explained <\/span><a href=\"https:\/\/arxiv.org\/pdf\/1803.07517.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">here<\/span><\/a><span style=\"font-weight: 400;\">.\u00a0<\/span><\/p>\n<div class=\"course-cta\">\n\t\t<div class=\"course-cta-img\"><img decoding=\"async\" width=\"388\" height=\"602\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/09\/2-194x301@2x.png\" class=\"attachment-full size-full\" alt=\"\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/09\/2-194x301@2x.png 388w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/09\/2-194x301@2x-193x300.png 193w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/09\/2-194x301@2x-300x465.png 300w\" sizes=\"(max-width: 388px) 100vw, 388px\" \/><\/div>\n\t\t<div class=\"course-cta-content\"><h6>Course<\/h6><h3>The ABCs of Machine Learning<\/h3>\n\t\t\t<p>Master the fundamental ML concepts in our free course.<\/p>\n\t\t\t<a href=\"https:\/\/nilg.ai\/en_us\/product\/the-abcs-of-machine-learning\/\" class=\"cta_btn\">Learn More<\/a>\n\t\t<\/div>\n\t<\/div>\n<h2><span style=\"font-weight: 400;\">State of the art<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Despite the lack of a term definition within the field, the main idea is that there are two different types of understanding: <\/span><b>understandability<\/b><span style=\"font-weight: 400;\"> and <\/span><b>interpretability<\/b><span style=\"font-weight: 400;\"> are related to the functional understanding of a certain model, providing the expert user with insights of the &#8220;black box&#8221; model. On the other hand, <\/span><b>explainability<\/b><span style=\"font-weight: 400;\"> is related to providing the average user with a high-level algorithmic information allowing him to answer questions like &#8220;Why?&#8221; and not directly related with the &#8220;How?&#8221;.\u00a0<\/span><\/p>\n<p><img decoding=\"async\" class=\"aligncenter wp-image-1512\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image6-1024x675-1.png\" alt=\"\" width=\"600\" height=\"416\" \/><\/p>\n<p style=\"text-align: center;\"><span style=\"font-weight: 400;\">Scheme of a truly explainable AI model extracted from <\/span><a href=\"https:\/\/arxiv.org\/abs\/1710.00794\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">here<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An interesting notion was introduced by <\/span><a href=\"https:\/\/arxiv.org\/abs\/1710.00794\" target=\"_blank\" rel=\"noopener\"><i><span style=\"font-weight: 400;\">Doran et al<\/span><\/i><\/a><i><span style=\"font-weight: 400;\">., <\/span><\/i><span style=\"font-weight: 400;\">\u00a0defending that a truly explainable model not only provides a decision and an explanation, but is also able to integrate reasoning. In the figure, the model should be able to classify the provided image as a\u00a0<\/span><span style=\"font-weight: 400;\">&#8220;factory&#8221; because it contains certain elements and afterwards provides reasoning supporting the decision: the association between the elements and the label should be made in an organized way, and not post classification. By this example one can easily see that in this ideal model both the \u201chow?<\/span><i><span style=\"font-weight: 400;\">\u201d<\/span><\/i><span style=\"font-weight: 400;\"> and the \u201cwhy?\u201d are presented.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Explainable models can be divided in <\/span><i><span style=\"font-weight: 400;\">Post-hoc <\/span><\/i><span style=\"font-weight: 400;\">and <\/span><i><span style=\"font-weight: 400;\">Ante-hoc <\/span><\/i><span style=\"font-weight: 400;\">(or <\/span><i><span style=\"font-weight: 400;\">in-model<\/span><\/i><span style=\"font-weight: 400;\"> techniques). The application of the first methods are done in a trained model, fitting explanations (e.g. saliency maps), whereas the latter ones are intrinsic to the model, (e.g. decision trees) as explained in the work of <\/span><a href=\"https:\/\/arxiv.org\/abs\/1712.09923\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Holzinger et al<\/span><\/a><span style=\"font-weight: 400;\">.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The table contains some examples of techniques that are currently being used. For simplicity, only visual data will be considered and one example of each group will be detailed, so that the reader gets a clearer picture of what can be achieved.\u00a0 There is a lot more done of what was discussed here, for example, <\/span><a href=\"https:\/\/arxiv.org\/pdf\/2005.13799.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Singh et al.<\/span><\/a><span style=\"font-weight: 400;\"> made a review on the methods currently being used to enhance the transparency of deep learning models applied to the medical image analysis.<\/span><\/p>\n<table>\n<tbody>\n<tr>\n<th>Post-hoc<\/th>\n<th>Ante-hoc<\/th>\n<\/tr>\n<tr>\n<td>Activation Maximization<\/td>\n<td>Attention-based models<\/td>\n<\/tr>\n<tr>\n<td>Layer-wise propagation<\/td>\n<td>Part-based models<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2><span style=\"font-weight: 400;\">Activation Maximization<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Activation Maximization visualizes the preferred inputs of certain neurons in each layer. This is done by finding the input pattern that leads to a <\/span><b>maximum activation of a certain neuron<\/b><span style=\"font-weight: 400;\"> (each input pixel is changed until the maximum is achieved). The process is iterative and starts by a random input image that is updated. The gradients can be computed using back-propagation, while maintaining constant the parameters learnt by the convolutional neural network. This way, each pixel of the initial noisy images are iteratively<\/span><\/p>\n<p style=\"text-align: center;\"><span style=\"font-weight: 400;\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-1514\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image2-1024x518-1.png\" alt=\"\" width=\"1024\" height=\"518\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image2-1024x518-1.png 1024w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image2-1024x518-1-300x152.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image2-1024x518-1-768x389.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image2-1024x518-1-600x304.png 600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/>Image extracted from <\/span><a href=\"https:\/\/arxiv.org\/pdf\/1602.03616.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">here<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">changed to maximise the activation of the considered neuron until the preferred pattern image is reached. As we can see by the image, obtained from the work of <\/span><a href=\"https:\/\/arxiv.org\/pdf\/1602.03616.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Nguyen et al.<\/span><\/a><span style=\"font-weight: 400;\">, the image on the right corresponds to an abstract representation of the pool tables that achieves the most activation within the network. <\/span><a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7259808\/#r18\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Reyes et al.<\/span><\/a><span style=\"font-weight: 400;\"> concentrated their efforts on the current state of the art regarding explainable AI and radiology. In their work they showcase how techniques like this, and others can be employed.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Layer-wise Relevance Propagation<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Layer-wise Relevance Propagation (LRP) represents by heatmaps the <\/span><b>contribution that each pixel has in the output, for the case of kernel based models<\/b><span style=\"font-weight: 400;\">. This decomposition is rooted in a series of constraints to guarantee that the heatmap is realistic and consistent.\u00a0 It can be formally given as representing the output by the sum of relevances for each pixel, in the input layer. These relevances can be computed in a chain-like mechanism where the total of relevances in a certain previous layer equals the total of relevances in the next layer. This also implies a constraint in the decomposition, ensuring that the total relevance remains constant from the output layer to the input layer, meaning that no relevance is forfeited or generated.\u00a0<\/span><\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-1515\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image3-1024x254-1.png\" alt=\"\" width=\"1024\" height=\"254\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image3-1024x254-1.png 1024w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image3-1024x254-1-300x74.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image3-1024x254-1-768x191.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image3-1024x254-1-600x149.png 600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">For more examples and detail on this technique, see the work of <\/span><a href=\"https:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0130140\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Bach et al.<\/span><\/a><span style=\"font-weight: 400;\"> from which this image was picked. This technique was recently applied by <\/span><a href=\"https:\/\/arxiv.org\/pdf\/2004.04582.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Karim et al.<\/span><\/a><span style=\"font-weight: 400;\"> on convolutional neural networks applied to X-ray images of lungs for COVID-19 detection.<\/span><\/p>\n<h2><span style=\"font-weight: 400;\">Attention Models<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Attention Models are methods based on the human vision system and its focal perception and processing of objects, though they are not exclusive to computer vision problems by having applications in Natural Language Processing, Statistical Learning and Speech (see <\/span><a href=\"https:\/\/arxiv.org\/pdf\/1904.02874.pdf\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Chaudhari et al<\/span><\/a><span style=\"font-weight: 400;\">. for more on attention models and examples of them). Attention models provide a way to enhance neural network interpretability while, in some cases, reducing the computational cost by selecting certain parts from the input.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Nowadays, there are already approaches that take advantage of this idea. For example, <\/span><a href=\"https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0167865520301240\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Rio-Torto et al.<\/span><\/a><span style=\"font-weight: 400;\"> proposed a network that contains both a Classifier and an Explainer. The explainer gives higher weight to the classification on the relevant parts of the input, as can be seen in the image below, (extracted from their work), where the zebra stripes are highlighted.<\/span><\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-1516\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image7.png\" alt=\"\" width=\"709\" height=\"582\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image7.png 709w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image7-300x246.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image7-600x493.png 600w\" sizes=\"(max-width: 709px) 100vw, 709px\" \/><\/p>\n<p>&nbsp;<\/p>\n<h2><span style=\"font-weight: 400;\">Part based networks<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Part based networks are a recent architecture that is based in the human way of explaining an image in a classification task based on <\/span><b>parts that are similar to what we<\/b><span style=\"font-weight: 400;\">, throughout our experiences,<\/span><b> have previously seen<\/b><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Prototypical part network is an ante-hoc technique capable of obtaining explanations alongside the predictions proposed by <\/span><a href=\"https:\/\/arxiv.org\/pdf\/1602.03616.pdf\" target=\"_blank\" rel=\"noopener\"><i><span style=\"font-weight: 400;\">Chen et al.<\/span><\/i><\/a><span style=\"font-weight: 400;\">. However, the explanations are in reality the sub-product of the prototypes activation on the network&#8217;s input. These prototypes are latent representations of some input part, from a certain class, in which the decision was based on <\/span><span style=\"font-weight: 400;\">considering a weight combination of these scores that will dictate the class at which the image belongs to<\/span><span style=\"font-weight: 400;\">. In the original classification task, and following the scheme below, one can see that in the prototype layer each of the prototypes are from a part of a bird, the first one is the head of a clay coloured sparrow whereas the second one is the head of a Brewer\u2019s sparrow. This means that the network learned, for example, that the head of a clay coloured sparrow is a distinctive pattern of its specific class, and that if the input image is similar to the patterns within the prototype then it will positively contribute to the classification of the image.<\/span><\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-1517\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image1-1.png\" alt=\"\" width=\"928\" height=\"369\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image1-1.png 928w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image1-1-300x119.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image1-1-768x305.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image1-1-600x239.png 600w\" sizes=\"(max-width: 928px) 100vw, 928px\" \/><\/p>\n<h2><span style=\"font-weight: 400;\">Practical case study &#8211; Explainable AI applied to epilepsy<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">During my MSc Dissertation, I worked with the <\/span><a href=\"https:\/\/www.utwente.nl\/en\/tnw\/cnph\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Clinical Neurophysiology Group<\/span><\/a><span style=\"font-weight: 400;\">, from the University of Twente, on the automation of the explainable diagnosis of epilepsy by deep learning models. It is also worth mentioning Prof. <\/span><a href=\"https:\/\/www.linkedin.com\/in\/luisfteixeira\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Lu\u00eds Teixeira<\/span><\/a><span style=\"font-weight: 400;\"> who gave crucial guidance during my work.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Epilepsy is a neurological disorder that affects more than 50 million people worldwide whose diagnosis is based on electroencephalography (EEG) &#8211; recording of brain electrical activity. The current clinical practice includes the analysis of the EEG recordings by trained neurologists to identify abnormal patterns associated with seizures, characterized by high frequency abnormalities in the EEG signals. <\/span><span style=\"font-weight: 400;\">However, this visual analysis, apart from being subjective, is extremely laborious as it requires highly trained neurophysiologists to go through EEG signals that may have hours of recording.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A major hindrance with the application of deep learning models in healthcare is that they are often seen as &#8220;black boxes&#8221;, despite their high performance. Consequently, they provide little to no insight of the processes underlying the decision, which in the medical context is not acceptable. To tackle this, two explainable approaches were used for seizure detection where the models not only identified which portions of the signals were the most probable of having abnormal patterns but which regions contributed the most to this decision (visual explanations).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The approaches used were the two previous ones described, the Classifier and Explainer network (C&amp;E), and the Prototype part network (ProtoPNet). Both approaches were evaluated with respect to the classification task and the explanations provided, which were directly compared to those of experts. Below we can see the EEG signals from a multi-channel montage and the overlapped explanations where the high spike regions are the most highlighted. The similarity with the explanations provided by the experts tells us that indeed both networks were able to provide relevant insights by correctly suggesting seizure related patterns associated with the decision of the model.<\/span><\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-1518\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image5-1024x679-1.png\" alt=\"\" width=\"1024\" height=\"679\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image5-1024x679-1.png 1024w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image5-1024x679-1-300x199.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image5-1024x679-1-768x509.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/image5-1024x679-1-600x398.png 600w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<h2><span style=\"font-weight: 400;\">Conclusion<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">With the diffusion of machine learning models throughout different businesses and fields, an increase in the number of works done in explainable AI is also seen in the literature. High stake decisions are the main focus of these models, as they often require more than a decision, or prediction, to be accepted and employed safely in the desired environment, such as in this example with Epilepsy. However, one can also use these approaches in several other AI domains, to help understand really what is driving your decisions. If you have some reservations on applying AI to your business feel free to discuss with us this kind of more transparent approach and how it could help you!<\/span><\/p>\n  \n\n <div class=\"author-cta\">\n\t\t<div class=\"author-cta-img\">\n\t\t    \n\t\t    <img decoding=\"async\" width=\"1920\" height=\"1332\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692.jpg\" class=\"attachment-full size-full\" alt=\"\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692.jpg 1920w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692-300x208.jpg 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692-1024x710.jpg 1024w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692-768x533.jpg 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692-1536x1066.jpg 1536w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/06\/DSC01670_edit-rotated-e1668721000692-600x416.jpg 600w\" sizes=\"(max-width: 1920px) 100vw, 1920px\" \/>\t\t    <\/div>\n\n<div class=\"author-cta-content\">\n\t<h3>Do you want to further discuss this idea?<\/h3><p>Book a meeting with <strong>Francisca Morgado<\/strong><\/p>\t<a class=\"cta_btn\" onclick=\"Calendly.showPopupWidget('');return false;\"  \n\">Meet Francisca<\/a>\n\t\t\t\n\t<a href=\"https:\/\/nilg.ai\/en_us\/?post_type=team&p=1334\" class=\"author-cta-link\">Learn More<\/a>\n\t\t\t<\/div>\n\t<\/div>\n\n<h2><span style=\"font-weight: 400;\">References<\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Ras, Gabri\u00eblle, Marcel van Gerven, and Pim Haselager. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/1803.07517.pdf\" target=\"_blank\" rel=\"noopener\">Explanation methods in deep learning: Users, values, concerns and challenges.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">Explainable and Interpretable Models in Computer Vision and Machine Learning<\/span><\/i><span style=\"font-weight: 400;\">. Springer, Cham, 2018. 19-36.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Doran, Derek, Sarah Schulz, and Tarek R. Besold. &#8220;<a href=\"https:\/\/arxiv.org\/abs\/1710.00794\" target=\"_blank\" rel=\"noopener\">What does explainable AI really mean? A new conceptualization of perspectives.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:1710.00794<\/span><\/i><span style=\"font-weight: 400;\"> (2017).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Holzinger, Andreas, et al. &#8220;<a href=\"https:\/\/arxiv.org\/abs\/1712.09923\" target=\"_blank\" rel=\"noopener\">What do we need to build explainable AI systems <\/a><\/span><span style=\"font-weight: 400;\">for<\/span><span style=\"font-weight: 400;\"> the medical domain?.&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:1712.09923<\/span><\/i><span style=\"font-weight: 400;\"> (2017).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Singh, Amitojdeep, Sourya Sengupta, and Vasudevan Lakshminarayanan. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/2005.13799.pdf\" target=\"_blank\" rel=\"noopener\">Explainable deep learning models in medical image analysis.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:2005.13799<\/span><\/i><span style=\"font-weight: 400;\"> (2020).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Nguyen, Anh, Jason Yosinski, and Jeff Clune. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/1602.03616.pdf\" target=\"_blank\" rel=\"noopener\">Multifaceted feature visualization: Uncovering the different types of features learned by each neuron in deep neural networks.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:1602.03616<\/span><\/i><span style=\"font-weight: 400;\"> (2016).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Reyes, Mauricio, et al. &#8220;<a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC7259808\/#r18\" target=\"_blank\" rel=\"noopener\">On the Interpretability of Artificial Intelligence in Radiology: Challenges and Opportunities.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">Radiology: Artificial Intelligence<\/span><\/i><span style=\"font-weight: 400;\"> 2.3 (2020): e190043.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Bach, Sebastian, et al. &#8220;<a href=\"https:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0130140\" target=\"_blank\" rel=\"noopener\">On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">PloS one<\/span><\/i><span style=\"font-weight: 400;\"> 10.7 (2015): e0130140.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Karim, Md, et al. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/2004.04582.pdf\" target=\"_blank\" rel=\"noopener\">Deepcovidexplainer: Explainable covid-19 predictions based on chest x-ray images.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:2004.04582<\/span><\/i><span style=\"font-weight: 400;\"> (2020).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Chaudhari, Sneha, et al. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/1904.02874.pdf\" target=\"_blank\" rel=\"noopener\">An attentive survey of attention models.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">arXiv preprint arXiv:1904.02874<\/span><\/i><span style=\"font-weight: 400;\"> (2019).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Rio-Torto, Isabel, Kelwin Fernandes, and Luis F. Teixeira. &#8220;<a href=\"https:\/\/www.sciencedirect.com\/science\/article\/abs\/pii\/S0167865520301240\" target=\"_blank\" rel=\"noopener\">Understanding the decisions of CNNs: an in-model approach<\/a>.&#8221; <\/span><i><span style=\"font-weight: 400;\">Pattern Recognition Letters<\/span><\/i><span style=\"font-weight: 400;\"> (2020).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Chen, Chaofan, et al. &#8220;<a href=\"https:\/\/arxiv.org\/pdf\/1806.10574.pdf\" target=\"_blank\" rel=\"noopener\">This looks like that: deep learning for interpretable image recognition.<\/a>&#8221; <\/span><i><span style=\"font-weight: 400;\">Advances in neural information processing systems<\/span><\/i><span style=\"font-weight: 400;\">. 2019.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Transparency is of utmost importance when AI is applied to high stake decision problems where additional information on the underlying process beyond the output of the model may be required. Taking the automation of loan attribution as an example, a client that has a loan denied will surely want to know why did that happen [&hellip;]<\/p>\n","protected":false},"author":45,"featured_media":1050,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[53],"tags":[69,51,45],"class_list":["post-1047","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technical","tag-explainable-ml","tag-healthcare","tag-machine-learning"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Explainable AI in Healthcare - NILG.AI<\/title>\n<meta name=\"description\" content=\"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nilg.ai\/en_us\/202011\/explainable-ai-in-healthcare\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Explainable AI in Healthcare - NILG.AI\" \/>\n<meta property=\"og:description\" content=\"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nilg.ai\/en_us\/202011\/explainable-ai-in-healthcare\/\" \/>\n<meta property=\"og:site_name\" content=\"NILG.AI\" \/>\n<meta property=\"article:published_time\" content=\"2020-11-24T11:06:45+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-10-06T15:00:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/pexels-tara-winstead-8386434-e1653486783807.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"1365\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Pedro Dias\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@nilg_ai\" \/>\n<meta name=\"twitter:site\" content=\"@nilg_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Pedro Dias\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"10 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/\"},\"author\":{\"name\":\"Pedro Dias\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/719d26ecfa254d530d9623cf8802e574\"},\"headline\":\"Explainable AI in Healthcare\",\"datePublished\":\"2020-11-24T11:06:45+00:00\",\"dateModified\":\"2022-10-06T15:00:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/\"},\"wordCount\":1945,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/nilg.ai\/#organization\"},\"keywords\":[\"Explainable ML\",\"Healthcare\",\"Machine Learning\"],\"articleSection\":[\"Technical\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/\",\"url\":\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/\",\"name\":\"Explainable AI in Healthcare - NILG.AI\",\"isPartOf\":{\"@id\":\"https:\/\/nilg.ai\/#website\"},\"datePublished\":\"2020-11-24T11:06:45+00:00\",\"dateModified\":\"2022-10-06T15:00:41+00:00\",\"description\":\"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nilg.ai\/#website\",\"url\":\"https:\/\/nilg.ai\/\",\"name\":\"NILG.AI\",\"description\":\"Create ever-improving businesses with AI\",\"publisher\":{\"@id\":\"https:\/\/nilg.ai\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nilg.ai\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/nilg.ai\/#organization\",\"name\":\"NILG.AI\",\"url\":\"https:\/\/nilg.ai\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg\",\"contentUrl\":\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg\",\"caption\":\"NILG.AI\"},\"image\":{\"@id\":\"https:\/\/nilg.ai\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/twitter.com\/nilg_ai\",\"https:\/\/youtube.com\/@nilg_ai\",\"https:\/\/www.linkedin.com\/company\/nilg-ai\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/719d26ecfa254d530d9623cf8802e574\",\"name\":\"Pedro Dias\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/c38b5b7be44090dff631654042cfbb7bca20c902addfff39068328589ede3ba5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/c38b5b7be44090dff631654042cfbb7bca20c902addfff39068328589ede3ba5?s=96&d=mm&r=g\",\"caption\":\"Pedro Dias\"},\"url\":\"https:\/\/nilg.ai\/en_us\/author\/pedro\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Explainable AI in Healthcare - NILG.AI","description":"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nilg.ai\/en_us\/202011\/explainable-ai-in-healthcare\/","og_locale":"en_US","og_type":"article","og_title":"Explainable AI in Healthcare - NILG.AI","og_description":"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.","og_url":"https:\/\/nilg.ai\/en_us\/202011\/explainable-ai-in-healthcare\/","og_site_name":"NILG.AI","article_published_time":"2020-11-24T11:06:45+00:00","article_modified_time":"2022-10-06T15:00:41+00:00","og_image":[{"width":2048,"height":1365,"url":"https:\/\/nilg.ai\/wp-content\/uploads\/2020\/11\/pexels-tara-winstead-8386434-e1653486783807.jpg","type":"image\/jpeg"}],"author":"Pedro Dias","twitter_card":"summary_large_image","twitter_creator":"@nilg_ai","twitter_site":"@nilg_ai","twitter_misc":{"Written by":"Pedro Dias","Est. reading time":"10 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/#article","isPartOf":{"@id":"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/"},"author":{"name":"Pedro Dias","@id":"https:\/\/nilg.ai\/#\/schema\/person\/719d26ecfa254d530d9623cf8802e574"},"headline":"Explainable AI in Healthcare","datePublished":"2020-11-24T11:06:45+00:00","dateModified":"2022-10-06T15:00:41+00:00","mainEntityOfPage":{"@id":"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/"},"wordCount":1945,"commentCount":0,"publisher":{"@id":"https:\/\/nilg.ai\/#organization"},"keywords":["Explainable ML","Healthcare","Machine Learning"],"articleSection":["Technical"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/","url":"https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/","name":"Explainable AI in Healthcare - NILG.AI","isPartOf":{"@id":"https:\/\/nilg.ai\/#website"},"datePublished":"2020-11-24T11:06:45+00:00","dateModified":"2022-10-06T15:00:41+00:00","description":"A review of the main approaches in Explainable AI and a practical use case in the healthcare industry: explainable Epilepsy detection models.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nilg.ai\/202011\/explainable-ai-in-healthcare\/"]}]},{"@type":"WebSite","@id":"https:\/\/nilg.ai\/#website","url":"https:\/\/nilg.ai\/","name":"NILG.AI","description":"Create ever-improving businesses with AI","publisher":{"@id":"https:\/\/nilg.ai\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nilg.ai\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/nilg.ai\/#organization","name":"NILG.AI","url":"https:\/\/nilg.ai\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nilg.ai\/#\/schema\/logo\/image\/","url":"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg","contentUrl":"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg","caption":"NILG.AI"},"image":{"@id":"https:\/\/nilg.ai\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/twitter.com\/nilg_ai","https:\/\/youtube.com\/@nilg_ai","https:\/\/www.linkedin.com\/company\/nilg-ai\/"]},{"@type":"Person","@id":"https:\/\/nilg.ai\/#\/schema\/person\/719d26ecfa254d530d9623cf8802e574","name":"Pedro Dias","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nilg.ai\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/c38b5b7be44090dff631654042cfbb7bca20c902addfff39068328589ede3ba5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/c38b5b7be44090dff631654042cfbb7bca20c902addfff39068328589ede3ba5?s=96&d=mm&r=g","caption":"Pedro Dias"},"url":"https:\/\/nilg.ai\/en_us\/author\/pedro\/"}]}},"_links":{"self":[{"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/posts\/1047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/users\/45"}],"replies":[{"embeddable":true,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/comments?post=1047"}],"version-history":[{"count":9,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/posts\/1047\/revisions"}],"predecessor-version":[{"id":2505,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/posts\/1047\/revisions\/2505"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/media\/1050"}],"wp:attachment":[{"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/media?parent=1047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/categories?post=1047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nilg.ai\/en_us\/wp-json\/wp\/v2\/tags?post=1047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}