{"id":3039,"date":"2023-04-10T12:33:51","date_gmt":"2023-04-10T12:33:51","guid":{"rendered":"https:\/\/nilg.ai\/?p=3039"},"modified":"2024-04-11T14:05:55","modified_gmt":"2024-04-11T14:05:55","slug":"in-medio-stat-virtus-not-always","status":"publish","type":"post","link":"https:\/\/nilg.ai\/pt\/202304\/in-medio-stat-virtus-not-always\/","title":{"rendered":"In medio stat virtus? Not always!"},"content":{"rendered":"<h3><img decoding=\"async\" class=\"wp-image-3052 aligncenter\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-1024x768.jpg\" alt=\"\" width=\"799\" height=\"599\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-1024x768.jpg 1024w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-300x225.jpg 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-768x576.jpg 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-1536x1152.jpg 1536w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-2048x1536.jpg 2048w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-1920x1440.jpg 1920w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL-600x450.jpg 600w\" sizes=\"(max-width: 799px) 100vw, 799px\" \/><\/h3>\n<h3>The Problem<\/h3>\n<p><b>What do you do when the model is underperforming?<\/b> When the models&#8217; performance does not meet our expectations, we usually spend time searching for the flaws, selecting and analyzing the cases where it failed to understand why it happened. Then, we try to apply more robust solutions, train, test, and repeat. In some cases, we succeed but in others, the model\u2019s performance does not increase, no matter how hard we try.<\/p>\n<p><b>What to do? <\/b>The temptation to give up increases with the number of failed attempts. Since trying to fix the model&#8217;s defects didn\u2019t lead to success, what about doing the opposite? Try to focus on the cases where your model succeeds. Select those cases, analyze them, and measure the value they contain. Do <b>not toss your model into the garbage bin <\/b>because it is missing some cases. Instead, <b>take advantage when it gets them right<\/b>!<\/p>\n<p>&nbsp;<\/p>\n<h3>The Solution<\/h3>\n<p>First of all, analyze your predictions! When the model is underperforming, the predictions might be distributed in two ways:<\/p>\n<ul>\n<li aria-level=\"1\"><b>Completely random<\/b>: no matter the range of scores you are selecting, the percentage of positives and negatives is similar to the global population. When this happens, the model didn\u2019t learn anything and you need to rethink the learning strategy.<img decoding=\"async\" class=\"aligncenter wp-image-3040 size-full\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Untitled-drawing2.png\" alt=\"\" width=\"809\" height=\"268\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Untitled-drawing2.png 809w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Untitled-drawing2-300x99.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Untitled-drawing2-768x254.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Untitled-drawing2-600x199.png 600w\" sizes=\"(max-width: 809px) 100vw, 809px\" \/><\/li>\n<li aria-level=\"1\"><b>Accurate at the tails and random at the center:<\/b> This is the most common case. Sometimes, the model is able to predict correctly the instances that are strong positives or strong negatives but it fails on categorizing the instances that have features correlated with both classes. I.e.<b> the model struggles to find a good boundary between classes<\/b>. If that\u2019s the case, here is the solution: instead of defining a single boundary, define 2, one for the positive tail and another for the negative tail; if the prediction score is under the negative boundary or over the positive boundary, leave it with the model, otherwise, add a human in the loop and pass it to them.<img decoding=\"async\" class=\"aligncenter wp-image-3041 size-full\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Copy-of-Untitled-drawing2.png\" alt=\"\" width=\"810\" height=\"269\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Copy-of-Untitled-drawing2.png 810w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Copy-of-Untitled-drawing2-300x100.png 300w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Copy-of-Untitled-drawing2-768x255.png 768w, https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/Copy-of-Untitled-drawing2-600x199.png 600w\" sizes=\"(max-width: 810px) 100vw, 810px\" \/><\/li>\n<\/ul>\n<p>The tails analysis should focus on two main factors:<\/p>\n<ul>\n<li aria-level=\"1\">the performance of the model on the tails &#8211; extract the visualization of the <strong>Sidekick KPI<\/strong> over the inclusion rate (the inclusion rate decreases when the positive and negative boundaries are pushed to the extremes)<\/li>\n<li aria-level=\"1\">the opportunity size on the tails &#8211; extract the visualization of the <strong>Hero KPI<\/strong>\u00a0 over the inclusion rate.<\/li>\n<\/ul>\n<div class=\"course-cta\">\n\t\t<div class=\"course-cta-img\"><img decoding=\"async\" width=\"582\" height=\"903\" src=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/08\/4-194x301@3x.png\" class=\"attachment-full size-full\" alt=\"\" srcset=\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/08\/4-194x301@3x.png 582w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/08\/4-194x301@3x-193x300.png 193w, https:\/\/nilg.ai\/wp-content\/uploads\/2022\/08\/4-194x301@3x-300x465.png 300w\" sizes=\"(max-width: 582px) 100vw, 582px\" \/><\/div>\n\t\t<div class=\"course-cta-content\"><h6>Course, Templates<\/h6><h3>Data Ignite<\/h3>\n\t\t\t<p> If <strong>Hero<\/strong> e <strong>Sidekick KPIs<\/strong> are new concepts to you, check our Data Ignite Course.<\/p>\n\t\t\t<a href=\"https:\/\/nilg.ai\/pt\/product\/data-ignite\/\" class=\"cta_btn\">Saber mais<\/a>\n\t\t<\/div>\n\t<\/div>\n<p>&nbsp;<\/p>\n<h3>The Use Cases<\/h3>\n<p>The viability of this approach depends on how you are going to integrate AI into your business. Integration of the type <b>filtering, <\/b>where the AI is used to reduce the workload that is passed to a human, any inclusion rate higher than 0% can be profitable. However, an integration of the type <b>replacing<\/b>, where the aim is to replace an existing process with an AI system, might require a higher inclusion rate to become profitable. But, when can we use it in practice?<\/p>\n<p>In <b>Healthcare<\/b>, most of the Use Cases of diagnosis support are of the type filtering. Making an autonomous AI system for disease diagnosis can be very challenging or even unrealistic since in a lot of cases specialists&#8217; opinions are not unanimous. With filtering the AI is able to screen a small segment of patients, but with high confidence in the decision, while the remaining patients are forwarded to a doctor.<\/p>\n<p><b>Hot and cold leads <\/b>are a type of use case where the hottest and coldest leads are identified to further play action on those leads or on the remaining. For example, if you are too sure that a segment of leads is going to churn, no matter what, you might avoid investing in customer service on those leads\/clients. On the other hand, if you\u2019re too sure that a lead is going to convert, you don\u2019t need to invest more resources to convince them, or you could already think of a strategy to upsell other products. Since these use cases depend on segment identification, identifying the tails is a useful and profitable strategy.<\/p>\n<p><b>Recommendation Systems <\/b>are another type of use case that can benefit from this approach. Usually, the models have a good performance when they have a history of the client but they tend to fail on new customers, without action history &#8211; <b>cold start.<\/b> When this happens, select the customer segment for which the model has a good performance and start there.<\/p>\n<p>If you think this solution is not profitable enough for your business, don\u2019t think of it as the end of the road but as the road itself. After selecting the segment where your AI is reliable, you can put the solution into production and use the cash flow it is returning to invest in data acquisition, data labeling, and deeper model exploration. This way, you\u2019ll need an initial investment to create a simple solution and the remaining investigation process can be supported by itself.<\/p>\n<p>So, keep in mind:<\/p>\n<ul>\n<li aria-level=\"1\">Bad models don\u2019t have to be useless models &#8211; explore their potential before flushing all the work you invested in them<\/li>\n<li aria-level=\"1\">Hero KPIs are much better indicators than sidekick KPIs<\/li>\n<li aria-level=\"1\">If it\u2019s still not a good end, see it as the means.<\/li>\n<\/ul>","protected":false},"excerpt":{"rendered":"<p>The Problem What do you do when the model is underperforming? When the models&#8217; performance does not meet our expectations, we usually spend time searching for the flaws, selecting and analyzing the cases where it failed to understand why it happened. Then, we try to apply more robust solutions, train, test, and repeat. In some [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":3052,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[53],"tags":[44,83,82,51,89],"class_list":["post-3039","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technical","tag-ai4business","tag-artificial-intelligence","tag-consulting","tag-healthcare","tag-recommender-system"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>In medio stat virtus? Not always! - NILG.AI<\/title>\n<meta name=\"description\" content=\"Learn how to find value and get cash-flow from models that are not achieving their goals.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nilg.ai\/pt\/202304\/in-medio-stat-virtus-not-always\/\" \/>\n<meta property=\"og:locale\" content=\"pt_PT\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"In medio stat virtus? Not always! - NILG.AI\" \/>\n<meta property=\"og:description\" content=\"Learn how to find value and get cash-flow from models that are not achieving their goals.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nilg.ai\/pt\/202304\/in-medio-stat-virtus-not-always\/\" \/>\n<meta property=\"og:site_name\" content=\"NILG.AI\" \/>\n<meta property=\"article:published_time\" content=\"2023-04-10T12:33:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-11T14:05:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2432\" \/>\n\t<meta property=\"og:image:height\" content=\"1824\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Paulo Maia\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@nilg_ai\" \/>\n<meta name=\"twitter:site\" content=\"@nilg_ai\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Paulo Maia\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutos\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/\"},\"author\":{\"name\":\"Paulo Maia\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/a860b9395bd25c5090160a3ac30e980d\"},\"headline\":\"In medio stat virtus? Not always!\",\"datePublished\":\"2023-04-10T12:33:51+00:00\",\"dateModified\":\"2024-04-11T14:05:55+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/\"},\"wordCount\":880,\"publisher\":{\"@id\":\"https:\/\/nilg.ai\/#organization\"},\"keywords\":[\"AI4business\",\"Artificial Intelligence\",\"Consulting\",\"Healthcare\",\"Recommender System\"],\"articleSection\":[\"Technical\"],\"inLanguage\":\"pt-PT\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/\",\"url\":\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/\",\"name\":\"In medio stat virtus? Not always! - NILG.AI\",\"isPartOf\":{\"@id\":\"https:\/\/nilg.ai\/#website\"},\"datePublished\":\"2023-04-10T12:33:51+00:00\",\"dateModified\":\"2024-04-11T14:05:55+00:00\",\"description\":\"Learn how to find value and get cash-flow from models that are not achieving their goals.\",\"inLanguage\":\"pt-PT\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nilg.ai\/#website\",\"url\":\"https:\/\/nilg.ai\/\",\"name\":\"NILG.AI\",\"description\":\"Create ever-improving businesses with AI\",\"publisher\":{\"@id\":\"https:\/\/nilg.ai\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nilg.ai\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"pt-PT\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/nilg.ai\/#organization\",\"name\":\"NILG.AI\",\"url\":\"https:\/\/nilg.ai\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-PT\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg\",\"contentUrl\":\"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg\",\"caption\":\"NILG.AI\"},\"image\":{\"@id\":\"https:\/\/nilg.ai\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/twitter.com\/nilg_ai\",\"https:\/\/youtube.com\/@nilg_ai\",\"https:\/\/www.linkedin.com\/company\/nilg-ai\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/a860b9395bd25c5090160a3ac30e980d\",\"name\":\"Paulo Maia\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"pt-PT\",\"@id\":\"https:\/\/nilg.ai\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9e3e7cb701fd6dcee37f7a4e9f73ef5a27f5741062c4cb179724a1052ea23086?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9e3e7cb701fd6dcee37f7a4e9f73ef5a27f5741062c4cb179724a1052ea23086?s=96&d=mm&r=g\",\"caption\":\"Paulo Maia\"},\"url\":\"https:\/\/nilg.ai\/pt\/author\/paulo\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"In medio stat virtus? Not always! - NILG.AI","description":"Learn how to find value and get cash-flow from models that are not achieving their goals.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nilg.ai\/pt\/202304\/in-medio-stat-virtus-not-always\/","og_locale":"pt_PT","og_type":"article","og_title":"In medio stat virtus? Not always! - NILG.AI","og_description":"Learn how to find value and get cash-flow from models that are not achieving their goals.","og_url":"https:\/\/nilg.ai\/pt\/202304\/in-medio-stat-virtus-not-always\/","og_site_name":"NILG.AI","article_published_time":"2023-04-10T12:33:51+00:00","article_modified_time":"2024-04-11T14:05:55+00:00","og_image":[{"width":2432,"height":1824,"url":"https:\/\/nilg.ai\/wp-content\/uploads\/2023\/04\/flat-lay-boss-sticker-mugSMALL.jpg","type":"image\/jpeg"}],"author":"Paulo Maia","twitter_card":"summary_large_image","twitter_creator":"@nilg_ai","twitter_site":"@nilg_ai","twitter_misc":{"Written by":"Paulo Maia","Est. reading time":"4 minutos"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/#article","isPartOf":{"@id":"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/"},"author":{"name":"Paulo Maia","@id":"https:\/\/nilg.ai\/#\/schema\/person\/a860b9395bd25c5090160a3ac30e980d"},"headline":"In medio stat virtus? Not always!","datePublished":"2023-04-10T12:33:51+00:00","dateModified":"2024-04-11T14:05:55+00:00","mainEntityOfPage":{"@id":"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/"},"wordCount":880,"publisher":{"@id":"https:\/\/nilg.ai\/#organization"},"keywords":["AI4business","Artificial Intelligence","Consulting","Healthcare","Recommender System"],"articleSection":["Technical"],"inLanguage":"pt-PT"},{"@type":"WebPage","@id":"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/","url":"https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/","name":"In medio stat virtus? Not always! - NILG.AI","isPartOf":{"@id":"https:\/\/nilg.ai\/#website"},"datePublished":"2023-04-10T12:33:51+00:00","dateModified":"2024-04-11T14:05:55+00:00","description":"Learn how to find value and get cash-flow from models that are not achieving their goals.","inLanguage":"pt-PT","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nilg.ai\/202304\/in-medio-stat-virtus-not-always\/"]}]},{"@type":"WebSite","@id":"https:\/\/nilg.ai\/#website","url":"https:\/\/nilg.ai\/","name":"NILG.AI","description":"Create ever-improving businesses with AI","publisher":{"@id":"https:\/\/nilg.ai\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nilg.ai\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"pt-PT"},{"@type":"Organization","@id":"https:\/\/nilg.ai\/#organization","name":"NILG.AI","url":"https:\/\/nilg.ai\/","logo":{"@type":"ImageObject","inLanguage":"pt-PT","@id":"https:\/\/nilg.ai\/#\/schema\/logo\/image\/","url":"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg","contentUrl":"https:\/\/nilg.ai\/wp-content\/uploads\/2022\/03\/logo.svg","caption":"NILG.AI"},"image":{"@id":"https:\/\/nilg.ai\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/twitter.com\/nilg_ai","https:\/\/youtube.com\/@nilg_ai","https:\/\/www.linkedin.com\/company\/nilg-ai\/"]},{"@type":"Person","@id":"https:\/\/nilg.ai\/#\/schema\/person\/a860b9395bd25c5090160a3ac30e980d","name":"Paulo Maia","image":{"@type":"ImageObject","inLanguage":"pt-PT","@id":"https:\/\/nilg.ai\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9e3e7cb701fd6dcee37f7a4e9f73ef5a27f5741062c4cb179724a1052ea23086?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9e3e7cb701fd6dcee37f7a4e9f73ef5a27f5741062c4cb179724a1052ea23086?s=96&d=mm&r=g","caption":"Paulo Maia"},"url":"https:\/\/nilg.ai\/pt\/author\/paulo\/"}]}},"_links":{"self":[{"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/posts\/3039","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/comments?post=3039"}],"version-history":[{"count":11,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/posts\/3039\/revisions"}],"predecessor-version":[{"id":3057,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/posts\/3039\/revisions\/3057"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/media\/3052"}],"wp:attachment":[{"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/media?parent=3039"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/categories?post=3039"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nilg.ai\/pt\/wp-json\/wp\/v2\/tags?post=3039"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}