{"id":1433,"date":"2019-02-15T10:32:09","date_gmt":"2019-02-15T10:32:09","guid":{"rendered":"http:\/\/kusuaks7\/?p=1038"},"modified":"2023-08-23T11:20:14","modified_gmt":"2023-08-23T11:20:14","slug":"why-ai-models-absolutely-need-humans-to-stay-awesome","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/why-ai-models-absolutely-need-humans-to-stay-awesome\/","title":{"rendered":"Why AI Models badly need Humans to stay Awesome?"},"content":{"rendered":"<p><strong><em>Ready to learn Machine Learning? <a href=\"https:\/\/www.experfy.com\/training\/courses\">Browse courses<\/a>\u00a0like\u00a0<a href=\"https:\/\/www.experfy.com\/training\/courses\/robotics-application-machine-learning\">Robotics Application Machine Learning<\/a> developed by industry thought leaders and Experfy in Harvard Innovation Lab.<\/em><\/strong><\/p>\n<h5 id=\"fed7\">Companies often expect that AI models once implemented will stay\u00a0<em>smart<\/em>\u00a0and work magically, ever\u00a0after<\/h5>\n<p id=\"21b4\">Nothing can be farther from the truth.<\/p>\n<p style=\"text-align: center;\"><img decoding=\"async\" style=\"width: 700px; height: 432px;\" src=\"https:\/\/cdn-images-1.medium.com\/max\/800\/1*S3nhkuVck8GzVdwd7lzoqA.jpeg\" \/><\/p>\n<p id=\"40e7\">\u201c<em>What about self-healing algorithms or self-maintaining AI platforms<\/em>\u201d you may ask. Well, none are close to production-grade enterprise implementations today. And, it will be a while before they obviate any human intervention.<\/p>\n<p id=\"b1ce\">Business leaders often find it disappointing to learn that, a machine learning model, after consuming precious time and dollars of investment still needs humans for routine maintenance. Let\u2019s see why this is the reality today and how companies can plan for it.<\/p>\n<h4 id=\"6a96\">A Handyman\u2019s relevance in an AI\u00a0World<\/h4>\n<figure id=\"4986\"><img decoding=\"async\" src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*t3A-s2eExektSb4S48r0FQ.jpeg\" data-src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*t3A-s2eExektSb4S48r0FQ.jpeg\" \/><\/figure>\n<p style=\"text-align: center;\">Photo by\u00a0<a href=\"https:\/\/unsplash.com\/photos\/IClZBVw5W5A?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/unsplash.com\/photos\/IClZBVw5W5A?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" data->Todd Quackenbush<\/a>\u00a0on\u00a0<a href=\"https:\/\/unsplash.com\/@kesari\/likes?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/unsplash.com\/@kesari\/likes?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" data->Unsplash<\/a><\/p>\n<p id=\"7c10\">To understand why models still need humans, we\u2019ll first start with a simple English explanation of how a machine learning model works, on the inside.<\/p>\n<p id=\"04ea\">We\u2019ll then cover 4 key scenarios where models usually scream for human help, based on learnings from the work we\u2019ve done at\u00a0<a href=\"https:\/\/gramener.com\/\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/gramener.com\">Gramener<\/a>.<\/p>\n<p id=\"bfb8\">Finally, we\u2019ll conclude by listing specific steps that businesses must plan for, to fail-proof their implementations and keep their models sane and successful.<\/p>\n<h4 id=\"d9ea\">A sneak \u2014 peek into how typical ML models\u00a0work<\/h4>\n<p id=\"25da\">Let us say you are a Telecom company looking to solve the big problem of customer churn. You\u2019d like early\u00a0<em>predictive<\/em>\u00a0warnings on those customers who would migrate out in the coming month.<\/p>\n<p id=\"abee\">You duly collect a dozen data feeds about customer demographics, purchases, subscription plans, and service interactions. You hand over these 100+ attributes from the past few years, which run into millions of data points.<\/p>\n<p id=\"0388\">Data scientists spend their days and nights analyzing and making sense of all this data. They then build and engineer models that can predict, say 8 of 10 customers who would eventually leave. When piloted, this works beautifully and lets you focus on the task of retaining these customers. All is well, so far.<\/p>\n<p id=\"ed35\">Let\u2019s pause now, and unwrap this magical model to inspect its internals.<\/p>\n<figure id=\"cdf7\"><img decoding=\"async\" src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*zHc-LCs_3y7uNvOln4RfeA.jpeg\" data-src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*zHc-LCs_3y7uNvOln4RfeA.jpeg\" \/><\/figure>\n<p style=\"text-align: center;\">Photo by\u00a0Pierrick VAN-TROOST\u00a0on\u00a0<a href=\"https:\/\/unsplash.com\/?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/unsplash.com\/?utm_source=unsplash&amp;utm_medium=referral&amp;utm_content=creditCopyText\" data->Unsplash<\/a><\/p>\n<p id=\"b76c\">From the 100+ factors of customer attributes that you supplied, you\u2019d find just the key 3 to 5 used by the model. For example, these could be, \u2018<em>contract tenure\u2019<\/em>, \u2018<em>whether movies were streamed\u2019<\/em>, \u2018<em>kind of service complaints reported\u2019<\/em>, or more non-intuitive factors like \u2018<em>payment mode\u2019,\u00a0<\/em>or the \u2018<em>number of dependents\u2019<\/em>.<\/p>\n<p id=\"d7d4\">After studying the strength of all signals, algorithms usually end up using a tiny set of factors (or maybe just 1!) that are most related to customer churn.<\/p>\n<blockquote id=\"7097\"><p>The true essence of all classification models can be encapsulated as:\u00a0<strong>\u201cJust give me a, b, c and I\u2019ll tell you the chances for event z to\u00a0occur.\u201d<\/strong><\/p><\/blockquote>\n<p id=\"ba8e\">That\u2019s all a model needs, and it does just that, at the unit level.<\/p>\n<p id=\"aa1a\">No, it doesn\u2019t always crunch a million data points. No, it doesn\u2019t model the customer brain nor does it perform any eerie reading of the human psyche. And deep learning models are not an exception either.<\/p>\n<p id=\"0956\">The entire discipline of machine learning is about identifying those few factors (<em>predictors<\/em>) and then figuring out their relationship (<em>imagine a formula<\/em>) to the outcome (<em>target<\/em>).<\/p>\n<figure id=\"2d6f\"><img decoding=\"async\" src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*pZLYEuf1qimW9EqSHteadw.png\" data-src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*pZLYEuf1qimW9EqSHteadw.png\" \/><\/figure>\n<p style=\"text-align: center;\">Models \u2014 Expectations vs\u00a0Reality<\/p>\n<h4 id=\"93d5\">4 Scenarios that shake the fundamentals of a\u00a0model<\/h4>\n<p id=\"728f\">Now, you get a sense of how fragile the internals of a model can be, in spite of the apparently sophisticated facade. Unfortunately, people often assume that machines have a grounded, comprehensive understanding of the situation.<\/p>\n<p id=\"5205\">To be fair, we humans also base complex decisions on a seemingly small set of factors. However the brain has a superior ability to play with these factors, or their relative importance for a decision. Models have ample catching up to do.<\/p>\n<p id=\"e3fd\">Here are the key scenarios that call for models to get back into the classroom:<\/p>\n<h4 id=\"7dc7\"><strong>1. Change in data structures<\/strong><\/h4>\n<p id=\"cde4\">Every organization\u2019s technology landscape is continuously evolving, with application upgrades, new tool purchases, and process changes. These impact the data formats and pipelines feeding the model, needing periodic updates.<\/p>\n<h4 id=\"3273\"><strong>2. Availability of new intelligence<\/strong><\/h4>\n<p id=\"372f\">Businesses routinely discover new feeds to tap into, such as the customer\u2019s online behavior, social feeds or other contextual intelligence. The model must be re-evaluated to check if these new inputs could be stronger predictors.<\/p>\n<h4 id=\"818a\"><strong>3. Change in business\u00a0dynamics<\/strong><\/h4>\n<p id=\"d70c\">With a change in business strategies, customers could now be drawn to your company for its new rich product features, and no longer for the price economics. Shouldn\u2019t the model be taught this new dynamic to stay relevant?<\/p>\n<h4 id=\"3914\"><strong>4. Ongoing refresh and validation<\/strong><\/h4>\n<p id=\"dea2\">Assuming none of the above changes, the model still needs a health check, say every few months. The model must be re-trained with fresh data to avoid going stale, and accuracy may dip over time calling for some technical tweaks.<\/p>\n<figure id=\"8f7f\"><img decoding=\"async\" src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*0EARnzk2vSkjgBKeH7G1pw.png\" data-src=\"https:\/\/cdn-images-1.medium.com\/max\/640\/1*0EARnzk2vSkjgBKeH7G1pw.png\" \/><\/figure>\n<p style=\"text-align: center;\">Business Scenarios that call for a retooling of Machine Learning models in production<\/p>\n<h4 id=\"20b5\">What does it take to keep the models\u00a0smart?<\/h4>\n<p id=\"d10a\">Having established the need for support, here are the ways that companies can plan to keep their data science investments a.k.a machine learning models refreshed and operational:<\/p>\n<ul>\n<li id=\"ddd7\"><strong>Budget for changes:<\/strong>\u00a0We\u2019ve seen that model decay and refurbishment is as natural as the growth cycle of living things. Set aside maintenance dollars by budgeting for the total cost of model ownership, upfront.<\/li>\n<li id=\"4334\"><strong>Plan for the right talent:<\/strong>\u00a0While discovery and model development get the cheers from data scientists, maintenance is often seen as a drag. Ensure availability of the right talent to tweak and tinker with the models.<\/li>\n<li id=\"9b15\"><strong>Watch out for\u00a0<\/strong><a href=\"https:\/\/www.youtube.com\/watch?v=V18AsBIHlWs\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/www.youtube.com\/watch?v=V18AsBIHlWs\" data-><strong>technical debt<\/strong><\/a><strong>:<\/strong>\u00a0As seen in software development, models often carry the weight of past baggage. While some are unavoidable, put in place\u00a0<a href=\"https:\/\/ai.google\/research\/pubs\/pub43146\" target=\"_blank\" rel=\"noopener noreferrer\" class=\"broken_link\">model processes<\/a>\u00a0and\u00a0<a href=\"https:\/\/ai.google\/research\/pubs\/pub45742\" target=\"_blank\" rel=\"noopener noreferrer\" class=\"broken_link\">accountability<\/a>\u00a0to minimize its effect.<\/li>\n<li id=\"5763\"><strong>Create an\u00a0<\/strong><a href=\"https:\/\/www2.deloitte.com\/insights\/us\/en\/focus\/human-capital-trends\/2018\/ai-robotics-intelligent-machines.html\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"https:\/\/www2.deloitte.com\/insights\/us\/en\/focus\/human-capital-trends\/2018\/ai-robotics-intelligent-machines.html\" data-><strong>ML-aware culture<\/strong><\/a><strong>:<\/strong>\u00a0With models increasingly seen as digital workers, companies should create a culture where people co-exist and collaborate with bots, knowing where they can support each other.<\/li>\n<\/ul>\n<h4>Closing thoughts for a more Automated future<\/h4>\n<p id=\"3830\">Today, there is disproportionately large attention on the model creation and engineering phase, as opposed to model maintenance. Understandably, this is due to the data science industry still being in its infancy.<\/p>\n<p id=\"0610\">Upcoming ML advances may help solve some of these challenges. Techniques such as\u00a0<a href=\"http:\/\/www.fast.ai\/2018\/07\/16\/auto-ml2\/\" target=\"_blank\" rel=\"noopener noreferrer\" data-href=\"http:\/\/www.fast.ai\/2018\/07\/16\/auto-ml2\/\" data->AutoML<\/a>\u00a0and\u00a0<a href=\"https:\/\/towardsdatascience.com\/everything-you-need-to-know-about-automl-and-neural-architecture-search-8db1863682bf\" target=\"_blank\" rel=\"noopener noreferrer\" class=\"broken_link\">Neural Architecture Search<\/a>, though geared for model creation today, could well be adapted to keep models fit.<\/p>\n<p id=\"308e\">Business leaders must adopt a long-term outlook and plan for model upkeep and well-being, to avoid data science disillusionment. For those new to machine learning, I hope this introduction cleared up some of the confusion or perceived magical aura surrounding the world of AI and ML models.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp;Companies often expect that AI models once implemented will stay&nbsp;smart&nbsp;and work magically, ever&nbsp;after. Business leaders must adopt a long-term outlook and plan for model upkeep and well-being, to avoid data science disillusionment.&nbsp; Business leaders often find it disappointing to learn that, a machine learning model, after consuming precious time and dollars of investment still needs humans for routine maintenance. Let&rsquo;s see why this is the reality today and how companies can plan for it.<\/p>\n","protected":false},"author":315,"featured_media":3440,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[97],"ppma_author":[1994],"class_list":["post-1433","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-artificial-intelligence"],"authors":[{"term_id":1994,"user_id":315,"is_guest":0,"slug":"ganes-kesari","display_name":"Ganes Kesari","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/Ganes_Kesari-150x150.jpeg","user_url":"http:\/\/gramener.com","last_name":"Kesari","first_name":"Ganes","job_title":"","description":"Ganes Kesari is the Co-founder and Chief Decision Scientist at <a href=\"https:\/\/gramener.com\/\">Gramener<\/a>, a data science company that helps organizations present data insights as stories. He advises executives on data-driven leadership and helps organizations adopt a culture of data for decision-making. He is a TEDx speaker and Contributor to Forbes and Entrepreneur. Find his latest work <a href=\"https:\/\/gkesari.com\/\">here<\/a> and reach out to him on  <a href=\"https:\/\/www.linkedin.com\/in\/gkesari\/\">LinkedIn<\/a>, where he shares insights regularly."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1433","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/315"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=1433"}],"version-history":[{"count":5,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1433\/revisions"}],"predecessor-version":[{"id":29015,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1433\/revisions\/29015"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/3440"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=1433"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=1433"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=1433"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=1433"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}