{"id":965,"date":"2018-11-02T02:47:49","date_gmt":"2018-11-01T23:47:49","guid":{"rendered":"http:\/\/kusuaks7\/?p=570"},"modified":"2021-05-11T14:01:07","modified_gmt":"2021-05-11T14:01:07","slug":"visualising-machine-learning-how-do-we-humanise-the-intelligence","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/visualising-machine-learning-how-do-we-humanise-the-intelligence\/","title":{"rendered":"Visualising Machine Learning: How do we humanise the intelligence?"},"content":{"rendered":"

Ready to learn Machine Learning? Browse<\/em><\/strong> Machine Learning Training and Certification courses<\/a> developed by industry thought leaders and Experfy in Harvard Innovation Lab.<\/em><\/strong><\/p>\n

These are exciting times for data science professionals. With the rapid advances being made in analytics, specifically around machine learning, deep learning, and AI, researchers and practitioners around the world have started adapting these technologies for deep, human-impacting applications.<\/p>\n

The Age of Advanced analytics<\/h4>\n

Social talk is replete with conversations that have shifted gears from self-driving cars to flying vehicles, smart machines to robots that are already collaborating quietly in our homes, and chatbots to conversational AI which is becoming omnipresent, contextual & indistinguishable from human response.<\/p>\n

Many pride on the fact that, as a human race, we have managed to create real-time intelligence, one that hasn’t naturally evolved. With advances across disciplines, we have finally cracked several challenges in simulating human intelligence and are starting to surpass it in some areas.<\/p>\n

The great analytics divide: Salvation or Sorcery?<\/h4>\n

Interestingly, this is where public opinion across the world also starts splitting into a clear divide. At the other end of this spectrum, we have people who question the very existence and intent of AI, with deep debates on not just the trustworthiness of advanced analytics, but also on its very utility.<\/p>\n

At some level there is a sense of fear gripping most consumers. There is an eerie uncertainty around the optimistic spin being given to the areas of potential application, with questions raised on its feasibility, scale & impact.<\/p>\n

There’s a connection between the advances that are made in technology and the sense of primitive fear people develop in response to it.\u200a—\u200aDon DeLillo<\/p><\/blockquote>\n

Rapid advances in technology have always been accompanied by an escalation of fear over the past decades. While technology earlier was complex, it was perfectly rational. With deep learning & AI, we can no longer claim this, since they now surpass the realm of human logic & understanding.<\/p>\n

The Challenge of Analytics consumption<\/h4>\n

Lack of basic awareness is the biggest challenge facing the analytics discipline today, and this ranks higher than the ethical dilemmas around its adoption. As users increasingly lose grip around the understanding<\/strong> of a new technology, the noises around its perceived utility and questions of adoption get louder.<\/p>\n

While large-scale adoption of advanced analytics by end consumers is still playing out incrementally, this is already a clear and present challenge for enterprises. Notwithstanding their million-dollar investments in data science to glean intelligent insights, businesses face huge resistance from within.<\/p>\n

The biggest challenge in enterprise projects is not with model engineering or accuracy, but with the on-ground adoption of analytics applications and implementation of recommendations provided by these intelligent<\/em> models. More so, when they end up counter-intuitive to industry heuristics & gut feel.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Model accuracies from a forecasting project, where neural networks outshines other models<\/p>\n

Models with high accuracy and low acceptance<\/h4>\n

Over the years of implementing advanced analytics engagements, we<\/a> have come across way too many instances wherein, outstanding complex models (black-box) meet the engagement objective with exceptional accuracies, but fail to meet the human acceptance standards.<\/p>\n

While black-box models like Neural networks bring about a significant jump in accuracies, this is often at the cost of losing explainability and human comprehension. Contrast this with the easiness in explaining a decision tree model with intuitive if-then-else conditions and simple thresholds.<\/p>\n

However, in projects, the improvements in business benefits made possible by the complex, black-box models are too alluring to ignore. As data science practitioners, our responsibility is to bridge this divide, enable consumption of machine learning insights & gently push towards prescriptive actions.<\/p>\n

If you can’t explain it simply, you don’t understand it well enough.\u200a—\u200aAlbert Einstein<\/p><\/blockquote>\n

A Visual framework for Machine learning<\/strong><\/h4>\n

While charts are more powerful in conveying information and can prove to be far superior to a table of numbers, a visual framework can be particularly effective in humanising the intelligence from machine learning.<\/p>\n

Lets look at the 4 key elements of this visual framework which can promote easy comprehension and aid in demystifying advanced analytics models.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

A visual framework for humanizing Machine learning<\/p>\n

1. Information Design:<\/h4>\n

Visual story-telling of data is the foremost approach to present not just a table of numbers, but importantly the statistical results and interpretations of the algorithm results to arrive at prescriptive actions.<\/p>\n

A standardised approach<\/a> to information design with a user-centric approach, and by designing the right navigation workflow, pertinent representations and relevant visual design is the right place to get started on this journey.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Demonstration of how a static visual presentation can encapsulate & illustrate model results well<\/p>\n

2. Adaptive abstraction:<\/h4>\n

The most powerful way to gain insight into a system is by moving across the levels of abstraction. <\/em>Data scientists and designers instinctively move up-and-down across different levels to glean insights & lay out the solution for users.<\/p>\n

Its imperative to empower users with some fluidity, so that they can take in the bird’s eye view (abstract summaries), digest the ground-level detail and dynamically navigate across, adapted to context and user expertise.<\/p>\n

Bret Victor’s ladder of abstraction<\/em><\/a> is a useful reference, wherein he demonstrates steering around a problem by abstracting over time, algorithm and data. Applying this in a contextual, domain-driven way can demystify the analytical solution by shining light on the underlying design approach.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Bret Victor’s ladder of abstraction<\/em><\/a> with a toy car example as a walk-through<\/em><\/p>\n

3. Model unravelling<\/h4>\n

Equally important in the journey of onboarding users is providing them a sneak peak into the model internals, albeit in a non-overwhelming way. While it still befuddles humanity on how algorithms like Neural networks learn or map data to the desired output, research<\/a> is fast progressing in this area.<\/p>\n

There are several early<\/a> attempts<\/a> at unpacking the internal sequence of steps in deep learning, particularly in areas such as classification and image recognition. Keeping the user safe from toxic<\/em> statistical jargons<\/em>, if we can unzip the model and enable simple traceability to the outputs, this can go a long way in making people appreciate the beauty of these black-box models.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

A powerful methodology<\/a> for classification models; Distill has setup a prize<\/a> for outstanding work in this area<\/p>\n

4. User interactivity:<\/h4>\n

User interactivity can be that powerful glue in stitching together various elements of this framework. It enables a visual storytelling interface that promotes meaningful user-journeys across the levels of abstraction, to understand the salience and operation of a machine learning model.<\/p>\n

By making all user interactions consistent, perceivable, learnable and predictable, the entire experience can be turned around from one which is doubt-inducing to something that can be meaningful & awe-inspiring.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Case study<\/a>: What-if modelling (move the sliders) for prescriptive action, enabled in a Visual causal analysis<\/p>\n

Summary<\/h4>\n

While the data science and AI disciplines go through exciting and exhilarating advances, its important to keep the user’s expectations and experiences in perspective. This is very critical since a sizeable segment of target AI users are fast getting alienated with deepening disconnect and distrust.<\/p>\n

It doesn’t need a big dash of imagination in bridging this gap. Many of the enablers needed to build user trust and promote understanding are already available in our toolkit, and research in the field is quickly unraveling the rest.<\/p>\n

What’s needed is an acknowledgment of this divide and a conscious effort to address it by adapting the above visual framework along with the constituent 4 key aspects, while implementing machine learning solutions.<\/p>\n","protected":false},"excerpt":{"rendered":"

While the data science and AI disciplines go through exciting and exhilarating advances, it’s important to keep the user’s expectations and experiences in perspective. This is very critical since a sizeable segment of target AI users are fast getting alienated with deepening disconnect and distrust. What’s needed is an acknowledgment of this divide and a conscious effort to address it by adapting the above visual framework along with the constituent 4 key aspects, while implementing machine learning solutions.<\/p>\n","protected":false},"author":315,"featured_media":3384,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[97],"ppma_author":[1994],"class_list":["post-965","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-artificial-intelligence"],"authors":[{"term_id":1994,"user_id":315,"is_guest":0,"slug":"ganes-kesari","display_name":"Ganes Kesari","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/Ganes_Kesari-150x150.jpeg","user_url":"http:\/\/gramener.com","last_name":"Kesari","first_name":"Ganes","job_title":"","description":"Ganes Kesari is the Co-founder and Chief Decision Scientist at Gramener<\/a>, a data science company that helps organizations present data insights as stories. He advises executives on data-driven leadership and helps organizations adopt a culture of data for decision-making. He is a TEDx speaker and Contributor to Forbes and Entrepreneur. Find his latest work here<\/a> and reach out to him on LinkedIn<\/a>, where he shares insights regularly."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/965","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/315"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=965"}],"version-history":[{"count":1,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/965\/revisions"}],"predecessor-version":[{"id":6043,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/965\/revisions\/6043"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/3384"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=965"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=965"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=965"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=965"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}