{"id":10763,"date":"2020-10-28T10:31:19","date_gmt":"2020-10-28T10:31:19","guid":{"rendered":"https:\/\/www.experfy.com\/blog\/?p=10763"},"modified":"2023-10-16T14:17:34","modified_gmt":"2023-10-16T14:17:34","slug":"whose-fault-is-it-when-ai-makes-mistakes","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/whose-fault-is-it-when-ai-makes-mistakes\/","title":{"rendered":"Whose Fault Is It When AI Makes Mistakes?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"10763\" class=\"elementor elementor-10763\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-5072097d elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"5072097d\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-a952649\" data-id=\"a952649\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-84d2010 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"84d2010\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-7ca363f\" data-id=\"7ca363f\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-a049328 elementor-widget elementor-widget-text-editor\" data-id=\"a049328\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Don\u2019t get me wrong, I love <a href=\"http:\/\/bit.ly\/quaesita_emperor\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">machine learning and AI<\/a>. But I don\u2019t trust them blindly and neither should you, because the way you build effective and reliable <a href=\"http:\/\/bit.ly\/quaesita_emperor\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">ML\/AI<\/a>solutions is to force each solution to <strong><em>earn<\/em><\/strong> your trust.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-894db34 elementor-widget elementor-widget-text-editor\" data-id=\"894db34\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><em>(Much of the advice in this article also applies to data insights and models made without ML\/AI, especially the very last paragraph.)<\/em><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-c810330 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"c810330\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-bc7aef9\" data-id=\"bc7aef9\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ea2112c elementor-widget elementor-widget-text-editor\" data-id=\"ea2112c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><\/p>\n<p class=\"is-layout-flow wp-block-quote-is-layout-flow\"><blockquote class=\"wp-block-quote\"><\/p>\n<p><p>Blind trust is a terrible thing.<\/p><\/p>\n<p><\/blockquote><\/p>\n<p><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-43f4541 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"43f4541\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-f7fe1b2\" data-id=\"f7fe1b2\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-6aad2c4 elementor-widget elementor-widget-text-editor\" data-id=\"6aad2c4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Before you start thinking that this has anything to do with robots or sci-fi, stop! <a href=\"http:\/\/bit.ly\/quaesita_emperor\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">ML\/AI<\/a>systems aren\u2019t humanlike, they\u2019re <href=\"http:\/\/bit.ly\/quaesita_simplest\" target=\"_blank\" rel=\"noreferrer noopener\">just useful thing labelers<\/a> with poetic names. Instead, their untrustworthiness comes from somewhere else entirely. I think it\u2019s best to show not tell, so let\u2019s see a <a href=\"http:\/\/bit.ly\/quaesita_unsupervised1\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">familiar example<\/a>\u2026<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-6aa3bf7 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"6aa3bf7\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-ec6f815\" data-id=\"ec6f815\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-0e21381 elementor-widget elementor-widget-image\" data-id=\"0e21381\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-1024x768.jpeg\" class=\"attachment-large size-large wp-image-33452\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-1024x768.jpeg 1024w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-300x225.jpeg 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-768x576.jpeg 768w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-1536x1152.jpeg 1536w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-610x458.jpeg 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-750x563.jpeg 750w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1-1140x855.jpeg 1140w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_QXk-5v4IQq06P_kFtiI2qw-1.jpeg 1920w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-2419878 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"2419878\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-0a918a1\" data-id=\"0a918a1\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-82f47b8 elementor-widget elementor-widget-heading\" data-id=\"82f47b8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Setting the scene for wishful thinking<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-42772ac elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"42772ac\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-6c9804c\" data-id=\"6c9804c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7f80a79 elementor-widget elementor-widget-text-editor\" data-id=\"7f80a79\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Welcome back to our cats, whom you might have <a href=\"http:\/\/bit.ly\/quaesita_unsupervisedimg\" target=\"_blank\" rel=\"noreferrer noopener\">already met<\/a> when we built a classifier to split my original dataset of six photos into two groups.<\/p><\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-dd401e2 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"dd401e2\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-25f535a\" data-id=\"25f535a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-fb935e8 elementor-widget elementor-widget-image\" data-id=\"fb935e8\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"528\" height=\"365\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_qZ0K8_atP_HvWv2vsjw5Hg.png\" class=\"attachment-large size-large wp-image-33453\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_qZ0K8_atP_HvWv2vsjw5Hg.png 528w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_qZ0K8_atP_HvWv2vsjw5Hg-300x207.png 300w\" sizes=\"(max-width: 528px) 100vw, 528px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-bcc50dd elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"bcc50dd\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-309c6b3\" data-id=\"309c6b3\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-5316d0f elementor-widget elementor-widget-text-editor\" data-id=\"5316d0f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Would you look at that? My amazing <a href=\"http:\/\/bit.ly\/quaesita_simplest\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">magical machine learning system<\/a> succeeded in returning the exact results I was hoping for!<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-1cc8be8 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"1cc8be8\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-7528462\" data-id=\"7528462\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-9468186 elementor-widget elementor-widget-image\" data-id=\"9468186\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"888\" height=\"415\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ.png\" class=\"attachment-large size-large wp-image-33454\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ.png 888w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ-300x140.png 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ-768x359.png 768w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ-610x285.png 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_CASi5zfagbE-I0-55rYaLQ-750x351.png 750w\" sizes=\"(max-width: 888px) 100vw, 888px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-2294173 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"2294173\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-487acc2\" data-id=\"487acc2\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-95919bb elementor-widget elementor-widget-text-editor\" data-id=\"95919bb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Bingo! These were two individual cats and the <a href=\"http:\/\/bit.ly\/quaesita_slkid\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">model<\/a> returns their labels perfectly, making me misty-eyed with parental pride at my clever classifybot. This means I\u2019ve just built a Tesla and Huxley Classifier!!! \u2026Right?<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-0bf5053 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0bf5053\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-22c0eaa\" data-id=\"22c0eaa\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-96dccf2 elementor-widget elementor-widget-heading\" data-id=\"96dccf2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Our minds play tricks on us<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-3def78c elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"3def78c\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-e5d9694\" data-id=\"e5d9694\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-f9d3d09 elementor-widget elementor-widget-text-editor\" data-id=\"f9d3d09\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Not so fast! That\u2019s our human wishful thinking playing tricks on us again. I got so emotionally caught up in my kitties that I might not have noticed that all the Tesla photos have a radiator in the background and all the Huxley photos don\u2019t. Did you notice it? Look again.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-934197d elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"934197d\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-4d757ed\" data-id=\"4d757ed\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-48b78b0 elementor-widget elementor-widget-image\" data-id=\"48b78b0\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"799\" height=\"373\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g.png\" class=\"attachment-large size-large wp-image-33455\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g.png 799w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g-300x140.png 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g-768x359.png 768w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g-610x285.png 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_a7gwykP-EskNgE2uhCHt_g-750x350.png 750w\" sizes=\"(max-width: 799px) 100vw, 799px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-c5f6504 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"c5f6504\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-cb863dd\" data-id=\"cb863dd\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1f4ccab elementor-widget elementor-widget-heading\" data-id=\"1f4ccab\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Cat detector or radiator detector?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-d967c8f elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"d967c8f\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-91672f8\" data-id=\"91672f8\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-a11663c elementor-widget elementor-widget-text-editor\" data-id=\"a11663c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>My solution\u2014 unbeknownst to me \u2014 is actually a radiator detector, not a Hux\/Tes detector. Testing with new examples has a reputation for being helpful, so let\u2019s see if we catch the problem that way\u2026<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-ab2032a elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"ab2032a\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-de3a79a\" data-id=\"de3a79a\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-efd4bc5 elementor-widget elementor-widget-image\" data-id=\"efd4bc5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"718\" height=\"346\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_vFjRF49yyXg3bZK_F_yTfA.png\" class=\"attachment-large size-large wp-image-33456\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_vFjRF49yyXg3bZK_F_yTfA.png 718w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_vFjRF49yyXg3bZK_F_yTfA-300x145.png 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/1_vFjRF49yyXg3bZK_F_yTfA-610x294.png 610w\" sizes=\"(max-width: 718px) 100vw, 718px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-5aa2808 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"5aa2808\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-ffa3bb9\" data-id=\"ffa3bb9\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-396c8d4 elementor-widget elementor-widget-text-editor\" data-id=\"396c8d4\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Even if I tested it out on new data by showing it these new photos, there wouldn\u2019t be so much as a peep of an alert. Oh dear. Is that a problem?<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cc979e7 elementor-widget elementor-widget-text-editor\" data-id=\"cc979e7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Not <strong> <em>if<\/em> <\/strong> Tes is <strong><em> always<\/em> <\/strong> photographed with a radiator and Hux <strong> <em> always<\/em> <\/strong> isn\u2019t. If that\u2019s the case, who cares how it works? It <strong> <em> always<\/em><\/strong> works. It\u2019ll give the right cat every time. There\u2019s no problem.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0705fbb elementor-widget elementor-widget-text-editor\" data-id=\"0705fbb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>That was a big if. What if the cats move to another apartment (true story)? What if you inherit my classifier without my notes and use it on your photos?<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5073c8a elementor-widget elementor-widget-text-editor\" data-id=\"5073c8a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>In those cases, the label returned will be \u201cHuxley\u201d and any mission-critical systems relying on my Hux\/Tes Detector will crash and burn horribly.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-5bd6fcb elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"5bd6fcb\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1012650\" data-id=\"1012650\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-34ac7cd elementor-widget elementor-widget-image\" data-id=\"34ac7cd\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"864\" height=\"574\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6.jpeg\" class=\"attachment-large size-large wp-image-33457\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6.jpeg 864w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6-300x199.jpeg 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6-768x510.jpeg 768w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6-610x405.jpeg 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_e-OeFDLG7JCpXyL6-750x498.jpeg 750w\" sizes=\"(max-width: 864px) 100vw, 864px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-ff23c45 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"ff23c45\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-bfd82f5\" data-id=\"bfd82f5\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-e11690c elementor-widget elementor-widget-heading\" data-id=\"e11690c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Whose fault is it?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-032aa18 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"032aa18\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-9e8d548\" data-id=\"9e8d548\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-54b1c7e elementor-widget elementor-widget-text-editor\" data-id=\"54b1c7e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>While the fires rage, let\u2019s do a quick autopsy:<\/p>\n\n<ul class=\"wp-block-list\">\n<li><em>As is common with\u00a0AI, the recipe converting pixels into labels is<\/em><a href=\"http:\/\/bit.ly\/quaesita_simplest\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"><em>\u00a0too complicated to wrap my head around<\/em><\/a><em>.<\/em><\/li>\n<li><em>All I observe is the inputs (pixels) and the outputs (Hux \/ Tes label).<\/em><\/li>\n<li><em>Because I\u2019m\u00a0<\/em><a href=\"http:\/\/bit.ly\/conf_bias\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"><em>human<\/em><\/a><em>, I don\u2019t notice things that are right under my nose (radiator and Tes always coincide).<\/em><\/li>\n<li><em>The story I tell myself about how the inputs relate to the outputs is not only oversimplified, it\u2019s also skewed away from the radiator explanation by\u00a0<\/em><a href=\"http:\/\/bit.ly\/conf_bias\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"><em>wishful thinking<\/em><\/a><em>.<\/em><\/li>\n<li><em>That\u2019s okay. I don\u2019t have to understand how it works as long as I can be sure it does work.<\/em><\/li>\n<li><em>The way to check whether it works is to evaluate how it does on a battery of relevant examples it hasn\u2019t seen before.<\/em><\/li>\n<\/ul>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-2754340 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"2754340\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-c7acc30\" data-id=\"c7acc30\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-1aa9986 elementor-widget elementor-widget-text-editor\" data-id=\"1aa9986\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>So far, so good. There\u2019s actually no problem yet. You trust plenty of things without knowing how they work, for example the <a href=\"https:\/\/bjaed.org\/article\/S1743-1816(17)30088-4\/fulltext\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"> paracetamol<\/a> many of us take for our headaches. It does the job, yet <a href=\"https:\/\/bjaed.org\/article\/S1743-1816(17)30088-4\/fulltext\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">science can\u2019t tell you how<\/a>. The important bit is that you can verify that <a href=\"https:\/\/en.wikipedia.org\/wiki\/Paracetamol\" target=\"_blank\" rel=\"noreferrer noopener\">paracetamol <strong> does<\/strong> work<\/a>(unlike that whole thing with <a href=\"http:\/\/bit.ly\/headache_mole\" target=\"_blank\" rel=\"noreferrer noopener\">strapping a dead mole to your head<\/a>).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-9902dfc elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"9902dfc\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-361be66\" data-id=\"361be66\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7f847d2 elementor-widget elementor-widget-image\" data-id=\"7f847d2\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"765\" height=\"421\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_qF7y6JBZBh1IWCP0.jpeg\" class=\"attachment-large size-large wp-image-33458\" alt=\"\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_qF7y6JBZBh1IWCP0.jpeg 765w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_qF7y6JBZBh1IWCP0-300x165.jpeg 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_qF7y6JBZBh1IWCP0-610x336.jpeg 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/10\/0_qF7y6JBZBh1IWCP0-750x413.jpeg 750w\" sizes=\"(max-width: 765px) 100vw, 765px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-0fe25ce elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0fe25ce\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-72d2339\" data-id=\"72d2339\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-261a81c elementor-widget elementor-widget-text-editor\" data-id=\"261a81c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Think about complex AI systems the same way as you think about headache cures. Make sure they work and you\u2019ll be fine. Okay, where\u2019s the unraveling? Drumroll, please!<\/p>\n<p>Unfortunately, I check performance on examples that aren\u2019t like the examples I want my system to operate in.<\/p>\n<p>There it is. This last one is where it\u00a0<em>actually<\/em> went horribly wrong. The rest are okay as long as we test the system appropriately with appropriate examples. So, the answer is:\u00a0<strong> it\u2019s my human fault.<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-340558d elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"340558d\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-e73cfc8\" data-id=\"e73cfc8\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c8ad92a elementor-widget elementor-widget-text-editor\" data-id=\"c8ad92a\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>If you test the system for one job and then apply it to another\u2026 what were you expecting?<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-cf9c73d elementor-widget elementor-widget-text-editor\" data-id=\"cf9c73d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>If I teach and test a student using a set of examples that don\u2019t cover the task I want that student learn, then why would I be surprised if there\u2019s a mess later? If all my examples are from the world where Tes and the radiator always go together, then I can only expect my classifier to work in that world. When I move it to a different world, I\u2019m putting it where it doesn\u2019t belong. The application had better be low-stakes because there\u2019s no excuse of <em>\u201cOops, but I didn\u2019t know it wouldn\u2019t work outside the setting it was made for.\u201d<\/em> You know. And if you didn\u2019t know before, you do now.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0b2c869 elementor-widget elementor-widget-text-editor\" data-id=\"0b2c869\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>This is why it\u2019s so important to have your <a href=\"http:\/\/bit.ly\/quaesita_dmguide\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"> goals and users<\/a> in mind from the beginning. Specify the specs and setting before you begin. Please put a <a href=\"http:\/\/bit.ly\/quaesita_first\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\">responsible adult<\/a&#038;> adult in charge or stick to toy applications.<\/p>\nWhere bigger things are at stake, don\u2019t just throw cool buzzwords at irrelevant datasets.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-3befb8c elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"3befb8c\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-57517d8\" data-id=\"57517d8\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-ca91b32 elementor-widget elementor-widget-text-editor\" data-id=\"ca91b32\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Without skilled and responsible leadership, well, I hope your application never has anyone\u2019s health, safety, dignity, or future hanging on it\u2026<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-b3c4edc elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"b3c4edc\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-c61390e\" data-id=\"c61390e\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-9a4df28 elementor-widget elementor-widget-heading\" data-id=\"9a4df28\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Common sense, not magic<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-dccf28e elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"dccf28e\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-acca09b\" data-id=\"acca09b\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-137fe72 elementor-widget elementor-widget-text-editor\" data-id=\"137fe72\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>I\u2019ve been using the word \u201cexamples\u201d instead of \u201cdata\u201d \u2014 they\u2019re the same thing \u2014 to remind you that this isn\u2019t magic. <mark>The point of <a href=\"http:\/\/bit.ly\/quaesita_emperor\" target=\"_blank\" rel=\"noreferrer noopener\"> ML\/AI<\/a> is that you\u2019re <a href=\"http:\/\/bit.ly\/quaesita_simplest\" target=\"_blank\" rel=\"noreferrer noopener\" class=\"broken_link\"> expressing your wishes using examples instead of instructions<\/a><\/mark>. For it to work, the examples have to be relevant. The more complicated the task, the more examples you\u2019ll need. You communicate using examples every day, so you knew this stuff already. Maybe you were wondering whether the math says something different; it doesn\u2019t. Rest assured that common sense was your best algorithm all along.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-53204bd elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"53204bd\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-d2d839c\" data-id=\"d2d839c\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2d2bc4e elementor-widget elementor-widget-text-editor\" data-id=\"2d2bc4e\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>If you want to teach with examples, the examples have to be good. If you want to trust your student, the test has to be good.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-e92f6fe elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e92f6fe\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1093c90\" data-id=\"1093c90\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7de4e0d elementor-widget elementor-widget-heading\" data-id=\"7de4e0d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Blind trust is a terrible thing<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-c33568e elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"c33568e\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1c608a3\" data-id=\"1c608a3\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-555b0f5 elementor-widget elementor-widget-text-editor\" data-id=\"555b0f5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>You don\u2019t know anything about the safety of your system outside the conditions you checked it in, so keep these reminders handy:<br \/><li>If you didn\u2019t test it, don\u2019t trust it.<\/li><br \/><li>If you didn\u2019t test it in [environment], don\u2019t trust it in [environment].<\/li><br \/><li>If you didn\u2019t test it with [user population], don\u2019t trust it with [user population].<\/li><br \/><li>If you didn\u2019t test it with [data population], don\u2019t trust it with [data population].<\/li><br \/><li>If an input is unusual, don\u2019t trust your system to output something sensible. Consider using outlier detection and\u00a0<a href=\"http:\/\/bit.ly\/quaesita_policy\" target=\"_blank\" rel=\"noreferrer noopener\" safety \/a>\u00a0(e.g. flagging an unusual instance for human review).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-0813461 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0813461\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-bc9845d\" data-id=\"bc9845d\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-4de8072 elementor-widget elementor-widget-text-editor\" data-id=\"4de8072\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>If you use a <a href=\"https:\/\/www.experfy.com\/blog\/the-7-tools-that-every-remote-team-needs\/\" target=\"_blank\" rel=\"noreferrer noopener\">tool <\/a>where it hasn\u2019t been verified safe, any mess you make is <em> your<\/em> fault. AI is a tool like any other.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Don\u2019t trust machine learning and AI blindly, because the way you build effective and reliable ML\/AI solutions is to force each solution to earn your trust.<\/p>\n","protected":false},"author":335,"featured_media":10764,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[226,111,225],"ppma_author":[2050],"class_list":["post-10763","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-ai","tag-ai-amp-machine-learning","tag-ml"],"authors":[{"term_id":2050,"user_id":335,"is_guest":0,"slug":"cassie-kozyrkov","display_name":"Cassie Kozyrkov","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/04\/medium_df35f80d-2bff-4fe3-b741-a94d51320e00-150x150.jpg","user_url":"https:\/\/careers.google.com\/?src=Online\/LinkedIn\/linkedin_profilepage&amp;utm_source","last_name":"Kozyrkov","first_name":"Cassie","job_title":"","description":"Cassie Kozyrkov is Chief Decision Scientist at Google, Inc. With a unique combination of deep technical expertise, and world-class public-speaking skills, she has provided guidance on more than 100 projects and designed Google's analytics program, personally training over 15000 Googlers in statistics, decision-making, and machine learning.\u00a0"}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/10763","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/335"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=10763"}],"version-history":[{"count":6,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/10763\/revisions"}],"predecessor-version":[{"id":33461,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/10763\/revisions\/33461"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/10764"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=10763"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=10763"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=10763"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=10763"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}