{"id":1988,"date":"2019-10-03T03:45:14","date_gmt":"2019-10-03T03:45:14","guid":{"rendered":"http:\/\/kusuaks7\/?p=1593"},"modified":"2024-03-18T15:17:30","modified_gmt":"2024-03-18T15:17:30","slug":"the-hidden-risk-of-ai-and-big-data","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/ai-ml\/the-hidden-risk-of-ai-and-big-data\/","title":{"rendered":"The Hidden Risk of AI and Big Data"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Recent advances in AI have been made possible through access to \u201cBig Data\u201d and cheap computing power. But can it go wrong?<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tBig data is suddenly everywhere. From scarcity and difficulty to find data (and information), we now have a deluge of data. In recent years, the amount of available data has been growing in an exponential pace. This is in turn made possible due to the immense growth in number of devices recording data, as well as the connectivity between all these devices through the internet of things.\u00a0<\/em>Everyone seems to be collecting, analyzing, making money from and celebrating (or fearing) the powers of Big data. By combining the power of modern computing, it promises to solve virtually any problem – just by crunching the numbers.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tBut, can big data really deliver on all this hype? In some cases, yes, in others, maybe not. On the one hand, there is no doubt that big data has already had a critical impact in certain areas. For instance, almost every successful artificial intelligence solution involves some serious number crunching.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nThe first thing to note is that although AI is currently very good at finding patterns and relationships within big datasets, it is still not very intelligent (depending on your definition of intelligence, but that\u2019s another story!). Crunching the numbers can effectively identify and find subtle patterns in our data, but it cannot directly tell us which of those correlations are actually meaningful.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Correlation vs. Causation<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWe all know (or should know!) that \u201cCorrelation doesn\u2019t imply causation<\/a>\u201d. However, the human mind is hardwired to look for patterns, and when we see lines sloping together and apparent patterns in our data, it is hard for us to resist the urge to assign a reason.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tStatistically we can\u2019t make that leap, however. Tyler Vigen, the author of\u00a0Spurious Correlations,<\/em><\/a>\u00a0has made sport of this on his website (which I can very much recommend visiting for a look at some entertaining statistics!) Some examples of such spurious correlations can be found in the figures below, where I have collected a few examples showing how Ice cream are apparently causing a lot of bad things, ranging from forest fires to shark attacks and polio outbreaks.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tHaving a look at these plots, one could argue that we should probably have banned Ice cream a long time ago. And, actually, in the 1940s Polio example, public health experts recommended that people stop eating ice cream as part of an “anti-polio diet”. Fortunately, they eventually came to realize that the correlation between polio outbreaks and ice-cream consumption was simply caused by the fact that polio outbreaks were most common during summer.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIn\u00a0statistics<\/a>, a\u00a0spurious relationship\u00a0or\u00a0spurious correlation<\/a>\u00a0is a\u00a0mathematical relationship\u00a0in which two or more events or variables are\u00a0associated<\/a>\u00a0but\u00a0not<\/em><\/a>\u00a0causally related<\/a>, due to either coincidence or the presence of a certain third, unseen factor (referred to as a “common response variable”, “confounding factor”, or “lurking variable<\/a>“). An example of such \u201clurking variables\u201d could e.g. be the seeming correlation between ice cream sales and shark attacks (I feel quite confident that increased sales of ice cream does not cause sharks to attack people). However, there is a common link behind these two numbers, namely temperature. Higher temperature causes more people to buy ice cream as well as more people to go for a\u00a0swim. Thus, this \u201clurking variable\u201d is really the cause of the apparent correlation. Luckily, we have learned to separate correlation from causation, and we can still enjoy some ice cream on a hot summer day without fearing polio outbreaks and shark attacks!\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

The power and limits of correlations<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWith enough data, computing power and statistical algorithms patterns will be found. But are these patterns of any interest? Not all of them will be, as spurious patterns could easily outnumber the meaningful ones. Big data combined with algorithms can be an extremely useful tool when applied correctly to the right problems. However, no scientist thinks you can solve the problem by crunching data alone, no matter how powerful the statistical analysis. You should always start your analysis based on an underlying understanding of the problem you are trying to solve.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Data science is the end of science (or is it?)<\/strong><\/h3><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tIn June 2008, C. Anderson, former editor-in-chief of Wired Magazine, wrote a provocative essay titled: \u201cThe End of Theory: The Data Deluge Makes the Scientific Method Obsolete\u201d,<\/a>\u00a0in which he states that \u201cwith enough data, the numbers speak for themselves\u201d. \u201cCorrelation supersedes causation, and science can advance even without coherent models and unified theories\u201d.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nThe strength and generality of this approach relies on the amount of data: the more data, the more powerful and effective is the method based on computationally discovered correlations. We can simply feed the numbers into powerful computers and let statistical algorithms automatically find interesting patterns and insight.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tUnfortunately, this simplified way of analysis has some potential pitfalls, which can be illustrated nicely through an example found on the\u00a0blog by John Poppelaars<\/a>:\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
Suppose we would like to create a prediction model for some variable Y. This could for example be the stock price of a company, the click-through rates of online ads or next week\u2019s weather. Next we gather all the data we can lay your hands on and put it in some statistical procedure to find the best possible prediction model for Y. A common procedure is to first estimate the model using all the variables, screen out the unimportant ones (the ones not significant at some predefined significance level) and re-estimate the model with the selected subset of variables and repeat this procedure until a significant model is found. Simple enough, isn’t it?<\/em><\/blockquote>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
Anderson suggested way of analysis has some serious drawbacks however. Let me illustrate. Following the above example, I created a set of data points for Y by drawing 100 samples from a uniform distribution between zero and one, so it\u2019s random noise. Next I created a set of 50 explanatory variables X(i) by drawing 100 samples from a uniform distribution between zero and one for each of them. So, all 50 explanatory variables are random noise as well. I estimate a linear regression model using all X(i) variables to predict Y. Since nothing is related (all uniform distributed and independent variables) an R squared of zero is expected, but in fact it isn’t. It turns out to be 0.5. Not bad for a regression based on random noise! Luckily, the model is not significant. The variables that are not significant are eliminated step by step and the model re-estimated. This procedure is repeated until a significant model is found. After a few steps a significant model is found with an Adjusted R squared of 0.4 and 7 variables at a significance level of at least 99%. Again, we are regressing random noise, there is absolutely no relationship in it, but still we find a significant model with 7 significant parameters. This is what would happen if we just feed data to statistical algorithms to go find patterns.\u201d<\/em><\/blockquote>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

The larger the data set, the stronger the noise<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tRecent\u00a0research\u00a0<\/a>has provided proof that as data sets grow larger they have to contain arbitrary correlations. These correlations appear simply due to the size of the data, which indicates that many of the correlations will be spurious. Unfortunately, too much information tends to behave like very little information.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThis is a major concern in applications where you work with high-dimensional data. As an example, let\u2019s say you gather sensor data from thousands of sensors on an industrial plant, and then mine these data for patterns to optimize performance. In such cases, you could easily be fooled into acting upon phantom correlations rather than real indicators of operational performance. This could potentially be very bad news, both financially and in terms of safe operation of the plant.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Adding data vs. adding information<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tAs data scientists, we might often claim that the best solution to improving our AI model is to \u201cadd more data\u201d. However, the idea that just \u201cadding more data\u201d will magically improve the performance of your model might not be the case. What we should focus on is rather to \u201cadd more information\u201d. The distinction between \u201cadding data\u201d and \u201cadding information\u201d is crucial: Adding more data does not equal adding more information (at least useful and correct information). On the contrary, by blindly adding more and more data, we encounter the risk of adding data that contains misinformation that can accordingly downgrade the performance of our models. With the abundant access of data, as well as the computing power to process it, this becomes increasingly important to consider.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Outlook<\/strong><\/h3><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tSo, should the above challenges stop you from adopting data driven decision making? No, far from it. Data driven decision making is here to stay. It will become increasingly valuable as we gain more knowledge on how to best harness all available data and information to drive performance, that being clicks on your website or optimal operation of an industrial plant.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tHowever, it is important to be aware that it requires more than just hardware and lots of data to succeed. Big data and computing power are important ingredients, but it is not the full solution. Instead, you should understand the underlying mechanisms that connect the data. Data will not speak for itself, we give numbers their meaning. The Volume, Variety or Velocity of data cannot change that.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThis article is also published on LinkedIn<\/a>.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Sources:<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t
Calude, C.S. & Longo, G. Found Sci (2017) 22: 595: The Deluge of Spurious Correlations<\/a><\/div>\n
blogs.crikey.com: Does big data equal big problems?<\/div>\n
Guiseppe Longo: Mathematical Use and Abuse of Big Data<\/a><\/div>\n
NY Times: Eight (No, Nine!) problems with big data<\/a><\/div>\n
The Wire: THE END OF THEORY: THE DATA DELUGE MAKES THE SCIENTIFIC METHOD OBSOLETE<\/a><\/div>\n
John Poppelars: Do numbers really speak for themselves<\/a><\/div>\n
<\/div>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Recent advances in AI have been made possible through access to \u201cBig Data\u201d and cheap computing power. But can it go wrong? Big data is suddenly everywhere. From scarcity and difficulty to find data (and information), we now have a deluge of data. In recent years, the amount of available data has been growing in<\/p>\n","protected":false},"author":651,"featured_media":4126,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[183],"tags":[97],"ppma_author":[3401],"class_list":["post-1988","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai-ml","tag-artificial-intelligence"],"authors":[{"term_id":3401,"user_id":651,"is_guest":0,"slug":"vegard-flovik","display_name":"Vegard Flovik","avatar_url":"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2020\/04\/medium_10d5ff84-76ce-4fa5-80dc-3a0dae50f16d-150x150.jpg","user_url":"http:\/\/www.axbit.com","last_name":"Flovik","first_name":"Vegard","job_title":"","description":"Vegard Flovik, Ph.D., is a Lead Data Scientist. Machine learning and advanced analytics at Axbit AS, a professional ICT systems partner."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1988","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/651"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=1988"}],"version-history":[{"count":6,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1988\/revisions"}],"predecessor-version":[{"id":36457,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/1988\/revisions\/36457"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/4126"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=1988"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=1988"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=1988"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=1988"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}