{"id":609,"date":"2018-02-23T02:03:36","date_gmt":"2018-02-22T23:03:36","guid":{"rendered":"http:\/\/kusuaks7\/?p=214"},"modified":"2025-05-05T11:17:47","modified_gmt":"2025-05-05T11:17:47","slug":"how-data-scientists-are-wasting-their-time","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/how-data-scientists-are-wasting-their-time\/","title":{"rendered":"How Data Scientists Are Wasting Their Time"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tReady to learn Data Science? Browse courses<\/a>\u00a0like\u00a0Data Science Training and Certification<\/a> developed by industry thought leaders and Experfy in Harvard Innovation Lab.<\/em><\/strong>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tToday\u2019s definition of what most companies want in a data scientist seems to be something akin to a superhero. Companies are looking for a regular\u00a0Mister Fantastic<\/a>\u00a0(the Marvel Comics\u2019 superhero who was \u201cone of the bravest adventurers and most brilliant scientific minds of his generation\u201d).\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tChief A.I. Officer at ZIFF, Ben Taylor, has coined the ideal caliber of data scientist as a \u2018Type-E<\/a>\u2019 \u2013 a kind of over-achieving, unapologetically ambitious, narcissistic, nerd-on-A.C.I.D, who eats, drinks, sleeps and is married to data science.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tHowever, if we want to mold this perfect data scientist then we first need to identify and eradicate their imperfections. So, let\u2019s take a quick look at ways in which data scientists fail:\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Data Scientists are Primed to be Researchers,\u00a0<\/strong>not<\/strong> Business People<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tTaylor sprints past Malcolm Gladwell\u2019s theory that it takes 10,000 hours of experience to make an expert, and claims you need at least triple that to make a semi-decent data scientist. This means that data scientists need to start gathering practical, real experience very early in life.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tData Scientists are generally highly qualified academically.\u00a0Research\u00a0shows that 88% of data scientists hold a minimum of a Master\u2019s degree, 46% hold a Ph.D., while only 1% have no third-level education.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nWhile academic qualifications are certainly fundamental, colleges place too much emphasis on coursework and academic research and not enough on training data scientists for the world of business. This results in the formation of data scientists who lack the vital business acumen needed to be able to prioritize projects and to choose those that are aligned with business objectives rather than those that they think would be exciting and cool.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Data Scientists Over-complicate Things<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tData scientists often fall into the trap of over-complicating projects because they know that they have the brains and skills to do so. Like any scientist, data scientists are at risk of being too overly concerned with breaking ground, doing what\u2019s never been done before, outsmarting their peers, and creating the most mind-boggling algorithms and mind-bending visuals that they lose sight of the main goal of any business: profit or business value.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tInstead of focusing on how complex and impressive they can make their code, data scientists need to focus on how to achieve the highest return for the least amount of time and money. They\u00a0should start simple\u00a0<\/a>and then build upon this infrastructure as the project proves itself worthy of the required time and effort. Data scientists should also know when to kill a project as soon as it shows signs of being irrelevant, something the tenacious data scientist is bad at.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Data Scientists are not Omniscient<\/strong><\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tYou might expect your data scientist to be a superhero, but expecting them to be God is a whole other, even more unrealistic, expectation. Data scientists are expected to be all-seeing and all-knowing, but this is impossible.\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tData experts have discussed<\/a>\u00a0the difficulties they face with collecting all of the necessary data to have a 360 view of the business. This is due to unidentified data silos, stakeholders with-holding information, vendor-owned data, and teams and departments competing with one another and being unwilling to cooperate. It is vitally important that everyone involved in a project and organization share data to the best of their ability, and sometimes the only way to do this is with the right tools.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tAlong with data collection, data cleaning and classification is another process that eats up time and money by data scientists who insist on carrying it out manually. This is not only time-consuming; it is also too susceptible to human error, meaning data is at risk of contamination. Bad data leads to bad predictions. In order to avoid this, it is often best to use an A.I. tool with machine learning to gather and clean your data, classify it, and make it relate.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Data Scientists have mixed feelings about AI Takeover<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThere exists among data scientists a certain reluctance to hand over their tasks to the new, powerful automation tools on the market which harness the power of A.I., Machine Learning, and Deep Learning. Perhaps, they have a fear of being made obsolete. This is understandable but unfortunately harks back to the failure of data scientists to prioritize business objectives over their own sense of self-worth.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThere is a consensus among many that A.I. trumps human ability every time when it comes to data collection, correlation, and bucketing; perpetual self-learning and algorithm building; as well as prediction, pattern identification, and trend analysis. In addition to this, a machine is not susceptible to certain potentially disadvantageous traits which are inherent in humans, such as bias, assumption, presumption, pride, stubbornness, personal inexperience, limited memory capacity, tiredness, stress, lack of\/too much confidence, arrogance, and limited speed and creativity. So certain work is better to do using neural net than manually.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Should Data Scientists Bow Out and Let the Robots Take Over?<\/h3><\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWe may want our data scientists to be superheroes, but all superheroes have their kryptonite. It would seem that the main flaw with being a data scientist is the one thing data scientists cannot change \u2013 the fact that they are human. Even Mister Fantastic was only human, after all. There is no way around this, so what is the solution? Do we throw all our data scientists out onto the street and replace them with machines?\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tWe are a long way off a time when machines trump humans on every aspect of data science. Yes, to be human is to err, but to be human is also to be passionate, ambitious, driven, competitive, and devoted. Machines do not (not yet anyway) possess these qualities.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\nA machine will not love its job like a data scientist will, you can\u2019t have a coffee and a doughnut with a machine and talk about how excited you are about the latest data insights, a machine won\u2019t smile from ear to ear and beam with pride when it presents you with the most beautiful dashboards and visualizations, and a machine doesn\u2019t care about you and your company.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tSo, while data scientists are flawed and there are lots of ways in which they could improve, so too are machines. It would seem that the best way forward is to work side-by-side, fleshy-arm-in-robotic-arm with the new race of machines and robots that will undoubtedly make our lives easier.\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

We may want our data scientists to be superheroes, but all superheroes have their kryptonite. It would seem that the main flaw with being a data scientist is the one thing data scientists cannot change – the fact that they are human. Even Mister Fantastic was only human, after all. There is no way around this, so what is the solution? Do we throw all our data scientists out onto the street and replace them with machines?<\/p>\n","protected":false},"author":226,"featured_media":3340,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[187],"tags":[94],"ppma_author":[1748],"class_list":["post-609","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bigdata-cloud","tag-data-science"],"authors":[{"term_id":1748,"user_id":226,"is_guest":0,"slug":"abhi-yadav","display_name":"Abhi Yadav","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","user_url":"","last_name":"Yadav","first_name":"Abhi","job_title":"","description":"Abhi Yadav, an accomplished AI technologist, and a renowned speaker, is co-founder & CEO at Zylotech<\/a>.  He is also an Advisory Board member at MIT – Global Startup Labs, Forbes Technology Council Member. He works with numerous Enterprise Innovation offices—including MIT."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/609","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/226"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=609"}],"version-history":[{"count":5,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/609\/revisions"}],"predecessor-version":[{"id":37767,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/609\/revisions\/37767"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/3340"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=609"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=609"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=609"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=609"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}