{"id":22692,"date":"2021-03-18T04:05:00","date_gmt":"2021-03-18T04:05:00","guid":{"rendered":"https:\/\/www.experfy.com\/blog\/the-rise-of-data-downtime\/"},"modified":"2023-08-29T12:33:25","modified_gmt":"2023-08-29T12:33:25","slug":"the-rise-of-data-downtime","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/the-rise-of-data-downtime\/","title":{"rendered":"The Rise Of Data Downtime"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"22692\" class=\"elementor elementor-22692\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"has_eae_slider elementor-section elementor-top-section elementor-element elementor-element-cd2c9be elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"cd2c9be\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"has_eae_slider elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-8cf817b\" data-id=\"8cf817b\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b34305b elementor-widget elementor-widget-text-editor\" data-id=\"b34305b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Has your CEO ever looked at a report you showed him and said the numbers look way off? Has a customer ever called out incorrect data in your product\u2019s dashboards? I\u2019m sure it hasn\u2019t happened to you specifically, but perhaps you have a friend who had this problem?<\/p>\n<p>In 2016, while I was leading a team at Gainsight, fondly called Gainsight on Gainsight (GonG), I became all too familiar with these issues. We were responsible for our <a href=\"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/using-big-data-analytics-for-predictive-maintenance-how-enterprises-slash-downtime\/\" target=\"_blank\" rel=\"noreferrer noopener\">customer data and analytics<\/a>, including key reports reviewed weekly by our CEO and quarterly by our board of directors. Seemingly every Monday morning, I would wake up to a series of emails about errors in the data. It felt like every time we fixed a problem, we found three other things that went wrong. What\u2019s worse, we weren\u2019t catching the issues on our own. Instead, other people, including our very patient CEO, were alerting us about these issues. Recently, I talked to a CEO of another company who told me he used to go around the office and put sticky notes saying \u201c<em>this is wrong<\/em>\u201d on monitors displaying analytics with erroneous data.<\/p>\n<p>At Gainsight, I had the privilege to work with hundreds of companies that were leading industries in their approach to customer data and deriving insights to improve business outcomes. But I saw firsthand that while many companies were striving to become data-driven, they were falling short. As they encountered pains and challenges similar to the ones I had, they lost faith in their data and ultimately made suboptimal decisions. A founder I met recently told me how persistent data issues in his company\u2019s data and dashboards negatively impacted their culture and hindered their ambition to become a data-driven company.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-98e7287 elementor-widget elementor-widget-image\" data-id=\"98e7287\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t<figure class=\"wp-caption\">\n\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"682\" src=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-1024x682.jpeg\" class=\"attachment-large size-large wp-image-18966\" alt=\"The Rise Of Data Downtime\" srcset=\"https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-1024x682.jpeg 1024w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-300x200.jpeg 300w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-768x512.jpeg 768w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-610x407.jpeg 610w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-750x500.jpeg 750w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime-1140x760.jpeg 1140w, https:\/\/www.experfy.com\/blog\/wp-content\/uploads\/2021\/05\/the-rise-of-data-downtime.jpeg 1400w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/>\t\t\t\t\t\t\t\t\t\t\t<figcaption class=\"widget-image-caption wp-caption-text\">Photo by&nbsp;<a href=\"https:\/\/unsplash.com\/@nate_dumlao?utm_source=medium&amp;utm_medium=referral\" target=\"_blank\" rel=\"noopener\">Nathan Dumlao<\/a>&nbsp;on&nbsp;<a href=\"https:\/\/unsplash.com\/?utm_source=medium&amp;utm_medium=referral\" target=\"_blank\" rel=\"noopener\">Unsplash<\/a><\/figcaption>\n\t\t\t\t\t\t\t\t\t\t<\/figure>\n\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-921c00d elementor-widget elementor-widget-heading\" data-id=\"921c00d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Introducing&nbsp;<a href=\"https:\/\/www.montecarlodata.com\/closing-the-data-downtime-gap\/\" target=\"_blank\" rel=\"noopener\">data downtime<\/a><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d013fe3 elementor-widget elementor-widget-text-editor\" data-id=\"d013fe3\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>I\u2019ve come to call this problem \u201cdata downtime.\u201d Data downtime refers to periods of time when your data is partial, erroneous, missing or otherwise inaccurate. It is highly costly for data-driven organizations today and affects almost every team, yet it is typically addressed on ad-hoc basis and in a reactive manner.<\/p>\n<p>I call it downtime to harken back to the early days of the Internet. Back then, online applications were a nice-to-have, and if they were down for a while\u200a\u2014\u200ait was not a big deal. You could afford downtime, since businesses were not overly reliant on them. We\u2019re now two decades in, and online applications are mission-critical to almost every business. As a result, companies measure downtime meticulously and invest a lot of resources in avoiding service interruptions.<\/p>\n<p>Similarly, companies are increasingly reliant on data to run their daily operations and make mission critical decisions. But we aren\u2019t yet treating data downtime with the diligence it demands. While a handful of companies are putting SLAs in place to hold data teams accountable to accurate and reliable data, it is not the norm yet. In the coming years, I expect there will be increased scrutiny around data downtime, and increased focus on minimizing it.<\/p>\n<hr class=\"wp-block-separator\"\/>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-c5cd687 elementor-widget elementor-widget-heading\" data-id=\"c5cd687\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Signs that data downtime is impacting your company<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e59f51f elementor-widget elementor-widget-text-editor\" data-id=\"e59f51f\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Data downtime may occur for a variety of reasons, including for example an unexpected change in schema or buggy code changes. It is usually challenging to catch this before internal or external customers do, and it is very time consuming to understand root cause and remediate it quickly.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-89ed9b1 elementor-widget elementor-widget-heading\" data-id=\"89ed9b1\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h3 class=\"elementor-heading-title elementor-size-default\">Here are some signs that data downtime is affecting your company:<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-392a306 elementor-widget elementor-widget-text-editor\" data-id=\"392a306\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Consumers of data, internal and external, are calling up with complaints about your data and are gradually losing trust. The customer might be thinking \u201c<em>Why am I the person spot checking data errors for this company?\u201d&nbsp;<\/em>Perhaps the CEO thinks:&nbsp;<em>\u201cIf this chart is wrong, what other charts are wrong?\u201d<\/em><\/li><li>You are struggling to get adoption for data-driven decision making in your company, putting yourself at a disadvantage against your competitors. Folks might be saying&nbsp;<em>\u201cThe data is broken anyway and we can\u2019t trust it, so let\u2019s just go with our intuition.\u201d<\/em><\/li><li>Your analytics\/BI, data science, data engineering and product engineering teams are spending time on firefighting, debugging and fixing data issues rather than making progress on other priorities that can add material value to your customers. This can include time wasted on communication (<em>\u201cWhich team in the organization is responsible for fixing this issue?\u201d),&nbsp;<\/em>accountability<em>&nbsp;(\u201cWho owns this pipeline or dashboard?\u201d),&nbsp;<\/em>troubleshooting (<em>\u201cWhich specific table or field is corrupt?\u201d),<\/em>&nbsp;or efficiency<em>&nbsp;(\u201cWhat has already been done here? Am I repeating someone else\u2019s work?\u201d).<\/em><\/li><\/ul>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6bf74c7 elementor-widget elementor-widget-text-editor\" data-id=\"6bf74c7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<hr class=\"wp-block-separator\"\/>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5c653ff elementor-widget elementor-widget-text-editor\" data-id=\"5c653ff\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>Tomasz Tunguz recently<a rel=\"noreferrer noopener\" href=\"https:\/\/tomtunguz.com\/5-predictions-for-2019\/\" target=\"_blank\">&nbsp;predicted<\/a>&nbsp;that \u201cData Engineering is the new Customer Success.\u201d In the same way that customer success was a nascent discipline and is now becoming a prominent function in every business, data engineering is expected to similarly grow. I couldn\u2019t agree more and would add that the problem of data downtime spans many teams in data-driven organizations. As companies become more data-driven and sophisticated in their use of data, along with business functions increasingly becoming heavier consumers of data, I expect the problem of data downtime to amplify and grow in importance. I also expect better solutions will emerge to help teams across the industry mitigate data downtime. In a future post, I\u2019ll describe how we attempted to solve this problem at Gainsight\u200a\u2014\u200aand the benefits companies achieve when they regain trust and confidence in their data.<\/p>\n<p>This article was published on <a href=\"https:\/\/www.montecarlodata.com\/the-rise-of-data-downtime\/\" target=\"_blank\" rel=\"noreferrer noopener\">Monte Carlo<\/a>.<\/p>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Data downtime refers to periods of time when your data is partial, erroneous, missing or otherwise inaccurate. Here are some signs that data downtime is affecting your company.<\/p>\n","protected":false},"author":727,"featured_media":18967,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[187],"tags":[120,1428,611],"ppma_author":[3567],"class_list":["post-22692","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-bigdata-cloud","tag-analytics","tag-data-downtime","tag-data-engineering"],"authors":[{"term_id":3567,"user_id":727,"is_guest":0,"slug":"barr-moses","display_name":"Barr Moses","avatar_url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","user_url":"","last_name":"Moses","first_name":"Barr","job_title":"","description":"Barr Moses is Co-Founder &amp; CEO at <a href=\"http:\/\/montecarlodata.com\/\">Monte Carlo<\/a>. She is an entrepreneur, speaker at O&rsquo;Reilly for Machine learning training, and worked at the Statistics Department at Stanford."}],"_links":{"self":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/users\/727"}],"replies":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/comments?post=22692"}],"version-history":[{"count":4,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22692\/revisions"}],"predecessor-version":[{"id":31872,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/posts\/22692\/revisions\/31872"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media\/18967"}],"wp:attachment":[{"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/media?parent=22692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/categories?post=22692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/tags?post=22692"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.experfy.com\/blog\/wp-json\/wp\/v2\/ppma_author?post=22692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}