The old way of managing data doesn’t work

Kirsten Doyle Kirsten Doyle
June 20, 2019 Big Data, Cloud & DevOps

Why do businesses struggle to unlock true value from their data? Norah Wulff, head of technology and operations at WeDoTech, highlights the key problems.

She says data initiatives often take too long to get off the ground, which can cause businesses to give up or change tack.

In addition, the promise of value of data warehousing projects is often lost due to other factors, including the fact that planning for the required hardware based on the estimated load and usage, is often a ‘thumb-suck’ exercise and requires a significant upfront capital investment.

“Too often, data requirements are restricted to lower the required storage and computing power. The opposite approach, where the company invests in high-spec servers, that handle a significant load for a few days a month and sit idle for the remainder of the time, doesn’t work either.”

Then there is a question of skills. “Finding and retaining the appropriate database administration skills to guarantee that data is readily available when needed, and indexed accordingly, is challenging and expensive.”

Wulff adds the development of the processes to extract, transform and load the data into a data warehouse can be an expensive and onerous task too. “Maintaining these processes also requires a lot of time and effort, particularly when critical processes go wrong due to changes to the source systems or hardware limitations.”

Unfortunately, the visualisations and insights that were sold to the business when it purchased its business intelligence tool of choice, becomes a distant memory when it has to wait three to six months to see the results, and these are often not what was expected.

However, she says with a modern data stack, companies can realise the value from their data initiatives faster. With a modern data warehousing approach, the traditional extract, transform and load process becomes faster, and more agile, where all data is loaded and then the relevant data is transformed into useful information.

“With new cloud-based technologies, businesses can work in an agile manner and get all of their data into a single platform without breaking the bank,” adds Wulff. “Cloud data warehousing tools, such as Snowflake, allow companies to first test the waters to realise value in their data initiatives. Data pipeline technologies such as Fivetran enable businesses to bring all of their data into a cloud data warehouse platform. All that is required is a five-minute setup.”

Then, she says once data has been blended into meaningful information, big data analytics platforms, such as Looker, allow organisations to embed data into every aspect of their business processes.

“Looker is way more than a data visualisation tool; it gives anyone in your company real-time access to data that drives your business. With a 360-degree vision of your business, you can finally ask sophisticated questions from your data to make better decisions and drive business value.”

  • Experfy Insights

    Top articles, research, podcasts, webinars and more delivered to you monthly.

  • Kirsten Doyle

    Tags
    Data Science
    © 2021, Experfy Inc. All rights reserved.
    Leave a Comment
    Next Post
    An Introduction to Big Data: Distributed Data Processing

    An Introduction to Big Data: Distributed Data Processing

    Leave a Reply Cancel reply

    Your email address will not be published. Required fields are marked *

    More in Big Data, Cloud & DevOps
    Big Data, Cloud & DevOps
    Cognitive Load Of Being On Call: 6 Tips To Address It

    If you’ve ever been on call, you’ve probably experienced the pain of being woken up at 4 a.m., unactionable alerts, alerts going to the wrong team, and other unfortunate events. But, there’s an aspect of being on call that is less talked about, but even more ubiquitous – the cognitive load. “Cognitive load” has perhaps

    5 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    How To Refine 360 Customer View With Next Generation Data Matching

    Knowing your customer in the digital age Want to know more about your customers? About their demographics, personal choices, and preferable buying journey? Who do you think is the best source for such insights? You’re right. The customer. But, in a fast-paced world, it is almost impossible to extract all relevant information about a customer

    4 MINUTES READ Continue Reading »
    Big Data, Cloud & DevOps
    3 Ways Businesses Can Use Cloud Computing To The Fullest

    Cloud computing is the anytime, anywhere delivery of IT services like compute, storage, networking, and application software over the internet to end-users. The underlying physical resources, as well as processes, are masked to the end-user, who accesses only the files and apps they want. Companies (usually) pay for only the cloud computing services they use,

    7 MINUTES READ Continue Reading »

    About Us

    Incubated in Harvard Innovation Lab, Experfy specializes in pipelining and deploying the world's best AI and engineering talent at breakneck speed, with exceptional focus on quality and compliance. Enterprises and governments also leverage our award-winning SaaS platform to build their own customized future of work solutions such as talent clouds.

    Join Us At

    Contact Us

    1700 West Park Drive, Suite 190
    Westborough, MA 01581

    Email: [email protected]

    Toll Free: (844) EXPERFY or
    (844) 397-3739

    © 2025, Experfy Inc. All rights reserved.