Medium f0d236fe 1400 4b4b 9f85 19b56453b063

The role of the data curator: Make data scientists more productive

Today our data scientists and data analysts are more like doctors who perform many functions themselves. We are fairly early in our evolution of roles to fulfill the end to end process of data analytics, and there is still tremendous opportunity to improve efficiency with better specialization of roles. Today we see the emergence of a new role: the data curator. By working with data engineers, data custodians, data analysts, and data scientists, the data curator develops a deep understanding of how data is used by the business, and how IT applies technology to make the data available.

Medium 444c30db b0fd 4b08 b281 146d1ce4e899

The Capabilities & Costs of New Technologies

Robotic Process Automation (RPA), Machine Learning (ML) and Artificial Intelligence (AI) get a lot of attention these days. After studying these technologies and finding ways to apply them appropriately in our business, it is clear that there are vast ranges of perceptions of what these tools do and how they can be applied by managers and by marketers. A lot of hype is being used to over sell benefits, and very little discussion takes place about the costs connected to these technologies.

Medium be5ea6f7 54b8 44f0 a4d5 4fb947d510f8

Twenty Big Data Use Cases

The title explains it all. No intrigue. A comprehensive overview of big data uses cases. We are going to describe big data use cases, and we have summed up twenty industry-neutral examples that clearly show the practical value of big data. So, let’s talk business value.


Medium c8882742 1bbe 448d afc5 78783cd8a1cc

Fake News and the Responsibility of Data Scientists

Discussions about fact versus truth come up quite a bit these days, especially with the proliferation of fake news and the news media’s coverage of certain facts or non-facts. There are sites to remove political bias and interpretation from these “facts,” but why would we need such things? Is it because reporters actively make up information and deliberately lie to viewers? Or could it be that they simply tweak hard facts just enough to fit them into their preferred narrative?

Medium c6301240 c2ec 4f8a a5a2 ea676e3c76f8

What if AI made us talk to each other more?

The way that bots and AI will interact with our life is still in the early stages of development, but what we do know is that AI can help us collaborate smarter. We therefore need to change the conversation from humans need to understand machines to machines need to understand humans.   AI can guide us in developing better, more meaningful relationships with those around us in a way that’s quick, convenient and intuitive. We might not always admit it, but our need for a true connection is more powerful than our need for convenience.

Medium f660a8d4 aa87 458c 9da5 427312b5127f

Getting That Data Science Job

Most people who attempt to get hired as a data scientist fail. This article is to help clarify what is happening and increase the chances of landing your first data science job. Everyone looks the same, literally. How do you expect a hiring manager to put you in their top 5-10 list for the final round if you look just like everyone else in the applicant pool? Once you admit that your fancy resume is actually boring and you look just like everyone else, you can start making some meaningful changes. 

Medium 41a06fbb 3118 40ca a23f 517cd7de2173

Five predictions on the future of smart warehousing

Customers want goods made to order and delivered as soon as possible, in a way that suits their flexible lifestyles. That’s a byproduct of the mobile, app-driven, on-demand age. But for many organisations and their warehousing and logistics experts, those customer wants can shine a harsh spotlight on legacy business models. Today’s smart warehouses are increasingly rolling out transformation strategies that deploy sensors connected to the IoT – so that robots, workers, managers, and even smart vehicles, know the location of every item and can track them on their journeys.

Medium c05fcd4e f2cf 4106 83d1 276764858bc8

Does It Make Sense to Do Big Data with Small Nodes?

In this age of big data and powerful commodity hardware, there’s an ongoing debate about node size. Does it make sense to use a lot of small nodes to handle big data workloads? Or should we instead use only a handful of very big nodes? If we need to process 200TB of data, for example, is it better to do so with 200 nodes with 4 cores and 1 terabyte each, or to use 20 nodes with 40 cores and 10 terabytes each? One reason we hear is that having all this processing power doesn’t really matter because it’s all about the data. If nodes are limited to a single terabyte, increasing processing power doesn’t really help things and only serves to make bottlenecks worse.

Medium 7bda43a0 308b 4546 89f4 1077b3c089f2

IIoT: The rise and rise of IoT in the industrial sector

There is more than one way in which IoT can enable industries to accelerate growth, transform economies and achieve a new level of competitiveness. With IIoT, manufacturers can ensure greater efficiencies across the value chain, ranging from operations and services to engineering and product supply. The inherent benefits of IIoT, including asset optimization, smart monitoring, predictive maintenance and, most importantly, intelligent decision-making, are rapidly making it an irreplaceable technology.


Medium 19a9647c dc80 405b 853b 91e4c9aa0346

Data is a stakeholder

Data science is currently very good at coming up with answers. It’s not very good at coming up with questions. I believe that requires data scientists to pay more attention to building non-technical skills, but I think it also requires us to build more tools that facilitate that part of the process. In fact, building the tools will contribute, in large measure, to building the non-technical skills.

Medium 71968104 e7d7 42e4 aa42 6f2980400a26

Trying to Persuade with Data?

Data professionals have to consider the environment around them when creating a data story. It’s not enough to find an issue and then start raising a red flag. Consider your audience and craft your message in a way that they can hear bad news, consider if others even consider the issue a problem, and then work with others to solve the issue.

Medium b06faa3c d89d 4287 a7f8 ff3ef8be79dc

Why Most AI Projects Fail

Everyone has AI on their roadmap these days. Bottom-tier innovation verticals like HR, multi-level marketing, entertainment, fashion, medical, supply chain are even starting to talk about it. Despite the hype and excitement, the majority of companies that commit to tackling AI projects will fail. Even that $1M+ hire won't save you from failure. Here are some of the main reasons why your AI project failed or will fail. These have seemed to resonate well with others so I figured I would share.

Medium 8d07d391 0de9 44a8 ae0b 87f5e491d79b

Blurred Lines: Data Analyst vs Data Science

In the world of exponential data growth, companies are turning to 2 jobs to solve some of their biggest problems, Data Analyst and Data Science. However, it’s becoming more apparent that the business world is unsure how to appropriately define the scope and differentiate between these roles. There are near identical skills required in both, but there is a key difference in what separates these roles. Businesses need to ensure they do not blur the lines.

Medium 442eaf66 78a5 47e9 8e1a 51f351c6efa1

Five Business Intelligence Myths, Debunked

Taking a passive approach to Business Intelligence (BI) is a mistake many companies today make. Their competitors mine data related to optimize their stake in the marketplace starting from their customers, and products all the way to market share and patterns of growth. But why are so many companies still so fearful of BI? Here are the top five myths debunked

Medium 996843ef aef5 48a0 b82f 744c80f55b77

RPA – The Small and Medium Businesses Challenge

Many of the RPA vendors have a well-rehearsed pitch and presentation clearly aimed at the global companies with tens of thousands of employees.  RPA does still have impactful potential for SMB companies but the analysis and application needs to a lot more granular and explicit about avenues of costs savings beyond head-count reductions.  In an SMB context, many of the process that should be automated will see FTE effort savings that will be less than 100% of 1 FTE.  

Medium 9ce9308a d12d 4490 b097 0da1d02c298d

Properly managing IIoT systems to prevent cyberattacks

One of the top challenges of IIoT is keeping valuable business data secure. Cyberattacks against IIoT systems and critical network infrastructure have severe consequences, putting world governments on high alert. Enterprises must take adequate precautions to manage and protect data related to IIoT or machine-to-machine security. By securing every necessary remote connection with VPN management, it will be possible for enterprises to stay ahead of future cybersecurity threats.

Medium c2afe537 e5a4 4a62 a2a0 250de58ae48e

The dysfunctional relationship most firms have with AI

AI pioneers have provided us with a glimpse of and conditioned us to ambient AI making it hard to break up with each other. They have also set a very high bar on our expectations of what AI should do for our businesses. The point is that enterprises embarking on AI need to radically shift their approach to technology adoption and analytics. This is not a plug and play and bolt on strategy. It takes work to go from POC to a capability that comes close to our expectations of AI based on our consumer experience. 

Medium ec424991 a115 41aa 8149 5ec2b1413c59

This is the AI debate that we need to have

Policy approaches to education, skills training, employment, and income distribution should all now assume a post-AI perspective. This will require us to question some of our most deeply held convictions. A world where autonomous AI systems can predict and manipulate our choices will force us to rethink the meaning of freedom. Similarly, we will also have to rethink the meaning and purpose of education, skills, jobs, and wages.

Medium 7ad619c6 15a3 4b4d b5cd a572af8e90ad

IoT network integrators – Key to meeting the Needs of Enterprise Customers

Most of the traditional large system integrators focus on the higher end of the technology stack – connectivity is usually assumed to exist.  But the core of their offers focusses on analytics and business process integration with legacy ERP and other systems.  Newer connectivity solutions such as LPWAN are not yet fully integrated into their domain expertise.  The current need for IoT network integrators is driven precisely by this need – the capability to determine the right network connectivity solution for lower tier access in terms of power consumption and cost is nascent, and this very capability is what determines whether new projects can be delivered at a reasonable ROI. 

Medium a9e7def9 945b 4108 bb3e 7650cd2a4f40

Big Data & Analytics: Trends & Developments

Big Data, Data Science and Analytics is the art and science of deriving business value from data. It was understood that if utilised correctly, data could remarkably elevate business’s ability to make insightful & strategic decisions. 

Medium 78727c7f 38f6 4532 a348 eb695dd14534

How Marketing Analytics Is Changing the Game for Lead Generation

Today’s technologies are making this easier for the savvy marketing practitioner, as there are plenty of powerful lead generation tools and marketing analytics tools that you can use to help automate labor-intensive aspects of this process and get both disciplines working in harmony.

Medium ff6c6a1e f1c7 46f4 aecb b55f8b0afccb

If machine learning isn’t saving you money, you’re doing it wrong

Machine learning is great, but its really easy to quickly become disenfranchised by it if you’re not going about it the right way. But your business and understanding of machine learning needs to take occasional false positives and negatives into account.

Medium c8a519fb 723d 4dee b74b f1f7c5452716

How Data Scientists Are Wasting Their Time

We may want our data scientists to be superheroes, but all superheroes have their kryptonite. It would seem that the main flaw with being a data scientist is the one thing data scientists cannot change – the fact that they are human. Even Mister Fantastic was only human, after all. There is no way around this, so what is the solution? Do we throw all our data scientists out onto the street and replace them with machines?

Medium a4e45216 c755 4b99 aae6 dfd357ebf4eb

The Unexpected Industries That Could Get a Boost From Self-Driving Cars

Car manufacturers, ride-hailing services, public transportation, car washes and parking garages will all go through some major shifts for obvious reasons. Driverless cars are bound to change not only the automotive industry but revolutionize our daily lives, as well.

Boston city bkg

Made in Boston @

The Harvard Innovation Lab