{"id":931,"date":"2018-10-16T04:44:10","date_gmt":"2018-10-16T01:44:10","guid":{"rendered":"http:\/\/kusuaks7\/?p=536"},"modified":"2021-05-11T14:00:28","modified_gmt":"2021-05-11T14:00:28","slug":"the-most-in-demand-skills-for-data-scientists","status":"publish","type":"post","link":"https:\/\/www.experfy.com\/blog\/bigdata-cloud\/the-most-in-demand-skills-for-data-scientists\/","title":{"rendered":"The Most in Demand Skills for Data Scientists"},"content":{"rendered":"

Ready to learn Data Science? Browse Data Science Training and Certification<\/a> courses developed by industry thought leaders and Experfy in Harvard Innovation Lab.<\/em><\/strong><\/p>\n

What are employers looking for?<\/h4>\n

Data scientists are expected to know a lot — machine learning, computer science, statistics, mathematics, data visualization, communication, and deep learning. Within those areas, there are dozens of languages, frameworks, and technologies data scientists could learn. How should data scientists who want to be in demand by employers spend their learning budget?<\/p>\n

I scoured job listing websites to find which skills are most in demand for data scientists. I looked at general data science skills and at specific languages and tools separately. I searched job listings on LinkedIn<\/a>, Indeed<\/a>, SimplyHired<\/a>, Monster<\/a>, and AngelList<\/a> on October 10, 2018. Here’s a chart showing how many data scientist jobs each website listed.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

I read through many job listings and surveys to find the most common skills. Terms like management<\/em> were not compared because they can be used in so many different contexts in job listings.<\/p>\n

All searches were performed for the United States with “data scientist” “[keyword]”<\/em>. Using exact match search reduced the number of results. However, this method ensured the results were relevant for data scientist positions and affected all search terms similarly.<\/p>\n

AngelList provides the number of companies with data scientist listings rather than the number of positions. I excluded AngelList from both analyses because its search algorithm seems to operate as an OR <\/em>type of logical search, without the ability to change it to an AND<\/em>. AngelList works fine if you are looking for “data scientist” “TensorFlow”<\/em> which is only going to be found with data scientist positions, but if your keywords are “data scientist” “react.js”<\/em> it returns far too many listings for companies with non-data scientist job listings.<\/p>\n

Glassdoor<\/a> was also excluded from my analyses. The site stated that it had 26,263 “data scientist”<\/em> jobs in the US, but it would show me no more than 900 jobs. Additionally, it seems highly unlikely it would have more than three times the number of data scientist job listings as any other major platform.<\/p>\n

Terms with over 400 listings on LinkedIn for general skills and over 200 listings for specific technologies were included in the final analyses. There was certainly some cross posting. The results are recorded in this Google Sheet<\/a>.<\/p>\n

I downloaded .csv files and imported them into JupyterLab. I then computed the percentage occurrences and averaged them across the job listing websites.<\/p>\n

I also compared the software results to a Glassdoor study<\/a> of its data scientist job listings from the first half of 2017. Combined with information from KDNuggets’ usage survey<\/a>, it appears some skills are becoming more important and others are losing importance. We’ll get to those in a bit.<\/p>\n

See my Kaggle Kernel for interactive charts and additional analyses here<\/a>. I used Plotly for the visualizations. To use Plotly with JupyterLab takes a little wrangling as of this writing — instructions are at the end of my Kaggle Kernel and in Plotly’s docs<\/a>.<\/p>\n

General Skills<\/h3>\n

Here’s the chart of the most frequent general data scientist skills sought by employers.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

The results show that analysis and machine learning are at the heart of data scientist jobs. Gleaning insights from data is a primary function of data science. Machine learning is all about creating systems to predict performance and it is very in demand.<\/p>\n

Data science requires statistics and computer science skills — no surprise there. Statistics, computer science, and mathematics are also college majors, which probably helps their frequency.<\/p>\n

It is interesting that communication is mentioned in nearly half of job listings. Data scientists need to be able communicate insights and work with others.<\/p>\n

AI and deep learning don’t show up as frequently as some other terms. However, they are subsets of machine learning. Deep learning is being used for more and more of the machine learning tasks that other algorithms were used for previously. For example, the best machine learning algorithms for most natural language processing problems are now deep learning algorithms. I expect deep learning skills will be sought more explicitly in the future and that machine learning will become more synonymous with deep learning.<\/p>\n

Which specific software tools for data scientists are employers looking for? Let’s tackle that question next.<\/p>\n

Technology Skills<\/h3>\n

Below are the top 20 specific languages, libraries, and tech tools employers are looking for data scientists to have experience with.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Let’s briefly look at the most common tech skills.<\/p>\n

\n

<\/p>\n<\/figure>\n

Python<\/a> is the most in-demand language. The popularity of this open-source language has been widely observed. It’s beginner friendly, with many support resources. The vast majority of new data science tools are compatible with it. Python is the primary language for data scientists.<\/p>\n

\n

<\/p>\n<\/figure>\n

R is not far behind Python. It once was the primary language for data science. I was surprised to see how in demand it still is. The roots of this open source language are in statistics, and it’s still very popular with statisticians.<\/p>\n

Python or R is a must for virtually every data scientist position.<\/p>\n

\n

<\/p>\n<\/figure>\n

SQL<\/a> is also in high demand. SQL stands for Structured Query Language and is the primary way to interact with relational databases. SQL is sometimes overlooked in the data science world, but it’s a skill worth demonstrating mastery of if you’re planning to hit the job market.<\/p>\n

\n

<\/p>\n<\/figure>\n

\n

<\/p>\n<\/figure>\n

Up next are Hadoop<\/a> and Spark<\/a>, both open source tools from Apache for big data.<\/p>\n

Apache Hadoop is an open source software platform for distributed storage and distributed processing of very large data sets on computer clusters built from commodity hardware.\u200a—\u200aSource<\/a>.<\/p><\/blockquote>\n

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development APIs to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.\u200a—\u200aSource<\/a>.<\/p><\/blockquote>\n

These tools have considerably less written about them on Medium and in tutorials than many others. I expect many fewer job candidates have these skills than Python, R, and SQL. If you have or can gain experience with Hadoop and Spark it should give you a leg up on the competition.<\/p>\n

\n

<\/p>\n<\/figure>\n

\n

<\/p>\n<\/figure>\n

Then come Java<\/a> and SAS<\/a>. I was surprised to see these languages as high as they are. Both have large companies behind them, and at least some free offerings. Both Java and SAS generally receive little attention in the data science community.<\/p>\n

\n

<\/p>\n<\/figure>\n

Tableau<\/a> is next in demand. This analytics platform and visualization tool is powerful, easy to use, and growing in popularity. It has a free public version, but will cost you money if you want to keep your data private.<\/p>\n

If you aren’t familiar with Tableau, it’s definitely worth taking a quick class such as Tableau 10 A-Z<\/a> on Udemy. I don’t get a commission for the suggestion— I just took the class and found it to be a great value.<\/p>\n

The chart below shows an even bigger list of the most in demand languages, frameworks, and other data science software tools.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

Historical Comparison<\/h4>\n

GlassDoor did an analysis<\/a> of the 10 most common software skills for data scientists from January 2017 through July 2017 on their site. Here’s a comparison of how frequently the terms appeared on their site compared to the average on LinkedIn, Indeed, SimplyHired, and Monster in October 2018.<\/p>\n

\n

<\/canvas><\/p>\n<\/figure>\n

The results are fairly similar. Both my analysis and GlassDoor’s found Python, R, and SQL to be the most in demand. We also found the same top nine technology skills, albeit in slightly different orders.<\/p>\n

The results suggest that compared to the first half of 2017, R, Hadoop, Java, SAS, and MatLab are now less in demand and Tableau is more in demand. This is what I would expect given the complementary results from sources such as the KDnuggets developer survey<\/a>. There, R, Hadoop, Java, and SAS all show clear multi-year downward usage trends and Tableau shows a clear upward trend.<\/p>\n

Recommendations<\/h3>\n

Based on the results of these analyses, here are some general recommendations for current and aspiring data scientists concerned with making themselves widely marketable.<\/p>\n