Technology, Institutions, Public Policy
Web Development: A Careers and Skills Data Story
What careers/roles exist in web development? How are they different from each other? What skills matter the most? Which ones are gaining in prominence, which ones are losing ground? What can we say about overall demand for web development jobs? Where are these jobs located?
Read on to know the answers! These results are based on mining a dataset of more than 28 million online job postings, for the period May 2013 to September 2014.
Note: This is a small sample of my work as head data scientist for SkilledUp (now defunct). Credits shared with Olivia Zhao.
I. Flavors of web developors
A. This is how they roles
Roles in web development fall into five clearly identifiable categories. They are listed below, along with popular alternate titles used for the same role. Levels within same role (Senior, Junior, Lead etc.) are not shown. Further, it is commonplace for web development roles to have generic titles such as 'Software Engineer'. To account for these, we identified job postings which listed several web development skills in the description and included them in the 'Other' category listed below, along with the actual title matches as alternate titles.
|Role Title||Alternate Titles|
|Web Developer||Web Applications Developer, .NET Web Developer, Web Engineer, PHP Web Developer, Web Programmer, Web Architect|
|Front End Developer||Front End Web Developer, Html Developer|
|UI Developer||User Interface Developer, UI/UX Developer, Web User Interface Developer, User Interface Design Engineer|
|Full Stack Developer||Full Stack Engineer, Full Stack Software Engineer|
|Back End Developer||Backend Engineer, Backend Software Developer|
|Other||Software Engineer, Java Developer, Software Developer, .NET Developer, PHP Developer, Ruby Developer, Python Developer|
B. Relative demand
The piechart below shows how the demand is split up between the different roles, for job postings from May 2013 to September 2014. 'Web Developer' (49%) is the most common role, with 'Front End Developer' (20%) being the most common specialization.
C. So, what separates them?
Are these just fancy titles for essentially the same role? In other words, are the piechart and its companion table above fine illustrations of hair splitting? To establish the differences between roles, we look at i) the skills emphasized by each, and ii) salary statistics for them.
i. Skill break up
ii. Mo problems, Mo money
The median salary for 'Web Developer' jobs is $57,000 p.a., and it increases significantly with greater specialization in front or/and back end. The statistics shown below have been obtained from Payscale, which currently does not provide stats for 'Full Stack Developer' and hence, an estimate obtained from Indeed salaries is shown. As can be expected, 'Full Stack Developer' has the highest salary.
By way of comparison, the plot below shows the mean salaries for these roles from Indeed trends, which are significantly higher than the median values shown above, indicating a longer tail in the distribution i.e. relatively small number of jobs with much higher salaries.
Mean salaries for web development roles from Indeed.
C. Specialization please
II. Let's look at skills again
Newer skills such as Angular.js, Backbone.js, CoffeeScript etc. were missing from the skills masterlist used for this analysis. A new list is being compiled and similar stats for all such skills will be available soon.
A. Top skills
The plot below shows the relative importance of skills for all web development roles, aggreagted over May 2013 to September 2014. A minimum threshold of 10% has been applied. Note that Python (14%) and Ruby (10%) are at the lower end of the spectrum.
Skills by percentage of web development jobs posted from May 2013 to September 2014
B. Trend matters
Web development skill demand trends from May 2013 to September 2014
III. Demand and distribution.All this is fine, but how many web development jobs are really out there? Where can you interview for one?
A. Overall demand, the long and short of it
The results shown above are mostly ratios, and have the benefit of statistical aggregation. On the other hand, absolute demand is currently difficult to establish. It is not clear how comprehensive the aggregated online jobs dataset we are using is, and there is no direct reference for comparison since job aggregator sites like Indeed and SimplyHired only put out '% of jobs posted' trends. Also, what is the fraction of jobs that are not posted online? Finally, we currently only have jobs data for about 18 months, and given the well-known seasonality in hiring, conclusions about growth trends will be on shaky ground.
For these reasons, the absolute demand numbers we have can be considered indicative. As seen in the plot below, with some variations, the number of web development jobs in 2013-2014 was mostly stable, with a smoothed trend of around 6500-7000 job postings per month.
Overall job demand in web development and smoothed trend from May 2013 to September 2014
B. Geography time
The distribution of web development jobs in the US (by metro areas) is shown below. The top metro areas are NY-NJ-PA (12%), SF Bay (9%), LA (7%), Boston (6%) and Chicago (6%).
Metro-wise distribution of web development jobs in the US (below 2% not shown)