41

So I was experimenting with the calculator just for fun and I noticed a very common pattern as the years of experience increase.

I was running some tests against Backend Developer jobs in San Francisco with the years of experience ranging from 5 to 30 by jumps of 5. It turned out that in each jump, the calculator would add, roughly, 13.5% to the base salary (which initially was calculated for 5 years of experience). If we divide 13.5% by 5 (jump in years) we get a 2.7% increase for every year of experience one may have.

Then I ran the tests again varying the years of experience from 1 to 10 by adding one year per iteration and the result indeed was 2.7% per extra year of experience.

Not to judge too early, I did pretty much the same thing for the cities of Eindhoven and Amsterdam both in The Netherlands, where the salaries, generally speaking, are completely different (Salaries tend to be higher in Amsterdam) and the pattern arose again. This time around though, the increase in the salary per year of experience was on average 1.19%

This, apparently, is very inaccurate as the values in the calculator are completely static based in the region you query by.

One other thing I realised is that the top value in San Francisco for someone who had 30 years of experience (which is the cap for the calculator, anything beyond 30 is ignored) was $313K, which equals $26K a month! Unless you're a CTO, I doubt a backend engineer can make 26 grand a month, except of extremely rare occasions. Glassdoor, for example, says the highest salary in San Francisco for a backend engineer is $188K, which is off - according to SO's numbers - by 60%.

So my question actually is: Does the calculator consider real numbers given by developers or it just uses an average increase per region and uses that value instead to calculate the final numbers?

As I am originally from São Paulo, I decided to experiment the calculator for it as well. It turns out that for 30 years of experience, a developer, according to the calculator, can make R$1M a year! You can argue that the conversion from USD to BRL basically equals the top salary in San Francisco, but things are not that simple. R$ 1.049.000 a year means R$87K a month and I am absolutely sure no developer in Brazil will ever make that amount of money if they are enrolled in permanent positions. Although not very valuable outside Brazil, BRL kind of maps as 1-1 to USD if you consider what a good salary is (for example, 10K USD per month is a good salary in the US as much as 10K BRL per month also is a good salary in Brazil) so R$87K a month is just unreal. The numbers are way more off than what I initially thought. I am sure any Brazilian folks who happen to read this question will confirm such statement.

6
  • 10
    My guess is that they fitted a linear relation to the data, and use that linear relation in the salary tool. I'm sure there were few respondents with 30 years of experience, so the linear fit overestimates salaries for the more experienced developers. May 16, 2019 at 23:19
  • This is probably the result of the model-ation. They could just try to establish what effect has the region/country (independent variable) on the total salary (dependent variable) and only move the experience years (independent variables). Pretty standard behavior if you just want a estimator.
    – Braiam
    May 16, 2019 at 23:20
  • It's just a toy. It's not like StackOverflow is displaying a job offer for exactly this salary next to the result of the calculator. May 17, 2019 at 7:48
  • 3
    @Trilarion It is not being advertised as a toy, despite the fact you have fairly accurately described its level of reliability.
    – jpmc26
    May 17, 2019 at 10:32
  • 1
    I've found that Glassdoor salaries tend to be way too low. I think they may be pretty out of date. Also, don't forget that the people who make a ton of money may have a title with words like "senior" or "principal" or "architect" in the name that causes Glassdoor to classify them separately. May 17, 2019 at 21:02
  • 3
    I'm a backend developer in Brazil and I wish that estimation was true. May 17, 2019 at 21:11

1 Answer 1

14

Right under the results of the calculator (you can see it in your screenshot) is a link to a description of their methodology

We again this year used multiple linear regression to predict salary from the model inputs, with regularization to help with variable selection

...

This year, we built two models, one for countries with higher incomes and one for countries with lower incomes

So they took the data from the developer survey, split it into high- and low- income bins, and then fit each to a linear model. Therefore, it's no surprise that you'd get a linear relationship between experience and salary because that's how they chose to model the data.


They also acknowledge that the model is not as good at predicting salaries in countries with lower incomes, like India, Brazil, and Russia:

notice that the residuals are much higher for countries with lower incomes like India than countries with higher incomes like Sweden. We cannot predict incomes as accurately in countries with lower incomes

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .