Why is Becoming a Data Scientist so Difficult?

Why is Becoming a Data Scientist so Difficult?


This question was recently posted on Quora. Blow is my answer.
It depends what kind of data scientist you want to become. I think many university curricula include material that is advanced but that you don’t really need. Also, they offer not enough practical, professional coding and big data manipulation that would help you right away when starting a career. It also depends on your background: mine was math, stats, data analysis, and applied computer science, so the transition was obvious and just simply about changing my job title.

You can do great implementations and analyses even if you know little statistics. Most of my data science projects (for instance image analysis or automated stock trading) involved designing algorithms, some doing the same thing as complex statistical techniques such as random forests, yet the algorithms themselves could be understood without statistical or mathematical knowledge, and could as well have been designed by software engineers who do not usually call themselves data scientists. It is particularly true if you design tools to beat your competitors: all of them are using the same techniques; if you come up with something original that works, you are more likely to successfully compete with them, whether your tool relies on advanced statistical models, or no statistical model at all. In a different context, I performed non-standard statistical testing in a way that does not involve using probability theory: it was all data-driven (bottom-up approach) rather than theory-driven (top-down.)
I find sales to be more difficult than data science, and more rewarding financially. Of course, it depends on what you are selling, but selling data science software to a large corporation for instance, is more difficult than succeeding as a data scientist working for that same company, in my opinion.
Related articles

22 Differences Between Junior and Senior Data Scientists
The First Things you Should Learn as a Data Scientist – Not what yo…
Full Stack Data Scientist: The Elusive Unicorn and Data Hacker
Statistical Significance and p-Values Take Another Blow
Are data science or stats curricula in US too specialized?
How do you identify an actual data scientist?
Is it still possible today to become a self-taught data scientist?
Will the job outlook for data scientists severely decline after 2020?
Why Logistic Regression should be the last thing you learn when bec…
What do mathematicians mean by good math and bad math?
Two Questions to Ask to a PhD Candidate for a Leadership Role
5 Myths About PhD Data Scientists
First Doctorship in Data Science
Why so many Machine Learning Implementations Fail?
What you won’t learn in stats classes
Biased vs Unbiased: Debunking Statistical Myths

For related articles from the same author, click here or visit www.VincentGranville.com. Follow me on on LinkedIn, or visit my old web page here.
DSC Resources

Invitation to Join Data Science Central
Free Book: Applied Stochastic Processes
Comprehensive Repository of Data Science and ML Resources
Advanced Machine Learning with Basic Excel
Difference between ML, Data Science, AI, Deep Learning, and Statistics
Selected Business Analytics, Data Science and ML articles
Hire a Data Scientist | Search DSC | Classifieds | Find a Job
Post a Blog | Forum Questions


Link: Why is Becoming a Data Scientist so Difficult?