It's Over.. Becoming a Data Engineer is a Scam
Вставка
- Опубліковано 5 лют 2025
- Get cloud certified and fast-track your way to become a cloud professional. We offer exam-ready Cloud Certification Practice Tests so you can learn by practicing 👉 getthatbadge.com/
Feel like touching grass and attending in-person events? Join our Data & AI Meetup group in South East England 👉 www.meetup.com...
Connect on LinkedIn 👉 / decisionforest
Follow on TikTok 👉 / decisionforest
Join the Discord 👉 / discord
---
Microsoft Azure Certified:
AI-900: Azure AI Fundamentals 👉 decisionforest...
AI-102: Azure AI Engineer 👉 decisionforest...
AZ-104: Azure Administrator 👉 decisionforest...
AZ-204: Azure Developer 👉 decisionforest...
AZ-305: Azure Solutions Architect 👉 decisionforest...
AZ-400: Azure DevOps Engineer 👉 decisionforest...
AZ-500: Azure Security Engineer 👉 decisionforest...
DP-100: Azure Data Scientist 👉 decisionforest...
DP-203: Azure Data Engineer 👉 decisionforest...
DP-300: Azure Database Administrator 👉 decisionforest...
DP-600: Microsoft Fabric Certified 👉 decisionforest...
Databricks Certified:
Databricks Machine Learning Associate 👉 decisionforest...
Databricks Data Engineer Associate 👉 decisionforest...
---
COURSERA SPECIALIZATIONS:
📊 Google Advanced Data Analytics 👉 decisionforest...
🛡️ Google Cybersecurity 👉 decisionforest...
📊 Google Business Intelligence 👉 decisionforest...
🛠 IBM Data Engineering 👉 decisionforest...
🔬 Databricks for Data Science 👉 decisionforest...
🧱 Learn Azure Databricks 👉 decisionforest...
COURSES:
🔬 Data Scientist 👉 decisionforest...
🛠 Data Engineer 👉 decisionforest...
📊 Data Analyst 👉 decisionforest...
LEARN PYTHON:
🐍 Learn Python 👉 decisionforest...
🐍 Python for Everybody 👉 decisionforest...
🐍 Python Bootcamp 👉 decisionforest...
LEARN SQL:
📊 Learn SQL 👉 decisionforest...
📊 SQL Bootcamp 👉 decisionforest...
LEARN STATISTICS:
📊 Learn Statistics 👉 decisionforest...
📊 Statistics A-Z 👉 decisionforest...
LEARN MACHINE LEARNING:
📌 Learn Machine Learning 👉 decisionforest...
📌 Machine Learning A-Z 👉 decisionforest...
📌 MLOps Specialization 👉 decisionforest...
📌 Data Engineering and Machine Learning on GCP 👉 decisionforest...
---
📚 Books I Recommend 👉 www.amazon.com...
Disclaimer: I may earn a commission if you decide to use the links above. Thank you for supporting the channel!
#decisionforest
Data Engineering is not a scam. It is simply a new name that replace "SQL developer", "DBA", "Data Migration Developer", "Business Intelligence Developer", "Data Warehouse developer", etc. Also, there are different level of data engineering. Some people only use SQL, other only use Python/Pyspark. Senior DE use both. It doesn't matter which platform (Azure, AWS, etc). To claim that DE is just about ETL is not understanding the market at all (especially the UK market).
You must have missed the point, never claimed that DE is just about ETL.
You are 💯 correct on this. I also work as data engineer but what i do is SQL developer jobs and a lot of etl and automation.
That is data engineering lol. @@ak47ava
I can agree that it is possible to use SQL or Python, but what you said about clouds is such an extensive topic that I don't think it would be possible for a senior developer to jump from one cloud to another in a short period of time.
@@takariksonHe probably means it would be easy for a senior developer to under the concepts. Understanding the UI is probably the hard part 😂
Very annoying click bait to explain something so basic. Technology won't ever stop evolving, ofcourse there'd be new ways coming up to do the same job, so you're gonna call it a scam? Be mindful about your content, as it can demotivate someone who's still learning. A job or skill won't lose its worth just because you don't understand its significance (despite having experience), or just because you don't find it fulfilling. Please find better words to educate.
Data Engineering is a specialization of backend software engineering. Python and SQL are the basics to begin with but if you stay on those you will just be an analytics engineer if you add dashboards and reports(or BI engineer). In larger companies(big tech for example), there isn't data engineering. It's just software engineer-data, which is a data engineer in scale. A data engineer should now the insides and outs of databases(and data warehousing, data modeling, etc) and big data systems, so Java/Scala knowledge is very important. Data platforms are very difficult to create and maintain and a data engineer is the suitable professional
You can also easily pivot from Data Engineering to Cloud Engineering
Correct, most people are doing this cause most of the work is Cloud based
The content is beautiful and truthful. The title is misleading and clickbaity. My attention could have been captured with less inflammatory statements.
Thank you 🙏 trying to say things as they are, at least from my pov. On the title and thumbnail, it got you to click and that was the goal - hoping that the content would be satisfying ☺️
@@DecisionForest i understand, your POV is clear and is representative of the reality. The thumbnail is alright. The title is not it. You might have dissuaded younger minds on the topic. I don't think that's the goal. We can agree to disagree. Keep telling the truth. All in all, i got the message loud and clear.
@iankangethe1820 thank you mate, tbf I put the title like this also cause it really does feel sometimes that we’re all getting scammed in this tech market 😁 hopefully younger people don’t get too discouraged as tech is still a great industry
The problem of automation and competition is common in all Tech jobs today. Not only data engineering.
100%
Half of your points relate to all tech jobs. Like learning is endless, projects are driven by fundrasing on new tech terms(AI, DE, Devops), etc.
100%
I agree. I have been working as a data engineer for quite some time. The scope has become limitless as platform and infrastructure engineering is clubbed with it and somehow data engineers are supposed to be expert in DevOps and to solve DSA interview questions these days. And don’t forget about cloud. That’s like taken for the granted
The irony of someone putting a dishonest clickbait title in his video, calling something else a scam💀
Testing a couple of thumbnails, but I hope you still enjoyed it ☺️
@@DecisionForestCover up the scam in name of experimenting... 🤡 🤡 🤡
The big craze now is Python. R, though very good at what does has been tossed aside for the often inferior Python. Really, coding aside, though, the best path may very well be simply what is most understood and used by companies. Products like Power BI, Excel, and yes, MS Access. These are what nearly all companies use. Add to that, where this video started, command line(BASH) and SQL. Start, master and adjust along these lines, and you will have more useful skills than most C-Suites know what to do with.
You’ve got a point there, that’s why Microsoft Fabric will be huge and the new mix of data engineer + analyst = analytics engineer role will be sought after in the near future
Thank you to anyone who speaks honestly about this profession amidst the glamour often created around it, likely fueled by the push to sell courses or garner likes on videos. There's no doubt it’s been over-glamorized. While being a consultant working on diverse projects can be rewarding, the reality for most data engineers is quite different. For the majority, roughly 80% of the work revolves around maintenance and operations tasks, rather than innovative development.
I like the DE endgame portrayed for a split second around @5:07. And getting specialized in one of the cloud providers stack won't make you more successful. You should look at concepts rather than implementation - doing it this way will unblock you. And I mean not like don't get deep into them as that's how you'll probably learn the basics but try to balance it out.
Man I am data engineer, I really agree with you. I alwasy expected that this would happen sometimes, so I always tried to be SE, disguised as DE :), to be honest, it really worked out a lot, because I can do both now.
That’s the best thing you can do, gaining DE skills once you focus on SE is marginal so you can do multiple jobs when needed
@@DecisionForest
i have 3 years of experience as a python developer. now thinking to move for AZURE DE.
am i going on right path. or should i continue as a backend developer only
@@shyammaths5705 Well it depends on your situation, in my view, if you are already good in backend development then go for the full-stack development part. Become good at it and integrate the AI offering in your software (like OpenAI APis) to bring the AI features into your product. Trust me, this is going to be more rewarding down the line.
I'm more of a Data Analyst that knows how to write code and use databases. I'm the only one in my team that can do that effectively, which I found quite shocking.
That is shocking, what’s the team structure?
Data engineer is saturated market already. Even car mechanic earn more than Master of science degree holder in computer science.
getting a job in general is a scam lol. Better of building a solo dev agency. Or at least that's what I'm trying to do cause I couldn't get a job for the life of me haha
That’s true. Entrepreneurship in tech, even at a smaller scale, is the future and happy to see you started.
need more small, medium size companies so not everyone try to get into fang
Data analyst:
SQL
Python
Excellent
Tableau
Power BI
In my country I see mostly data analyst offers, in the case of cybersecurity there are hardly any offers and web development, the latter being oversaturated, is more scarce.
The majority of work is the same everywhere, companies needs analytics as that’s tangible, gets the business excited. Cybersecurity is important but not big enough in terms of jobs
@@DecisionForest I realize that in the range of 100 offers at least 80 are for data analysts or data related in terms of technology positions according to what I see in the job offers. thank you for your answer
@elliscaicedo9045 I’m not familiar with the exact numbers but data is definitely the hot thing right now as companies need to make sense of their own data in order to “leverage AI”. In the next year or so I assume this trend will continue for engineers and analysts. Less for data scientists cause now companies want analysts to have “some” scientist skills.
I’m currently a BI analyst who wants to go into data engineering. Does this move worth?
Its not a scam, whats a scam is central banking
The funny thing with data is that companies overpaid some junior people lol...all that hype.
I think the real scam is this kind of content, personally I have been in a career shift crisis, trying to learn and break into IT industry by learning data engineering and following the roadmap. Whenever I open youtube I get this type of videos discoraging people from Data engineering, data science, data analysis ... every job there is. what shall we do ? just sit back at home and stop working anything ???
Tries to sell
Us education course at the end ?? I’m a noob trying to get into the data industry, can anyone vouch on the best next steps? I’m doing the Google data analyst cert but I’m moving towards pipeline once I’m done learning the cert.
I agree ! Same feeling after working on a project for 1 year …… i really wanted to upskill at got into another company where i again landed in similar project😢
It’s all the same +-10%
How do i report this video for misleading information and clickbait to shill his course
@@Test-ci7sd firstly everything I talk about is from my own experience as a working professional in the field. Secondly, I don’t shill a course, I promote a business like every creator on UA-cam. Thank you for taking the time to watch the video
I'm Data engineer , am I that bad 😢😣
@@morrazzo4432 of course not Morrazzo, wasn’t talking about you ☺️
So basically you build the databases and after that you get paid to do nothing? That sounds like a drema job
@@angelacevedogarcia1895 wish it was this easy ☺️
Nah, after which is maintenance + other new db related migrations + more maintenance. Automation wise, might come in during the maintenance phase.
DE is not a scam. This just to get more views.
@@sajidsarkar9574 never said DE is a scam. See the video and decide for yourself
I saw document when AI is coding Python. You just give orders in english. Aswell me as automation engineering and Cad designer must focus to new A.I. - CAD softwares and forget old Autocad etc...
Why I have switched from Data Analyst to Data Engineering...........Few months later.........It's Over, Data Engineering is a scam 😂😂😂😂
@@adityagoyal6964 it’s a rollercoaster ride 😁
This is so true!! DE is a dead end career.
He said what I was thinking a long time already !!
@@maikoke6768 great minds think alike 😋
If its a scam why are you offering data engineering services..Thanks but no thanks
Now it is Moneyyy $$$ Eng I neering!
Get that cash 💰
Very knowledgeable. Thanks for opening our brains
Appreciate the kind words 🙏
You are hurting ETL developers with facts
@@doitteluguian982 facts are the worst
data architecture, data models, how to stream massive realtime and tranform in time, understand data governance, compute tuning and delta/iceberg format is not gonna be replace. BA is not only consumer, LLM model and other ML model also rely on quality data. Data engineer is working on boring stuff, but so as blue collar workers, are you saying plumber, house flipper, A/C engineer are not making good money? You just know a scratch of data engineer, DE is not only ETL
Oh, until I saw cloud promo. Finally I understand. Tbh as cloud engineer from AWS, cloud skills is a must for every engineer, cloud engineer is already dead like sde in test
Never said DE is only ETL. Also I’m not comparing DE to manual labour jobs. Not sure what you mean by listing delta and iceberg data formats there. They’re just data formats, it’s like saying csv and json is not gonna replace what? can you detail please?
Exactly, now most of the work is cloud based and broader skills are necessary
@@DecisionForest DE is like labor dirty jobs, but those fields needs engineers to make things happen, however fancy AI boys dont want to get hands dirty. Understand characteristic of combination of data format, data platform, data model, cicd, sdlc, different source, how to governance data, MPP tuning, CDC, schema/partition evolution, comprehensive cloud knowledge etc many of those are based on experience and tech stacks more complex than other data jobs.
Nowadays every business decision is data driven, data quality and SLA is the key for business decision and model accuracy, I dont understand why not study DE. DE also a better path to go to MLE if you do not have AI phd with top research paper
I completely agree. The problem that I see is that it’s a set of skills that keeps growing and encompasses more and more for it to be a job that a beginner could do. The reasons why I said it’s a scam refer to beginners being told they can just jump on the bandwagon. I am still learning all the time even after so many years in the field and for some to believe that it’s a short path, it sets them up for disappointment.
every tech job... 😁
Sick
😂💯