About the speaker - 0:18 Overview - 0:59 Goals - 3:13 Skills - 5:51 Data Pipelines - 6:05 Automation - 9:48 ETL Development - 13:17 Product Understanding - 15:26 Why develop data pipelines? - 16:57 Tools - 19:12 Data engineer impact - 24:16 Data Engineer vs. Data Scientist - 27:08 Data Engineer vs. Business Intelligence - 29:05 Q\A - 30:31
I really never knew what a data engineer was, after listening to this it sounds like what I support on a daily basis as a technical support engineer, i need to pursue this.
This is really interesting, my official job title is software engineer but all the work I do really revolves around Data Engineer roles. All the things you said here, like building data warehouses, etl, automation, the tools like apache airflow. I work with all those tools inclusively. So this video served as my confirmation that I am a data engineer. I enjoying what I do honestly and would like to continue with this role. I just hope it pays well.
Hmm. Considering Data Engineering re-skilling thru employer. Currently a DBA. I like the idea pipeline development, data extraction and automation. I hate the thought of dashboard development. BI Development is something I avoid.
So as a Software Architect trying to understand what Data Engineers do, Is the snowflake architecture done by a script to generate it's content via one of the slave DB to an isolated environment strictly for Data Engineers?
Oh god the way he explained what a cron was when asked what a cron is in QA... I could tell he knew what it was but horrible job explaining it by using “basically” too much. He could have simply just said that it’s a task scheduler.
![Lp. Сердце Вселенной #60 РОЖДЕНИЕ ЛОЛОЛОШКИ [Финал] • Майнкрафт](http://i.ytimg.com/vi/YoR0pAV9FVQ/mqdefault.jpg)
About the speaker - 0:18
Overview - 0:59
Goals - 3:13
Skills - 5:51
Data Pipelines - 6:05
Automation - 9:48
ETL Development - 13:17
Product Understanding - 15:26
Why develop data pipelines? - 16:57
Tools - 19:12
Data engineer impact - 24:16
Data Engineer vs. Data Scientist - 27:08
Data Engineer vs. Business Intelligence - 29:05
Q\A - 30:31
I really never knew what a data engineer was, after listening to this it sounds like what I support on a daily basis as a technical support engineer, i need to pursue this.
Aweseome. This is the path I want to pursue.
This is really interesting, my official job title is software engineer but all the work I do really revolves around Data Engineer roles. All the things you said here, like building data warehouses, etl, automation, the tools like apache airflow. I work with all those tools inclusively. So this video served as my confirmation that I am a data engineer. I enjoying what I do honestly and would like to continue with this role. I just hope it pays well.
@jon smith really?
awsome, please share the ppt with us
Hello Ahmad, PowerPoint is unavailable, but you can find the additional resources on our site: online.datasciencedojo.com/
Hmm. Considering Data Engineering re-skilling thru employer. Currently a DBA. I like the idea pipeline development, data extraction and automation. I hate the thought of dashboard development. BI Development is something I avoid.
Where can I get this PPT?
Hello Dileep, PowerPoint is unavailable, but you can find the additional resources on our site: online.datasciencedojo.com/
So as a Software Architect trying to understand what Data Engineers do, Is the snowflake architecture done by a script to generate it's content via one of the slave DB to an isolated environment strictly for Data Engineers?
good stuff
Will Data Engineering and Cloud Engineering converge to become DATACLOUD Engineering?
Do you think that this degree has a long future, or it could be automate by programmers. Thank you.
Definitely a long future for this. Data roles will take precedence over regular programming roles.
Oh god the way he explained what a cron was when asked what a cron is in QA... I could tell he knew what it was but horrible job explaining it by using “basically” too much. He could have simply just said that it’s a task scheduler.
Hi, nice information. Appreciated.
Is it safe to say that a Data Engineer is basically "a BI Developer who uses modern tools"?