#01 | What is Snowpark in Snowflake
Вставка
- Опубліковано 25 лип 2024
- In this short video titled "What Is Snowpark, Introduction & Architecture", we explore Snowpark, a new feature in Snowflake that enables data professionals to write code in their preferred language, such as Java, Python, and Scala. We start by discussing whether Snowpark is a library, API, or framework, and then provide a brief history of popular data processing tools such as Pandas, Apache Spark, and Snowflake. We explain how Snowpark is different from Apache Spark, and dive into Snowpark's computational model, which leverages in-memory computing and parallel processing. To demonstrate how Snowpark works, we provide a simple example using Python code to manipulate data within Snowflake's cloud data platform. By the end of this video, you will have a clear understanding of what Snowpark is and how it can benefit your data processing workflows and will be able to answer following questions
1. Is Snowpark a library, framework, utility, or API?
2. How does Snowpark's data frame differ from Python's Pandas data frame and Apache Spark's data frame?
3. What is Snowpark's computational approach?
4. What does a Snowpark data frame using Python look like?
5. Does Snowpark data frame also use the transformation and action approach?
6. Does Snowpark support lazily evaluation?
✏ Instagram: / learn_dataengineering
✏ Twitter: / de_simplified
✏ Facebook: learndataengineering
✏ GitHub : github.com/TopperTips
✏ Website: toppertips.com
🚀🚀 Snowpark Medium Article 🚀🚀
-----------------------------------------------------------
➥ / 8df4b6229be4
➥ Snowflake End To End Guide Cheat Sheet - bit.ly/43t5IPB
🚀🚀 Snowpark Episode-01 Video Sections 🚀🚀
----------------------------------------------------------------------------
➥ 00:00 Introduction
➥ 00:48 Welcome To Data Engineering Simplified
➥ 01:49 Episode-01 Objective & Playlist Objective
➥ 04:49 Announcement (Cheatsheet)
➥ 05:38 Pandas Vs Apache Spark Vs Snowpark
➥ 08:37 Snowpark Code Base Git Status
➥ 09:40 What is Snowpark? Library Vs API Vs Framework
➥ 12:58 Snowpark Python PIP Installation
➥ 13:22 Sample Customer Data Set
➥ 14:10 Sample Snowpark/Python Program
➥ 16:09 Running Snowpark & Snowflake Query History
➥ 18:45 Snowpark Architecture - Under The Hood
➥ 20:45 What is next & Thank You Note
🚀 🚀 Everything About Snowpark Playlist 🚀 🚀
--------------------------------------------------------------------------------
✏ Ch-01 What Is Snowpark, Its Introduction & Architecture? • #01 | What is Snowpark...
✏ Ch-02 What is NOT Snowpark? • #02 | What Is NOT Snow... .
✏ Ch-03 Who Should Learn Snowpark? • #03 | Who Should Lear...
✏ Ch-04 Where To Learn Snowpark From? • #04 | Where To Learn ...
✏ Ch-05 Can A SQL Developer Learn Snowpark? • #05 | How SQL Develop...
✏ Ch-06 Can we write snowpark in Python, Scala or Java Programming Languages? • #06 | Snowpark API Fo...
✏ Ch-07 Can I run snowpark in Databricks notebooks? • #07 | Run Snowpark On ...
✏ Ch-08 Can Snowpark run inside Snowflake Cloud Data Warehouse? • #08 | How To Deploy & ...
✏ Ch-09 Will Apache Spark Survive? • #09 | Snowpark Vs. Apa...
✏ Ch-10 Snowpark and Future of ADF, Databricks & Azure Synapse Analytics? • #10 | Snowpark Vs. ADF...
✏ Ch-11 Apache Spark to Snowflake Snowpark Migration Roadmap? • #11 | Apache Spark To ...
✏ 12 Snowpark Python Vs Snowpark Scala Vs. Snowpark Java? (12/15 coming soon...)
🚀 🚀 Other Playlist by Data Engineering Simplified 🚀 🚀
----------------------------------------------------------------------------------------------
➥ Snowflake Snowpark Python Example Playlist • Snowpark Tutorial | Le...
🚀 🚀 Other Playlist By Data Engineering Simplified 🚀 🚀
----------------------------------------------------------------------------------------------
➥ Complete Snowflake Master Class 🌐 bit.ly/snowflake-tutorial
➥ Data Loading In Snowflake Master Class 🌐 bit.ly/load-data-into-snowflake
➥ SnowPro Certification Mock Test Papers 🌐 bit.ly/snowpro-mock-test
➥ SnowPro Certification Guide 🌐 bit.ly/snowpro-certification-v1
#snowpark
#snowflake
#snowflaketutorial
#snowflakedatawrehouse
#snowflakecomputing
#clouddatawarehouse
#snowparktutorial
Disclaimer: All snowflake-related learning materials and tutorial videos published in this channel are the personal opinions of the data engineering simplified team and they're neither authorised by nor associated with Snowflake, Inc.
The easiest-to-understand video about Snowpark. Thank you
Glad it was helpful!
Great effort in educating people with your videos. Can’t appreciate your effort enough with words. I have been watching all your playlists and I must say I’m hooked up to your channel so much. Thanks again for these wonderful knowledge sharing videos
So nice of you
Perfect compilation of information. Thank you.
Thanks for your note..
This is the best video so far describing what Snowpark is, thank you for sharing 🙏🏼
Glad it was helpful!
Very informative video having information which are not easily available over internet. Loved the first episode, eagerly waiting for following episodes.
Thanks a ton
I thought of asking you about the snowpark, But you started, Good to see sir
Yes, thanks
Thanks! - 13 Feb 2024 - 08:41 PM IST
Great content again. Thanks alot. Eagerly waiting for all the 15 episodes. I have seen snowflake videos many times and learnt a lot and still watching.
Can we expect one snowspark video every week? 🙂
glad .. you liked all my videos... will try to publish one video every week...
Great content. Thanks.
Glad you liked it!
Very nice video playlists Sir. I am learning everyday from your videos. It would be much helpful if you also upload videos on Data structure and algorith using python
Thanks for your note.. for now my focus is on Snowflake..
Thank you sir!
Welcome
How to extract the .gz file from stage to snowflake folder ? and how you maintaining the .csv files in separate folder in snowflake. Thanks
If I'm a SQL developer familiar with writing SQL, does that mean I can just write my code in SQL without needing to use Snowpark?
Where your snowflake is installed or can you explain how can i integrate snowflake and snowpark in my local windows system
If you are using python, then you need to have python 3.8.x (not higher version, else it will not work) and then use pip to install your snowflake-python-snowpark library and it will automatically be available for use. Once it is done, you can use session api to connect (I am releasing a video on this soon)
Great video..
But question
1.when data present in snowflake the easiest wat to trasform the data using sql.why we need snowpark here?
2.can we use snowpark as a ETL like Talend or iics(taking the data from other rdbms table or file system) or this just for elt?
There are couple of reason
1. A team is migrating their work from PySpark or Spark to Snowpark, then you can use the same set of code without writing a fresh SQL statement and save tons of effort.
2. Having a DevOps based ETL development in some strict environment is more easy for Python based tool than using SQL
3. If your team is not good with SQL, then programming is the best approach (this will surprise you, but there are many who are very good in programming but poor in SQL)
4. Programming gives lot of code re-usability and library integration and much more easy to work than working with large SQLs.
Follow my channel and I am going to publish a video that will talk about end to end ETL using Snowpark for data engineers.
@Data Engineering Simplified thank you . What do you suggest? How important DBT is to work on snowflake, creating data model.
@@subhojyotiganguly5013 dbt is getting very popular and yes, you can certainly used dbt. DBT is one of the future tool becoming very popular alongside snowflake.
I am almost done with the snowflake video series. I have started giving interviews but as far as I understand there are very less calls for snowflake right now. Can we expect a good amount of interview calls at least from mid of May and June. Could you pls share ur thoughts on this. Thanks in advance.
Snowflake is a cloud data warehouse platform.. and you must have data warehouse knowledge or data engineering knowledge alongside snowflake.. else it will be hard to get a call... it also depends on what is your current year of experience ...
Very great knowledge..but even being in uk z there is calls for snowflake.. you should know our tools too to crack the jobs..
Hi
How much syllabus covered Snowflake Advanced Data engineer certification
A lot + including scenario based questions..
@@DataEngineering Could you please share the play list link here for snowflake advanced certification. not able to find from your channel.
where to find this code ?
Please check this medium blog for code.. medium.com/@data-engineering-simplified/588b19591b47
Are you the same tutor who had udemy course on aws redshift and related
No.. here is my udemy contents
These contents are available in udemy.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command...
1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/
2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/