![Rajiv Gupta - Everyday Learning](/img/default-banner.jpg)
- 109
- 179 513
Rajiv Gupta - Everyday Learning
India
Приєднався 4 кві 2009
This channel is dedicated to Snowflake, Azure and is presented for the benefit of the community. I hold multiple certification like Azure, Snowflake, Oracle Cloud etc.
With more than 15 years of IT experience in a variety of different areas, I had worked majorly on Database.
Being Snowflake Data Super Hero and part of the most active community my goal is to share knowledge to all who wanted to grow in the IT world. It will be my pleasure to help them through my blogs, UA-cam channel or linked query support. Often people are hardworking, but they don't find the guide to show them the correct path. I want to be that guide so that others don't feel what I felt during my journey.
Stay with me to get all snowflake, Azure learning videos.
With more than 15 years of IT experience in a variety of different areas, I had worked majorly on Database.
Being Snowflake Data Super Hero and part of the most active community my goal is to share knowledge to all who wanted to grow in the IT world. It will be my pleasure to help them through my blogs, UA-cam channel or linked query support. Often people are hardworking, but they don't find the guide to show them the correct path. I want to be that guide so that others don't feel what I felt during my journey.
Stay with me to get all snowflake, Azure learning videos.
Snowflake Admin Series: Identified First Login | Rajiv Gupta Learn Everyday
Identifier-first login allows Snowflake to identify a user before presenting authentication options. In this flow, Snowflake prompts the user for their email address or username only, then displays authentication options based on the identity of the user.
An identifier-first login reduces confusion and login issues by only showing users’ valid authentication options. For example, identifier-first login can do the following:
In an environment that uses multiple identity providers, it can restrict single sign-options to include only those identity providers that are associated with the user.
When combined with an authentication policy, it can hide the password option for users who need to be using an identity provider to authenticate.
An identifier-first login reduces confusion and login issues by only showing users’ valid authentication options. For example, identifier-first login can do the following:
In an environment that uses multiple identity providers, it can restrict single sign-options to include only those identity providers that are associated with the user.
When combined with an authentication policy, it can hide the password option for users who need to be using an identity provider to authenticate.
Переглядів: 436
Відео
Snowflake Admin Series: Authentication Policies | Rajiv Gupta Learn Everyday
Переглядів 5166 місяців тому
Authentication policies help you take control on how you want a particular user /client to connect. This narrow down the security perimeter and scope of security lapse by reducing their diameter of access ways. Restrict client/user to choose one or multiple ways they can connect to snowflake using Snowsight or Classic Console, drivers, or SnowSQL (CLI client). You can also decide on the allowed...
Reaction On Snowflake Dev Conference for AI & Apps | Rajiv Gupta Learn Everyday
Переглядів 2567 місяців тому
People Feedback On Snowflake Dev Conference for AI & Apps happened on 17th Jan,2024 at JW Marriott.
Snowflake Admin Series: Organization Account Restore | Rajiv Gupta Learn Everyday
Переглядів 479Рік тому
An organization is a first-class Snowflake object that links the accounts owned by your business entity. Organizations simplify account management and billing, Replication and Failover/Failback, Snowflake Secure Data Sharing, and other account administration tasks. This feature allows organization administrators to view, create, and manage all of your accounts across different regions and cloud...
Snowflake Admin Series: Organization Account Drop | Rajiv Gupta Learn Everyday
Переглядів 416Рік тому
An organization is a first-class Snowflake object that links the accounts owned by your business entity. Organizations simplify account management and billing, Replication and Failover/Failback, Snowflake Secure Data Sharing, and other account administration tasks. This feature allows organization administrators to view, create, and manage all of your accounts across different regions and cloud...
Snowflake Admin Series: Organization Account Rename | Rajiv Gupta Learn Everyday
Переглядів 346Рік тому
An organization is a first-class Snowflake object that links the accounts owned by your business entity. Organizations simplify account management and billing, Replication and Failover/Failback, Snowflake Secure Data Sharing, and other account administration tasks. This feature allows organization administrators to view, create, and manage all of your accounts across different regions and cloud...
Snowflake Admin Series: Fetch Organization Name | Rajiv Gupta Learn Everyday
Переглядів 375Рік тому
An organization is a first-class Snowflake object that links the accounts owned by your business entity. Organizations simplify account management and billing, Replication and Failover/Failback, Snowflake Secure Data Sharing, and other account administration tasks. This feature allows organization administrators to view, create, and manage all of your accounts across different regions and cloud...
Snowflake Streams on View | Rajiv Gupta Everyday Learning
Переглядів 528Рік тому
Streams on views support both local views and views shared using Snowflake Secure Data Sharing, including secure views. Currently, streams cannot track changes in materialized views. BLOG: medium.com/r/?url=https://blog.devgenius.io/table-stream-in-snowflake-48c050b38e10
Snowflake - How To Share The Replicated Database | Rajiv Gupta Everyday Learning
Переглядів 1,1 тис.Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Fail-Over/Fail Back | Rajiv Gupta Everyday Learning
Переглядів 922Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Replication | Rajiv Gupta Everyday Learning
Переглядів 3,1 тис.Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Replication & Clustered Materialized View | Rajiv Gupta Everyday Learning
Переглядів 486Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Replication & Table Clustering | Rajiv Gupta Everyday Learning
Переглядів 466Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Replication- Monitoring & Data Compare | Rajiv Gupta Everyday Learning
Переглядів 1,1 тис.Рік тому
When any organization wants to replicate or sync any database from one account to another account within the same organization automatically across region and even across cloud provider . Replicated copy of database in secondary or target account is always read-only copy, and you will not able to perform any DML or DDL operation on them. Database replication is a standard feature and available ...
Snowflake Database Replication- Database Role & Account Role | Rajiv Gupta Everyday Learning
Переглядів 593Рік тому
Snowflake Database Replication- Database Role & Account Role | Rajiv Gupta Everyday Learning
Snowflake Shared Database Role | Rajiv Gupta Everyday Learning
Переглядів 851Рік тому
Snowflake Shared Database Role | Rajiv Gupta Everyday Learning
Snowflake Database Role Behavior With Database Cloning | Rajiv Gupta Learn Everyday
Переглядів 461Рік тому
Snowflake Database Role Behavior With Database Cloning | Rajiv Gupta Learn Everyday
Snowflake Database Role Usage And Behavior With Account Role | Rajiv Gupta Learn Everyday
Переглядів 1,5 тис.Рік тому
Snowflake Database Role Usage And Behavior With Account Role | Rajiv Gupta Learn Everyday
Account Replication and Failover - Replication Group | Rajiv Gupta Learn Everyday
Переглядів 1,4 тис.Рік тому
Account Replication and Failover - Replication Group | Rajiv Gupta Learn Everyday
Account Replication and Failover - Link Account object | Rajiv Gupta Learn Everyday
Переглядів 407Рік тому
Account Replication and Failover - Link Account object | Rajiv Gupta Learn Everyday
Account Replication and Failover - New Object Addition to Replication | Rajiv Gupta Learn Everyday
Переглядів 329Рік тому
Account Replication and Failover - New Object Addition to Replication | Rajiv Gupta Learn Everyday
Account Replication and Failover - Enable Task & Stream Replication | Rajiv Gupta Learn Everyday
Переглядів 416Рік тому
Account Replication and Failover - Enable Task & Stream Replication | Rajiv Gupta Learn Everyday
Account Replication and Failover - Failover to Secondary Account | Rajiv Gupta Learn Everyday
Переглядів 389Рік тому
Account Replication and Failover - Failover to Secondary Account | Rajiv Gupta Learn Everyday
Account Replication and Failover - Failover Group | Rajiv Gupta Learn Everyday
Переглядів 2 тис.Рік тому
Account Replication and Failover - Failover Group | Rajiv Gupta Learn Everyday
Account Replication and Failover - Inventory Setup | Rajiv Gupta Learn Everyday
Переглядів 723Рік тому
Account Replication and Failover - Inventory Setup | Rajiv Gupta Learn Everyday
Account Replication and Failover - Enable Replication | Rajiv Gupta Learn Everyday
Переглядів 1 тис.Рік тому
Account Replication and Failover - Enable Replication | Rajiv Gupta Learn Everyday
Snowflake Admin Series: Redirecting Client Connection | Rajiv Gupta Learn Everyday
Переглядів 1,1 тис.2 роки тому
Snowflake Admin Series: Redirecting Client Connection | Rajiv Gupta Learn Everyday
Snowflake Admin Series: Resource Monitor Notify NonAdmin User | Rajiv Gupta Learn Everyday
Переглядів 5442 роки тому
Snowflake Admin Series: Resource Monitor Notify NonAdmin User | Rajiv Gupta Learn Everyday
Snowflake Admin Series: Resource Monitor Automation - Part 3 | Rajiv Gupta Learn Everyday
Переглядів 6802 роки тому
Snowflake Admin Series: Resource Monitor Automation - Part 3 | Rajiv Gupta Learn Everyday
Snowflake Admin Series: Resource Monitor Automation - Part 2 | Rajiv Gupta Learn Everyday
Переглядів 1 тис.2 роки тому
Snowflake Admin Series: Resource Monitor Automation - Part 2 | Rajiv Gupta Learn Everyday
WHERE IS CODE
Thank you so much for sharing this video..
what if multiple records come from source for same business key. how do you handle type2 and close old record and keep latest record as active
excellent tutorial, thank you !
excellent tutorial, thanks !
excelent playlist, clear and concise explanations, thank you !
@RajivGuptaEverydayLearning i am looking snowflake admin online training . Will you able to provide training if yes please ping mail id so that i can contact you
Hi good to see this
Very informative 🎉
Thank you so much sir. It's a great help for the learning students
I am a senior DBA and planning to learn snowflake , Does snowflake admin alone have scope or we need to learn development as well as snowflake is SAAS once we deploy services everything managed by snowflake right ? Please do suggest which works better for DBAs
As a Snowflake Adminstrator you should have expertise on Snowflake and it's architecture, cost optimization, etc. Fair expertise of any one of cloud which your client used. Fair idea of devops specially for deployment and automation to star with.
I'm a bit confused, this is what the official documentation of snowflake says about database roles, why are the database roles cloned on your example? For database roles: A database role is not cloned when you run the CREATE CLONE command to clone a database or other objects that are contained in the database. You must use the CREATE DATABASE ROLE … CLONE command to clone a database role to the target database. If the database role is already cloned to the target database, the command fails. If this occurs, drop the database role from the target database and try the CLONE command again.
Nice information but why do we have to make SCD1(Supplier_Landing) and then make SCD2(Supplier_Staging) from it?
Just curious, can't we just get the updated/new rows directly from the Raw table without adding one additional step?
Can you provide me the commands
This series is enough to learn sniwflake admin or else i need to learn any thing more apart from this because i working as snowflake develiper could you please suggest me
I would say this will be your starting point, do read blog for more context. Later you can deep dive into documentation.
can you please share me the related links i searched but i couldn't get related blogs and documentation @@RajivGuptaEverydayLearning
Superb useful, Thanks lot❤
Glad it was helpful!
Super useful, Thanks lot❤
Glad it was helpful!
HI Rajiv, can the replication be done on Enterprise Edition?
Replication is possible but failover can only be done at Business critical edition onward only.
It wud be great if u can share the code
Sorry that's for you to practice. Motivation here to make you learn not to copy code.
@@RajivGuptaEverydayLearning thank you. Did on my own.
Sir I am working as a Hadoop Administrator, Is it beneficial to switch to Snowflake Admin have any good job opportunity.
Future is bright in Snowflake. You can try.
@@RajivGuptaEverydayLearning Thank you sir.
Rajiv your Everyday learning is awesome ,, in appreciation this is everyday referal, everyday tips , it's a Bible to learners
Hi Rajiv, I am getting compilation error. get @internal_stage_json/file://c:\ajay\snowflake\TRAINING\unloadingdata; 001003 (42000): SQL compilation error: syntax error line 1 at position 73 unexpected ';'.
Short and sweet! Very nice!
Thanks!
when SF is not going to be used as a OLTP then what scenario streams are significant?
Snowflake is not an OLTP database for your information. Streams is used to track the changes happens to your base table, think this as trigger in oracle which record all your dml operation on base table.
Oracle is a OLTP there streams are nice to have. when SF is not a OLTP in what scenario this is more useful? that is my question. Could you provide some examples @@RajivGuptaEverydayLearning
Hi I've a query. I have a requirement where a new file comes to my local system every day at a specific location. I have to create an internal stage on Snowflake and have to exceute put command on snowsql to upload this file data into snowflake table . I want to orchestrate this daily. How to achieve this
There are multiple ways you can do that 1) ADF can help here 2) Custom shell script scheduled using airflow 3) Python script + Airflow 4) Python + Snowpipe
Nicely explained. Thank you sir
It would be more helpful if you can explain what is sample rows mean and what is the purpose of SEED. We get these definition from the Snowflake documents, but does not explain with a good example.
Hi Rajiv, when i am adding a another file, it is skipping the file as saying Ignoring non-change file ... can you please suggest what is the issue
If file already ran once and it is not marked as repeatable than it will only run once. Look at version table at database. If you want to run this anyhow, mark it repeatable for it to run everytime or delete the entry from log so that it can be run gain.
Thanks for the work & I can understand 16 mins of video needs atleast 3-4 hours of efforts. Keep it up!!!
Thank you
Well explained. Small doubt sir, few objects are not replicate like internal stage, what we can d9 for those objects.?
Now that too can be replicated using ENABLE_ETL_REPLICATION parameter. Read this for more details ⇾ docs.snowflake.com/en/user-guide/account-replication-stages-pipes-load-history
@@RajivGuptaEverydayLearning thank you so much for your time to reply.
@@kishoreevani5813 , Do see my full-fledged explanation on High Availability, Business Continuity & Disaster Recovery rajivgupta780184.medium.com/list/business-continuity-disaster-recovery-7de6fa618363 Hope you are getting value out of my blogs and UA-cam Demo. Do share this to a larger audience if you think it can help people. Resharing on LinkedIn with your network is one of great way of sharing knowledge.
www.linkedin.com/in/rajiv-gupta-618b0228/
Very good video on snowflake replication ever seen. Great thanks for sharing this video sir. I have one query.. In step 2 why you have enabled replication for 2 servers. I mean to ask, our plan is primary to secondary replication and secondary server to standard server data sharing. for 3rd server also we need to enable replication even we are doing data sharing?
This to make DR setup more robust. Assume what will happen if two region get down at same time, you should have third option to recover. In general primary and secondary is good to start.
can we do Modeling in Snowflake ? Could you pls share some videos on this pls
Not in Snowflake but you can certainly do modeling using @Sqldbm which supports Snowflake natively. See my blogs on same. medium.com/snowflake/snowflake-sqldbm-codeless-data-modeling-tool-be189589e0b2
@@RajivGuptaEverydayLearning i have snowpro core certification and Four hands-on badges from snowflake. Today I have applied for Snowflake SME. Howmany days it will take to get reply from Snowflake if im eligible?
In my primary database, all objects like tables/views are created with sysadmin role, I want to replicate with same role, how can I do that?
Use Account Replication if you want to replicate object outside database as well. In your case SYSADMIN is the default role, so it would not be an issue and you can use DB replication. But in case you also want to replicate roles you have to go for account replication. rajivgupta780184.medium.com/list/snowflake-account-replication-e3c111ec84b1
very nice explanation but I have one doubt where actually we do transformations, make one video making transformations after loading into snowflake table take any scenario and do bro if possible only
How to complete certifications like 1) Hands On Essentials - Data Lake 2) Hands On Essentials - Data Engineering 3)SnowPro Subject Matter Expert All these are Free or Paid certifications? Could please guide.
Step 1: Complete this 5 workshop from Snowflake University Badge 1: Data Warehouse - learn.snowflake.com/courses/course-v1:snowflake+ESS_DWW_101+2021/about Badge 2: Data Application - learn.snowflake.com/courses/course-v1:snowflake+ESS-DABW+A/about Badge 3: Data Sharing - learn.snowflake.com/courses/course-v1:snowflake+ESS-SMEW+C/about Badge 4: Data Lake Workshop - learn.snowflake.com/courses/course-v1:snowflake+ESS-DLKW+A/about Badge 5: Data Engineering Workshop - learn.snowflake.com/courses/course-v1:snowflake+ESS-DNGW+A/about SnowPro Subject-Matter Expert is not a certificate.
Thank You@@RajivGuptaEverydayLearning
Great video... thanks
🌟 P r o m o S M
SHOW DATABASE ROLES IN DATABASE DBROLE; would be the command to list database roles in that db.
Yes
Nicely presented but where is the code ? If you don't provide the code, how can learners practice and learn?
Correct Also it could have been explained using diagrams
good presentation... If you could share the source code it would be good.
Is it possible to use schema detection in external tables ?
Yes, look for external table create documentation with infer_schema sample sql.
@@RajivGuptaEverydayLearning Thanks, I found it. But for CSV files still isn't possible ? I saw that the Snowflake release of june/23 says that CSV and JSON would be supported, but still not being able to use it.
HOW TO SEE THE LAST ACTION MADE ON THE TABLE IN SNOWFLAKE
Try Access_History metadata view to see all tracking for said table.
Hi Rajiv - Can you please share the scripts ?
thanks, but this unload ndjson and not json, there is any idea to do it and exceed 16mb ( limit with array_agg) ?
Thank you sir for the information. i am from non IT background but understood it.
Most welcome
crystal clear explination
How can we disable local authentication and force federated auth? i assume there's SP initiated settings but can't figure out how to do that
where can i find ddl commands for your videos?
what if you have multiple tables in database and you want to replicate only one table?
That's not possible through Snowflake replication.