You can do one time history table load using ETL tools, if ETL tools are not available, you have to export the data from on-premice database to files, place those files in cloud storage and load into snowflake tables. There is no other way than these 2 ways.
@@mrjana520 yeah ..but can we store the results like whether the filewise data loaded or errored out to some other table??? When we execute the copy command, we get an output table that says which all the files got loaded/errored out.. can we store that data somewhere??
When ever you run copy command it gives output as list of files that were successfully loaded and errored out, but the data will be loaded to the table that you have mentioned in the copy into tablename...
Nice Explanation Sir.. Can I stage the same file again in to the internal stage. Example earlier I have 10 records in the file but now in the same file records updated in to 20.So want to stage the file to load the remaining records in to the table
Hi sir i try to create snow pipe on internal stage but i am getting error 090040 (XX000): Pipe Notifications bind failure "Internal Stage not supported for auto_ingest" if i am coment on autoingest i am able to create but i try to change my file but i am not seen auto loading here.
Sir,i have career gap,i have learnt snowflake in an institute recently.now i would like to work with real time projects to improve my skill.so is there any freelancers or internships on the snowflake?
Hi Janardhan, I have two queries. 1) how to store limited rows in snowflake table using copy command. Ex. If my file has 1000 records but I want to store 200 records 2) how to store source file name along with data
But this is the only video I have explained only theory, all other videos I have executed and explained. But people see only black dot on the white paper, it is quiet natural.
Thankyou very much.I dont think I can get better channel to learn snowflake in youtube.great explanation on each and every concepts in snowflake.
Superb explation. Please upload more videos related to snowflake.
Complete snowflake videos available in my channel, follow my playlist
Sir make video full fledged video with copy command With practical we practice it pleas sir it's very confusion 🙏🙏🙏
Valuable information Sir
Thank You Sir. This is helpful
Thanks sir is there any video snow pipe on internal name stage please provide
I don't have it
Could you please advise How to handle historical tables part of migration
You can do one time history table load using ETL tools, if ETL tools are not available, you have to export the data from on-premice database to files, place those files in cloud storage and load into snowflake tables. There is no other way than these 2 ways.
Sir TQ very much.
Pls do a video on realtime how we have to write stored procedure in detail.pls sir
there are 2 videos on Stored procs, check in my playlist
how can we get the sample data in s3? please tell
You can use public s3 data or you have to upload files to your AWS s3 account for practice.
Sir what type of errors are there in files
Watch all videos clearly, you will get the answer.
what is the difference between overwrite = true and force = true?
I don't see overwrite option in Snowflake documentation also :(
copyOptions ::=
ON_ERROR = { CONTINUE | SKIP_FILE | SKIP_FILE_ | 'SKIP_FILE_%' | ABORT_STATEMENT }
SIZE_LIMIT =
PURGE = TRUE | FALSE
RETURN_FAILED_ONLY = TRUE | FALSE
MATCH_BY_COLUMN_NAME = CASE_SENSITIVE | CASE_INSENSITIVE | NONE
ENFORCE_LENGTH = TRUE | FALSE
TRUNCATECOLUMNS = TRUE | FALSE
FORCE = TRUE | FALSE
LOAD_UNCERTAIN_FILES = TRUE | FALSE
Can we store the result that we get from copy command into some temp table??
Copy command means, you are already storing or loading the data into some table, it can be a permanent table or temporary table or transient table
@@mrjana520 yeah ..but can we store the results like whether the filewise data loaded or errored out to some other table??? When we execute the copy command, we get an output table that says which all the files got loaded/errored out.. can we store that data somewhere??
When ever you run copy command it gives output as list of files that were successfully loaded and errored out, but the data will be loaded to the table that you have mentioned in the copy into tablename...
Nice Explanation Sir.. Can I stage the same file again in to the internal stage. Example earlier I have 10 records in the file but now in the same file records updated in to 20.So want to stage the file to load the remaining records in to the table
Yes by using Force=true option
@@mrjana520 Thanks Sir
Please explain some realtime scenarios
Will do once all basic content is completed
Hi sir
i try to create snow pipe on internal stage but i am getting error
090040 (XX000): Pipe Notifications bind failure "Internal Stage not supported for auto_ingest"
if i am coment on autoingest i am able to create but i try to change my file but i am not seen auto loading here.
the auto-ingest feature only works with external stages.
Hi Janardhan, Can you please that PPT about the copy command.
Contact me on jana.snowflake2@gmail.com
Sir,i have career gap,i have learnt snowflake in an institute recently.now i would like to work with real time projects to improve my skill.so is there any freelancers or internships on the snowflake?
I am not sure on that, I am just posting my knowledge in youtube
@@mrjana520 it's ok sir, thank you.
Hi Janardhan,
I have two queries.
1) how to store limited rows in snowflake table using copy command. Ex. If my file has 1000 records but I want to store 200 records
2) how to store source file name along with data
community.snowflake.com/s/article/Inserting-filename-into-target-table
We can't filter the records while loading into snowflake by using copy command
Thank you, janardhan!
As per your COPY command video, we can only give SIZE LIMIT keyword while loading data file?
please explain clustered key concept
Cluster key video is already available, all snowflake material that is required to clear an interview is available in my channel
you could have done it while running those commands with an explanation otherwise theoretical is always boring ..
But this is the only video I have explained only theory, all other videos I have executed and explained. But people see only black dot on the white paper, it is quiet natural.