as usual it was helpful thanks buddy. and pls upload more frequently i know you must have work but i am following this series religiously so can't wait to see more videos.❤
Hi Manish, I am getting the below error and while uploading the files as blob the trigger is not running. Please guide. Failed to unsubscribe to events for event trigger InputBlob (Trigger). Failed to deactivate InputBlob(Trigger). Failed to get subscription status on storage events for event trigger InputBlob (Trigger)..
@@learnbydoingit I have resolved the issue by added the Microsoft event.grid service in my subscription account. Thank you sir for your prompt response.
@@learnbydoingit The Microsoft.EventGrid resource provider is not registered in subscription a5afeedc-530e-47b8-abb8-6e9de9559efb. Register the provider in the subscription and retry the operation. Activity id:d47ab9c5-e762-4e8e-8692-7afa25684c8e, timestamp: 1/14/2025 10:14:20 AM (UTC) this is the error coming
if inputCSV container already consists of three csv files and now we uploaded a new csv file to the folder then the pipeline will trigger, and it copies all the four csv files or the only file which is recently upload ? because we are using *.csv i believe all four will gets copied right , how can we specify to copy the recently added csv file to the folder
@@learnbydoingit thanks for the information. I just wanted to ask one scenario. can we create a system that anyone in my company uploads a file it will accept it. suppose there are 50 people and at the end of the day they upload there time tracker files in a folder. so can they have direct access to upload the files somewhere and not depend on the data engineer.
as usual it was helpful thanks buddy.
and pls upload more frequently i know you must have work but i am following this series religiously so can't wait to see more videos.❤
Yes sure
Hi sir
May i know when will you complete this series.
This month it will be completed ..I will try to post more video on this weekend
@@learnbydoingit thanku for the reply
Hi Manish, I am getting the below error and while uploading the files as blob the trigger is not running. Please guide.
Failed to unsubscribe to events for event trigger InputBlob (Trigger).
Failed to deactivate InputBlob(Trigger).
Failed to get subscription status on storage events for event trigger InputBlob (Trigger)..
Hi
In this video, you didn't selected json file format when you created outputjson, so how it is showing .json file?
If we want to load current date uploaded files ??
Use incremental logic
hi sir
i am getting error after i set trigger and apply publish all as
Failed to get subscription status
Could u paste complete error
@@learnbydoingit I have resolved the issue by added the Microsoft event.grid service in my subscription account. Thank you sir for your prompt response.
@@learnbydoingit The Microsoft.EventGrid resource provider is not registered in subscription a5afeedc-530e-47b8-abb8-6e9de9559efb. Register the provider in the subscription and retry the operation. Activity id:d47ab9c5-e762-4e8e-8692-7afa25684c8e, timestamp: 1/14/2025 10:14:20 AM (UTC)
this is the error coming
if inputCSV container already consists of three csv files and now we uploaded a new csv file to the folder then the pipeline will trigger, and it copies all the four csv files or the only file which is recently upload ?
because we are using *.csv i believe all four will gets copied right , how can we specify to copy the recently added csv file to the folder
We can check last file upload time then based on that we can have condition and schedule it
thanks
so who all will have access to upload the csv file?
Devops or data engineer..
@@learnbydoingit thanks for the information. I just wanted to ask one scenario. can we create a system that anyone in my company uploads a file it will accept it.
suppose there are 50 people and at the end of the day they upload there time tracker files in a folder. so can they have direct access to upload the files somewhere and not depend on the data engineer.
Im getting error schema import failed
Go to projection import schema
ua-cam.com/video/2N9VIyRsTd8/v-deo.htmlsi=8oA5P6qLIGT83tlm