Відео

Really a great job Anjan. It's a very crystal clear and simple. I learn lot of from your channel. I would like to hear your expertise about python. If I have read CSV from python stand alone while read inside GCP it's seems slightly diffrence . How can understand gcp code. Hopefully once you get free response.

Hello Anjan Sir your all video are really helpful thanks, I have problem let see I want to capture CDC from PostgreSQL and I want to transfer into bigquery , instead of final data I want to store what was changed instead of final data, I try to created a stream from postgres to pub/sub for storing the CDC event in postgres, but there is no destination option available for pub/sub in data stream, can you I do do you have any idea? postgreSQL -> GCS -> pub/sub ----> pub/sub -> bigquery? I have a stream already running PostgreSQL to Bigquery, it will write change postgres to bigquery,

Great stuff! Just one question, what would be the steps if we need to create pipeline for multiple tables?

👍

Hi , This was a very good explanation. I am also looking for providing logging access using terraform.

Very great video sir. You are helping us learn and explore. Thank You Sir 😊

How can we capture the log and in case of any exception and failure and store it to bigquery

How its charged the billing in the sense after once we create cluster its keep running or else after complted the job is it went to ideal state pls let me sir....

👨‍🎓

Superb explanation, Sir

Great explanation. Keep rocking Bro. Thank You so much for uploading.

In video voice is very low it seems, without handsfree can't hear you properly 🥲

All your videos are useful , But please remove background music , really disgusting and irritating .

Join button not visible 😊

Can you just explain that how frequently you will post new member only videos Sir!

sir , If I get membership can you tell me what are the skill set that we can expect in the channel. And how many months will it take to upload all the content in the channel(members only). Please tell me

tq sir

Kindly Provide Access To The Python Code...

how did you connect jupyter notebook to gcs

Thanks Anjan, I am studiying for an interview related to Apache Beam and Dataflow. I will let you know in this comment if I get the job. Cheers from Chile

Excellent learning series.

Any specific reason you are using yield statement in ParDo logic instead of return statement? I see, return is giving me flatmap result while yield is giving me map result. why is this happening?

most underrated video, very good explanation 🙌🏼

Hi Anjan , Can you please let know where can I access the python script. I couldn’t find in demo codes repo Would be helpful to learn Thanks

Why to create compute engine for that? Just run the publisher script from local and verify by running the subscriber script

i wanna ask if in this process which one was right ETL or ELT from your video above?

Hi Anjan, Thanks for this. Kindly do more data engineering videos especially focusing on data mesh architecture. Also tips and tricks would be more beneficial.

Please make and upload videos on GCP data platform topics from start to end

Great Anjan, thanks for upgrading everyone watching on GCP, please create more videos and keep us learning more. I am joining my new job on GCP data platform leader

Invalid table-valued function EXTERNAL_QUERY Connect to PostgreSQL server failed: server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request ,,, Im getting above error while querying the data from the external connection. Please help

I already liked this series so good

first comment

Great video and post periodically...

Simple and effective

very well and in detail explained

can we save the dataframe to hdfs instead of gcs

What’s the pricing of this table

Good Explanation

Very nice Anjan, please keep doing more to make us upskill on GCP, AWS, Azure Cloud data platforms. I want a full end to end data project, your explanantion is awesome, simple and clear to understand with slides and labs with examples

please provide the json file to understand