And the answer would be "because I work with a multinational enterprise customer". If you have a large market share in China (1 bill people) , India (1 Bill people), Europe 0.75 Bill, USA (350M people) it doesn't take long to get to 100 BIllion transactions. If you want to do Financial Year on Year comparisons, you need to keep at least 24 months of data, usually 36 months. .
Heyy, very informative. I came here around searching for big data processing in seconds. Ive a question, I would like to build a system where I import terabytes of data into single table with keys and I want to perform all the DML operatiom in such a way it should take very less execution time as shown. Please help me out, how I can acheive. Im stuck.
Hello sir. I tried to import 400k data into big query sandbox. But ended with more errors. Is this possible to import those data. Pls anyone help me it's urgent ( interview assignment)
what to do when I want to overwrite 100 millions of rows into new table, in minutes? df.write.mode("overwrite").saveAsTable("FINAL"), if you could please help with this?
Please for 50 days I am looking for this i wanna to create 2000 users in mysql and set the phone number as user name and password my be say me how can i create most users with default password? That's
This is nice but not that impressive. Obviously, the table is being stored using Columnstore Compression techniques. So you only need to query the columns in the select list. And they are typically grouped in blocks of 1 M or more. These header pages keep rowcount values. So you are not reading every row. Just the block headers of a single column. If your query forced the scan of all rows in the "block" asking it to be combined with other fields in the same row or in other tables before you could filter it. You will no longer be in the columnstore sweet spot. and the difference in query speed would be more striking. Still good thou, as that is a common use case.
Thanks for the explaination. I am curious that is it just scaling of the systems, or BigQuery does query optimization to reduce the latency as well?
The first question you should always ask when working with a 100 billion row database: “Why do I have a 100 billion row database?”
And the answer would be "because I work with a multinational enterprise customer". If you have a large market share in China (1 bill people) , India (1 Bill people), Europe 0.75 Bill, USA (350M people) it doesn't take long to get to 100 BIllion transactions.
If you want to do Financial Year on Year comparisons, you need to keep at least 24 months of data, usually 36 months. .
Simple and concise, thank you!
Great, Thanks a lot, sir.
we can download this database to do some testes ?
I nice ideal for next video is compare this same situation with noSQL database.
excellent sir thank you so much highly motivational for passionate person
Wow.. this experiment was really amazing to benchmark the bigquery .
Heyy, very informative. I came here around searching for big data processing in seconds. Ive a question, I would like to build a system where I import terabytes of data into single table with keys and I want to perform all the DML operatiom in such a way it should take very less execution time as shown. Please help me out, how I can acheive. Im stuck.
So I don't have to carry about performance when I make projects ?!
Wow what a gr8 video sir ji..pls sir make video on sql with ml and sql also..
I appreciate your effort. Could you put the used link for the google cloud project?
Well Explained, Thanks a lot
Awesome . Keep it up.
it's always an Indian guy!
Please organize the videos and make playlists , great video , very informative and helpful, which led me to subscribe , thanks 😊
Hello sir. I tried to import 400k data into big query sandbox. But ended with more errors. Is this possible to import those data. Pls anyone help me it's urgent ( interview assignment)
marketer of google cloud.. nothing states what to improve
@Arpit Agrawal, Good. Let me know what database is behind this Console?
Google Cloud Bigquery 😁
Nice video but while voicing better to expand the screen than side by side videos
what to do when I want to overwrite 100 millions of rows into new table, in minutes?
df.write.mode("overwrite").saveAsTable("FINAL"), if you could please help with this?
Great explanation
Hello, can I connect it on php?
Please for 50 days I am looking for this i wanna to create 2000 users in mysql and set the phone number as user name and password my be say me how can i create most users with default password? That's
Nicely explained.
Im confused were these indexes?
BigQuery doesn't have indexes. It has partitions and clustering.
Amazing!
I need your help
This is good...
This is nice but not that impressive. Obviously, the table is being stored using Columnstore Compression techniques. So you only need to query the columns in the select list. And they are typically grouped in blocks of 1 M or more. These header pages keep rowcount values. So you are not reading every row. Just the block headers of a single column.
If your query forced the scan of all rows in the "block" asking it to be combined with other fields in the same row or in other tables before you could filter it. You will no longer be in the columnstore sweet spot. and the difference in query speed would be more striking.
Still good thou, as that is a common use case.
wow!
👍