Apache Hive Introduction & Architecture {தமிழ்}
Вставка
- Опубліковано 12 вер 2024
- #hive #apachehive
Apache Hive Introduction & Architecture
Video Playlist
-----------------------
Big Data Shorts in Tamil - bit.ly/3v2aL8p
Big Data Shorts in English - bit.ly/3tVEs9T
Hadoop in Tamil - bit.ly/32k6mBD
Hadoop in English - bit.ly/32jle3t
Spark in Tamil - bit.ly/2ZzWAJN
Spark in English - bit.ly/3mmc0eu
Hive in Tamil - bit.ly/2UQVUgv
Hive in English - bit.ly/372nCwj
NOSQL in English - bit.ly/2XtU07B
NOSQL in Tamil - bit.ly/2XVLLjP
Scala in Tamil : goo.gl/VfAp6d
Scala in English: goo.gl/7l2USl
Email: atozknowledge.com@gmail.com
LinkedIn : / sbgowtham
Instagram: / bigdata.in
UA-cam channel link
/ atozknowledgevideos
Website
codewithgowtha...
atozknowledge.com/
Technology in Tamil & English
![Installation [Apache Hive 2 with MySQL]{தமிழ்} #hive #apachehive](http://i.ytimg.com/vi/AVNAKkeCEWo/mqdefault.jpg)
![Installation [Apache Hive 2 with MySQL]{தமிழ்} #hive #apachehive](/img/tr.png)
![Unboxing [Hadoop Framework in தமிழ்]](http://i.ytimg.com/vi/B24TVooCrRE/mqdefault.jpg)
Awesome explanation as always bro. The difference between embedded and remote metastore was clearly explained. I have a doubt, why to use RDBMS separately if we can store metadata in HDFS? Is there any limitation in HDFS to act as metastore?
Thanks 🙂
And this is the exact reason
The storage system for the metastore should be optimized for online transactions with random accesses and updates. A file system like HDFS is not suited since it is optimized for sequential scans and not for random access. So, the metastore uses either a traditional relational database (like MySQL, Oracle) or file system (like local, NFS, AFS) and not HDFS. As a result, HiveQL statements which only access metadata objects are executed with very low latency. However, Hive has to explicitly maintain consistency between metadata and data.
Source - stack overflow
@@dataengineeringvideos wow got it! Thanks bro 😁
Really awesome.. Understood the concept very clearly.. This is my first time on watching your video.. And subscribed in this itself.. Thank you so much for ur effort in giving this lecture in tamil..
Very clear explanations about Hive Bro ❤ Thank you for sharing the knowledge 🙏🙏Vazga Vazamudan ☺️🙏👍
Awesome Brother, Usual 20 mins video do get bored, but your video is looking like a good movie, feels like this video don't get end likewise.. This is my first video on your channel, soon I am going to complete all the playlist bro..
So nice of you
Nice explanation ji & thank you
Crispy and clear explanation buddy keep upload more video
Thank you for the wonderful explanation. concepts are clear sir.
Hi Gowtham, U r Awesome teacher... Concepts are clear..
Clear explanation bro thank you😊
Awsome bro !!! Concept is clear and perfect👍👍
Superb explanation sir, sounds clear. good job.
Hive meta store ku oru video podunga bro
Super explanation... Really great
Vera vera level !!!
Well explanation bro
Bro you said HIVE don't have database then while inserting record again how it will store data in hive table ? Before moving the insert record to HDFS you said it will go into hive table
Super explanation
awesome expalnation bro
Sir, I learnt that Spark uses RDD and is RAM based unlike HDFS which uses hard disk.
I am little confused here. Does it mean with the same infrastructure that is made up of hard disk , one cannot fully utilize the benefit of Spark and requires infrastructure change using RAM?
Please correct my understanding gap
Super bro,is there any documents to Learn more?
Hi Gowtham , Thanks! . For remote rdbms, we have to purchace another machine. Totally, slave nodes machine, master node machine and rdbms node machines. Am i right?
Thank you bro for the wonderful videos, i have a question, Will the RDBMS spread across multiple nodes for HA?
Exactly
You said about saving metadata outside of HIVE because HIVE is not having storage ?
Can you tell me the difference between command load, insert and import In detail?
How we access the unstructure data? Is sperate technology for that.
Thank you bro
Why metadata in RDBMS why not in HDFS? sorry if you mentioned the reason in video.. not derby i mean
Hive stores metadata information in the metastore using RDBMS instead of HDFS. The reason for choosing RDBMS is to achieve low latency as HDFS read/write operations are time consuming processes.
@@giridharaneee Thanks, even i was wondering why to use RDMS separately if we can store metadata in HDFS itself. Your answer is convincing. Thank you.
Bro pls can you do it for impala?
How to check the metadata in RDBMS? If it is stored outside...
For example , just login to mysql and execute show databases command , u will metastore_db this is where hive metadata will be stored
@@dataengineeringvideos Thank you so much for the explanation bro...
Sqoop with hive Ku oru video podunga
please refer this video ua-cam.com/video/HAM1jHbpd64/v-deo.html
Hive we can get only structure data, how we can see the relations of the tables and various keys ER relationship. Does hive provide DBMS managing solutions?
இதில் tez னு இருப்பது Google pay வா?
no this is different one