- 80
- 13 322
Cloud and Coffee with Navnit
Приєднався 29 січ 2009
Welcome to Cloud and Coffee with Navnit! ☕️
This channel is your go-to destination for everything related to Data Analytics, Data Engineering, and the latest trends in AI and Cloud technologies. Whether you’re a seasoned professional or just starting out, you’ll find valuable insights, tutorials, and discussions to help you stay ahead in the rapidly evolving world of data and AI.
On this channel, I dive deep into:
\t• Data Analytics: Techniques, tools, and best practices to transform raw data into actionable insights.
\t• Data Engineering: Step-by-step guides on building scalable data pipelines, working with big data technologies, and optimizing data systems.
\t• AI Trends: A look at how artificial intelligence is reshaping industries, with real-world applications and future forecasts.
I also host engaging podcasts with thought leaders and experts discussing the most relevant developments in data science and AI.
Subscribe to Cloud and Coffee with Navnit and hit the notification bell
This channel is your go-to destination for everything related to Data Analytics, Data Engineering, and the latest trends in AI and Cloud technologies. Whether you’re a seasoned professional or just starting out, you’ll find valuable insights, tutorials, and discussions to help you stay ahead in the rapidly evolving world of data and AI.
On this channel, I dive deep into:
\t• Data Analytics: Techniques, tools, and best practices to transform raw data into actionable insights.
\t• Data Engineering: Step-by-step guides on building scalable data pipelines, working with big data technologies, and optimizing data systems.
\t• AI Trends: A look at how artificial intelligence is reshaping industries, with real-world applications and future forecasts.
I also host engaging podcasts with thought leaders and experts discussing the most relevant developments in data science and AI.
Subscribe to Cloud and Coffee with Navnit and hit the notification bell
Sizing Amazon OpenSearch Domain - Part 2 | Identifying Number of Shards in Your OpenSearch Domain
Discover how to optimize your Amazon OpenSearch Service domain by effectively determining the number of shards needed for your workload. In this detailed guide, we break down the key considerations for shard sizing and distribution to ensure optimal performance, scalability, and cost-efficiency for your OpenSearch cluster.
📌 What You’ll Learn in This Video:
• Understanding default shard configurations in Amazon OpenSearch Service.
• Why pre-indexing shard decisions are critical for long-term scalability.
• The impact of shard distribution on cluster performance and resource utilization.
• Step-by-step examples of calculating the number of primary shards, including scenarios with anticipated data growth.
• Best practices for balancing shard sizes to avoid large shard recovery delays and small shard inefficiencies.
Whether you’re managing search latency-critical applications, write-heavy workloads, or simply looking to enhance your cluster’s reliability, this video provides actionable insights to make the most of your OpenSearch Service domain.
🔑 Keywords: Amazon OpenSearch Service, Shard Sizing, Number of Shards, OpenSearch Domain Optimization, Data Growth, Shard Calculation, Shard Distribution, OpenSearch Performance, Cloud Analytics.
📌 What You’ll Learn in This Video:
• Understanding default shard configurations in Amazon OpenSearch Service.
• Why pre-indexing shard decisions are critical for long-term scalability.
• The impact of shard distribution on cluster performance and resource utilization.
• Step-by-step examples of calculating the number of primary shards, including scenarios with anticipated data growth.
• Best practices for balancing shard sizes to avoid large shard recovery delays and small shard inefficiencies.
Whether you’re managing search latency-critical applications, write-heavy workloads, or simply looking to enhance your cluster’s reliability, this video provides actionable insights to make the most of your OpenSearch Service domain.
🔑 Keywords: Amazon OpenSearch Service, Shard Sizing, Number of Shards, OpenSearch Domain Optimization, Data Growth, Shard Calculation, Shard Distribution, OpenSearch Performance, Cloud Analytics.
Переглядів: 7
Відео
Working with Custom (JSON) classifier within AWS Glue
Переглядів 1614 днів тому
In this video, we dive into working with custom classifiers within AWS Glue, a powerful tool for ETL (Extract, Transform, Load) operations. AWS Glue provides built-in classifiers, but creating custom classifiers allows you to handle unique and complex data formats that may not be covered by default Classifier.
Working with (un) Nested JSON using AWS Glue and Amazon Athena
Переглядів 2114 днів тому
In this video, we explore working with nested JSON data using AWS Glue and Amazon Athena with the help of custom classifiers. Nested JSON can often present challenges when it comes to data extraction and transformation, but AWS Glue’s custom classifiers enable you to easily parse and work with complex, multi-layered JSON structures.
Data warehouse, Data Lake and Lake House Architecture Simplified
Переглядів 8214 днів тому
Are you curious about the differences between Data Warehouses, Data Lakes, and the emerging Lake House Architecture? In this video, we simplify these concepts to help you understand their key features, use cases, and how they fit into modern data strategies. 📌 What You’ll Learn: • What is a Data Warehouse? • What is a Data Lake? • How does Lake House Architecture combine the best of both worlds...
Top 10 analytics announcement from AWS re:Invent 2024
Переглядів 4121 день тому
Top 10 analytics announcement from AWS re:Invent 2024
Getting started with Amazon S3Tables | How to create S3 tables and integrate with Athena | Demo
Переглядів 12721 день тому
Getting started with Amazon S3Tables | How to create S3 tables and integrate with Athena | Demo
🎥 Episode 2: What’s New with AWS Analytics
Переглядів 3021 день тому
🎥 Episode 2: What’s New with AWS Analytics
How to work with Amazon Nove (reel) foundation model (LLMs)
Переглядів 72Місяць тому
How to work with Amazon Nove (reel) foundation model (LLMs)
How to Identify change in Source Schema using AWS Glue Data Catalog
Переглядів 74Місяць тому
How to Identify change in Source Schema using AWS Glue Data Catalog
What’s New with AWS Data, Analytics & AI: EP 1:Top 5 AWS Analytics Highlights of the Week! (Nov' 24)
Переглядів 48Місяць тому
What’s New with AWS Data, Analytics & AI: EP 1:Top 5 AWS Analytics Highlights of the Week! (Nov' 24)
How to troubleshoot Apache Spark using Generative AI : Troubleshooting for Apache Spark in AWS Glue
Переглядів 93Місяць тому
How to troubleshoot Apache Spark using Generative AI : Troubleshooting for Apache Spark in AWS Glue
How to create Highchart in Amazon QuickSight
Переглядів 443Місяць тому
How to create Highchart in Amazon QuickSight
Data De duplication with AWS Entity Resolution : Part 4 | ML Based Data De duplication
Переглядів 24Місяць тому
Data De duplication with AWS Entity Resolution : Part 4 | ML Based Data De duplication
Data De-duplication with AWS Entity Resolution : Part 1 | Crawling Data from S3 using Glue Crawler
Переглядів 27Місяць тому
Data De-duplication with AWS Entity Resolution : Part 1 | Crawling Data from S3 using Glue Crawler
Data De-duplication with AWS Entity Resolution : Part 3 | Rule-Based Data De-Duplication
Переглядів 28Місяць тому
Data De-duplication with AWS Entity Resolution : Part 3 | Rule-Based Data De-Duplication
Data De-duplication with AWS Entity Resolution: Part 2 | Schema Mapping
Переглядів 47Місяць тому
Data De-duplication with AWS Entity Resolution: Part 2 | Schema Mapping
AWS Glue Crawler: Automate Metadata Discovery for Your Data Lake
Переглядів 43Місяць тому
AWS Glue Crawler: Automate Metadata Discovery for Your Data Lake
Plan Your AWS re:Invent 2024 Itinerary with Amazon Bedrock Chat | Bedrock Chat with Your Documents
Переглядів 57Місяць тому
Plan Your AWS re:Invent 2024 Itinerary with Amazon Bedrock Chat | Bedrock Chat with Your Documents
Step-by-Step Guide: Connecting Amazon Athena to Amazon QuickSight for Data Visualization
Переглядів 131Місяць тому
Step-by-Step Guide: Connecting Amazon Athena to Amazon QuickSight for Data Visualization
How to Build Transactional Data Lake on AWS (Part 1) | Introduction to Transactional Data Lake
Переглядів 148Місяць тому
How to Build Transactional Data Lake on AWS (Part 1) | Introduction to Transactional Data Lake
How to size your Amazon OpenSearch Domain (Part 1 - Storage )
Переглядів 452 місяці тому
How to size your Amazon OpenSearch Domain (Part 1 - Storage )
Getting started with Dynamic Data Masking (DDM) in Amazon Redshift
Переглядів 1042 місяці тому
Getting started with Dynamic Data Masking (DDM) in Amazon Redshift
How to upload Jupyter Notebook in Amazon Redshift Query Editor v2
Переглядів 262 місяці тому
How to upload Jupyter Notebook in Amazon Redshift Query Editor v2
How to bring incremental data using AWS Glue \\ Glue bookmark
Переглядів 1242 місяці тому
How to bring incremental data using AWS Glue \\ Glue bookmark
Working with Napkin.AI - Visual from Text
Переглядів 252 місяці тому
Working with Napkin.AI - Visual from Text
Definition of AI, ML, DL and GenAI (AWS Certified AI Practitioner : Part 2)
Переглядів 1812 місяці тому
Definition of AI, ML, DL and GenAI (AWS Certified AI Practitioner : Part 2)
Man this was such a great video! Looking forward to the next part!
Thank you! I will create another one soon!
Here you go - ua-cam.com/video/CJTsgYwZhP8/v-deo.html&ab_channel=CloudandCoffeewithNavnit
Can we increase the time from 6 to 30 sec?
No , currently it has limitation of 6 sec
Thanks for hosting this!
Thank you for watching it!!
exactly what i needed, thaks!
Thank you!!
Good Video, can you share one with creating custom jdbc connector to pull data.
Yes I can
Hi, Your video is nice and easy to understand. I understand how we can implement parallelism for reading data. What options we need to use when we are writing data to redshift table using dynamicFrame jdbc option. Greatly appreciate if you can respond on this.
Thank you for your comment.. I will make a new Video and share with you!!
Truly enjoyed your video, I was Glue_d to my chair the entire time. Waiting for more content! Thank you.
Thank you!!
How to pull multiple tables from on prem to s3 using glue(esp when schema is different) with 1 jobe template
I will make a video and share with you!!
What if the database is on-prem
It will work similarly .. no change in architecture or solution
How do you delete Redshift Servertless?
Please improve audio quality. Voice is so low, can't able to hear at all clearly
Noted .. Thanks for feedback
I had seen the 4+ minute vedio.. i did not get what i was looking , how to create users and how to use it..this vedio , could have got more information. next notice, your voice is Low, should be more High. Thanks for this vedio.
Thanks for feedback .. this video is very specific to creating account alias
Hi Navnit, very good video initiative, only suggestion is to update the mic as the voice is not very clear and loud
Thank for the suggestion, I will work on it.
Hi bro I am new to AWS or the cloud concept I am currently working as an IT support in an organization I want to change my career. I don't have any knowledge in database or programming my work is technical support for emails, user-management, system management etc... Will learning AWS help me get a job on a different field, does this require background of programming or database? Can you help me in clearing these doubts kindly reply.
Hi Roy a, learning AWS can help you to get job in cloud computing technology. In this learning series I am trying to cover fundamentals of AWS Cloud and its services which don't require any programming knowledge and help you to get job like cloud support engineer job but to excel in your job you definitely need to put extra effort on your end to develop deep understanding around couple of AWS services. Good Luck
@@cloudncoffeewithnavnit Thanks Bro for the reply waiting for your new videos
If you are getting error - "Command Not found AWS" - you need to install AWS CLI first before configuring your profile. docs.aws.amazon.com/cli/latest/userguide/install-cliv2.html
Superb!
Thank you! Cheers!