sumit kumar
sumit kumar
  • 175
  • 217 089
How to Change AWS Lambda Runtime in 30 Seconds! 🚀 #AWS #lambda #shorts
Need to update your AWS Lambda function runtime? 🖥️ In this quick tutorial, I’ll show you how to change the runtime of your AWS Lambda function in less than 60 seconds! Perfect for beginners or anyone needing a fast refresh! 🚀 Watch, learn, and boost your AWS skills! #AWS #Lambda #CloudComputing
Переглядів: 15

Відео

AWS OpenSearch Quick Start Guide from Scratch | Free Tier Tutorial
Переглядів 84Місяць тому
Welcome to our AWS OpenSearch Quick Start Guide! In this video, we'll walk you through setting up and using AWS OpenSearch from scratch, all on the Free Tier. Whether you're a beginner or looking to expand your cloud computing skills, this tutorial covers everything you need to get started with AWS OpenSearch. We'll cover: What is AWS OpenSearch? Setting up an OpenSearch domain Configuring acce...
Understanding the Terraform Lookup Function: A Complete Guide
Переглядів 33Місяць тому
"Welcome to our in-depth guide on the Terraform lookup function! In this video, we'll explore one of Terraform's most powerful functions and show you how to use it effectively in your infrastructure as code projects. What You'll Learn: Introduction to Terraform and its core concepts Detailed explanation of the lookup function and its syntax Practical examples of using the lookup function in rea...
Mastering Terraform Functions: A Complete Guide for Beginners
Переглядів 322 місяці тому
Welcome to our comprehensive guide on Terraform functions! In this video, we'll take you through everything you need to know to get started with Terraform functions, from basic concepts to advanced usage. What You'll Learn: Introduction to Terraform and its core concepts Detailed explanation of Terraform functions and their importance How to use built-in functions for string manipulation, numer...
Master Terraform Map Variables: Key to Efficient Infrastructure Coding!
Переглядів 212 місяці тому
"Dive deep into the world of Terraform map variables in this detailed tutorial! Map variables are powerful tools in Terraform that allow you to manage related values with ease. This video is designed for both beginners and experienced users who want to enhance their understanding and utilization of map variables in Terraform. 🔸 What You’ll Learn: Fundamentals of map variables in Terraform How t...
Mastering Terraform Lists: Efficiently Manage Multiple Values!
Переглядів 322 місяці тому
"🚀 Welcome to our deep dive into Terraform Lists! In this tutorial, we'll explore how to define, manipulate, and utilize lists in Terraform to streamline your infrastructure configurations. Whether you're a beginner or looking to enhance your skills, this video is your ultimate guide to mastering list variables in Terraform. 🔹 What You'll Learn: How to define list variables in Terraform Practic...
Terraform Variable Validation Tutorial: Ensuring Correct Values in Your Configuration
Переглядів 272 місяці тому
In this video, we will delve into Terraform variable validation, a crucial feature to ensure your infrastructure configuration values are correct. We'll cover: How to define variables with validation in Terraform Adding custom validation conditions to variables Practical examples demonstrating variable validation Tips for writing effective validation conditions Whether you're new to Terraform o...
Terraform Variables Tutorial: Defining Types and Default Values
Переглядів 192 місяці тому
Terraform Variables Tutorial: Defining Types and Default Values
Terraform Variables Tutorial: Mastering Input and Output Variables
Переглядів 322 місяці тому
Welcome to our Terraform tutorial series! In this video, we will dive deep into Terraform variables, focusing on both input and output variables. Understanding how to use variables in Terraform is crucial for writing flexible and reusable infrastructure as code. In this comprehensive guide, you will learn: - What Terraform variables are and why they are important - How to declare and use input ...
Terraform Tutorial: Using Output Variables in a Hello World Example
Переглядів 252 місяці тому
Welcome to our Terraform tutorial series! In this video, we'll dive into using output variables in Terraform with a simple "Hello World" example. Output variables are a powerful feature in Terraform that allow you to export and display values from your infrastructure configurations. In this step-by-step guide, you will learn: - What output variables are and why they are useful - How to define a...
Create an AWS S3 Bucket with Terraform: Step-by-Step Tutorial
Переглядів 1933 місяці тому
"Learn how to seamlessly create and manage an AWS S3 bucket using Terraform in this detailed tutorial. This video guides you through every step of writing and applying Terraform configurations to set up S3 buckets in your AWS environment. Whether you're new to Terraform or looking to expand your cloud infrastructure skills, this tutorial will equip you with the knowledge to use Terraform for ef...
Mastering Databricks: How to Pass Parameters in Workflows|Pyspark|Databricks|workflow|python
Переглядів 4493 місяці тому
In this video, we're diving deep into Databricks workflows and exploring how to pass parameters effectively. Whether you're a data engineer, data scientist, or just getting started with Databricks, understanding how to work with parameters in workflows is crucial for creating dynamic and flexible data pipelines.
Create Workflow for Notebooks in Databricks: Step-by-Step Guide |Databricks|pyspark|python|notebook
Переглядів 933 місяці тому
Welcome to my channel! In this video, I'll be walking you through the process of creating workflows for notebooks in Databricks. We'll cover everything from setting up your Databricks environment to configuring and scheduling workflows to automate your data tasks. Whether you're a beginner or an experienced data engineer, this tutorial will help you streamline your data processes and enhance yo...
Master Databricks Widgets: Simplifying Your Workflow with dbutils.widgets
Переглядів 953 місяці тому
Welcome to my channel! In this video, we dive into the world of Databricks widgets, a powerful feature to make your Databricks notebooks more interactive and dynamic. Whether you're a data scientist, data engineer, or analyst, understanding how to use dbutils.widgets can greatly enhance your workflow and productivity. What You'll Learn: Introduction to Databricks widgets How to create and use t...
How to Schedule AWS Lambda Functions Using EventBridge | Step-by-Step Guide #aws #lambda #python
Переглядів 1353 місяці тому
How to Schedule AWS Lambda Functions Using EventBridge | Step-by-Step Guide #aws #lambda #python
How to Trigger a SageMaker Jupyter Notebook File from AWS Lambda using WebSockets
Переглядів 4123 місяці тому
How to Trigger a SageMaker Jupyter Notebook File from AWS Lambda using WebSockets
New PySpark Feature: Run SQL Queries Directly on DataFrames Without using Temp Views|Pyspark|sql
Переглядів 853 місяці тому
New PySpark Feature: Run SQL Queries Directly on DataFrames Without using Temp Views|Pyspark|sql
How to Call One Databricks Notebook from Another: Step-by-Step Guide
Переглядів 923 місяці тому
How to Call One Databricks Notebook from Another: Step-by-Step Guide
Effortlessly Create Your First Compute Cluster & Databricks Notebook!
Переглядів 1666 місяців тому
Effortlessly Create Your First Compute Cluster & Databricks Notebook!
Getting Started with Databricks Community Edition: A Step-by-Step Guide
Переглядів 2136 місяців тому
Getting Started with Databricks Community Edition: A Step-by-Step Guide
Mastering Python: =, ==, vs is and Mutable vs Immutable |understanding variables in Python
Переглядів 797 місяців тому
Mastering Python: =, , vs is and Mutable vs Immutable |understanding variables in Python
Mastering Airflow:Effortlessly Connect to PostgreSQL| Airflow Connection connect to Postgres#airflow
Переглядів 1,4 тис.7 місяців тому
Mastering Airflow:Effortlessly Connect to PostgreSQL| Airflow Connection connect to Postgres#airflow
Python Interview Question | LeetCode Python Tutorial : Fibonacci Number Problem
Переглядів 718 місяців тому
Python Interview Question | LeetCode Python Tutorial : Fibonacci Number Problem
Python Interview Question: Find the Maximum Time from a Four-Digit Number|python |coding interview
Переглядів 1188 місяців тому
Python Interview Question: Find the Maximum Time from a Four-Digit Number|python |coding interview
Python Interview Question: LeetCode Python Tutorial: Two Sum Problem|python|leetcode
Переглядів 628 місяців тому
Python Interview Question: LeetCode Python Tutorial: Two Sum Problem|python|leetcode
Python Interview Question:Find the pair with given number in a list|Two sum problem|leetcode|python
Переглядів 1018 місяців тому
Python Interview Question:Find the pair with given number in a list|Two sum problem|leetcode|python
Python Interview Question: Reverse Words in a Sentence with Code Examples|String operation|regex
Переглядів 488 місяців тому
Python Interview Question: Reverse Words in a Sentence with Code Examples|String operation|regex
Python Interview Question: How to Find the Occurrence of an Element in a List
Переглядів 2058 місяців тому
Python Interview Question: How to Find the Occurrence of an Element in a List
Python Interview Question: Sort the dictionary by values in ascending order |Dictionary|Bubble Sort
Переглядів 778 місяців тому
Python Interview Question: Sort the dictionary by values in ascending order |Dictionary|Bubble Sort
Python Interview Question: Sort the dictionary by values in ascending order |Dictionary|Sorted
Переглядів 858 місяців тому
Python Interview Question: Sort the dictionary by values in ascending order |Dictionary|Sorted

КОМЕНТАРІ

  • @arafatabsi6546
    @arafatabsi6546 17 годин тому

    hi the command docker-compose up -d --no-deps --build airflow-webserver airflow-scheduler is changing the containers (you can notice from the containers IDs) means when i want to add a requirement all my data in the containers will be lost! what is the solution!

  • @YashKumarJain-v5c
    @YashKumarJain-v5c 10 днів тому

    I followed as per the vedio but the dags are not visible in UI could you help me out

    • @sumitkumar2955
      @sumitkumar2955 10 днів тому

      @@YashKumarJain-v5c thanks for watching. Please check permission issue, role. If not working ping me on what's app. 8147085086

    • @YashKumarJain-v5c
      @YashKumarJain-v5c 3 дні тому

      @@sumitkumar2955 Thank you for the reply, i solved the issue, i was using already set up VPC and there was no NAT enabled.

  • @mayankv83
    @mayankv83 16 днів тому

    Thanks for Video. receiving error white test lamda function "An error occurred (ValidationException) when calling the StartNotebookInstance operation: Status (InService) not in ([Stopped, Failed]). Unable to transition to (Pending) for Notebook Instance" Please help me.

  • @AbhishekRoy-w2f
    @AbhishekRoy-w2f 29 днів тому

    can we run the lambda function without opening the terminal. i am only able to run it if i am opening terminal, the notebook run is successful. if i am not opening terminal, lambda function is successful then also but sagemaker notebook is not running

    • @sumitkumar2955
      @sumitkumar2955 28 днів тому

      "Can you run the lambda function without opening the terminal "- what does it mean could you please tell me which terminal you opening and running lambda?

  • @rithishkonduri508
    @rithishkonduri508 Місяць тому

    Thanks, Mate. It helped

    • @sumitkumar2955
      @sumitkumar2955 Місяць тому

      @@rithishkonduri508 happy to know 😊

  • @shubhampoul1643
    @shubhampoul1643 Місяць тому

    Thanks bro 🧡

    • @sumitkumar2955
      @sumitkumar2955 Місяць тому

      @@shubhampoul1643 please subscribe and share with your friends. Thanks 😊👍

  • @Safar-e4o
    @Safar-e4o Місяць тому

    Pls sir Add the Code sheet in Description.

    • @sumitkumar2955
      @sumitkumar2955 Місяць тому

      Sure, but have I done any coding in this video?

  • @aashishpant
    @aashishpant 2 місяці тому

    does this starts the notebook instance by itself or we have to run this while instance is running?

    • @sumitkumar2955
      @sumitkumar2955 2 місяці тому

      Yes, we have to run this while instance is running..Thanks

  • @vaibhavgupta7429
    @vaibhavgupta7429 2 місяці тому

    Commendable video, thanks a lot. Would appreciate if a lot of missing steps could be documneted in the doc also

    • @sumitkumar2955
      @sumitkumar2955 2 місяці тому

      Thanks 🙏 I guess,I have updated all the steps but I will check and update in below blog. deltafrog.net/trigger-sagemaker-jupyter-notebook-file-from-aws-lambda/

  • @yejinzai
    @yejinzai 2 місяці тому

    Thank you so much! Proven it works!

  • @RahulGupta-uq3ej
    @RahulGupta-uq3ej 2 місяці тому

    @SumitKumar getting below errors when running df.show() Py4JJavaError: An error occurred while calling o77.showString. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1) (LAPTOP-6C4N7D8I executor driver): org.apache.spark.SparkException: Python worker failed to connect back. Caused by: java.net.SocketTimeoutException: Accept timed out

  • @nabeelasyed1034
    @nabeelasyed1034 3 місяці тому

    How to resolve error: externally-managed-environment while installing apache airflow?

    • @sumitkumar2955
      @sumitkumar2955 3 місяці тому

      What step are you following? please provide more information

  • @reneshmlal2809
    @reneshmlal2809 3 місяці тому

  • @wintercherryblossom4020
    @wintercherryblossom4020 3 місяці тому

    Thanks, this is very helpful!

    • @sumitkumar2955
      @sumitkumar2955 3 місяці тому

      Thanks 😊 please subscribe for more such videos

  • @droptimistic7419
    @droptimistic7419 3 місяці тому

    Which API ? Did you use? Which account is the free account?

    • @sumitkumar2955
      @sumitkumar2955 3 місяці тому

      unfortunately,API is not working for me AS WELL

  • @abushama1638
    @abushama1638 3 місяці тому

    Very informative

  • @notanspameratall7293
    @notanspameratall7293 3 місяці тому

    Amazing, thanks for your tutorials and help

  • @abushama1638
    @abushama1638 3 місяці тому

    Great tutorial

  • @TechnoSparkBigData
    @TechnoSparkBigData 3 місяці тому

    Nice video sir

  • @egunjobitunde8369
    @egunjobitunde8369 3 місяці тому

    Free at last🤩. After Several Videos, my df.show() always gives an error. Thanks a lot! This video is a life Saver

  • @AMITDAS-mr8xj
    @AMITDAS-mr8xj 3 місяці тому

    Hi Sumit bro, i have applied this approach to get the dbt packages installed but still im getting module not found error. Although the installation went smooth. Need help

  • @ManishKumar-mj3ko
    @ManishKumar-mj3ko 3 місяці тому

    Can you please tell me about user amit ? when did you created that ?

  • @ManishKumar-mj3ko
    @ManishKumar-mj3ko 3 місяці тому

    Can you please share video link for Create SFTP server for S3 with username and password authentication without using cloud formation template

  • @ManishKumar-mj3ko
    @ManishKumar-mj3ko 3 місяці тому

    Can you please share the link please:-Create SFTP server for S3 with username and password authentication without cloud formation template

  • @TechnoSparkBigData
    @TechnoSparkBigData 4 місяці тому

    That is very good feature, thanks for sharing Sir.

  • @TheSarfarazahmed
    @TheSarfarazahmed 4 місяці тому

    But the screen is blurred, please check.

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      Sure ....can you change the quality to 2k and check

  • @TheSarfarazahmed
    @TheSarfarazahmed 4 місяці тому

    Superb👌

  • @abushama1638
    @abushama1638 4 місяці тому

    Great thanks a lot

  • @notanspameratall7293
    @notanspameratall7293 4 місяці тому

    Is there any way i can upload a .parquet file into the postgre database ?, from my local machine to the postgre container ?

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      You can use python code to read parquet file and prepare data frame the you can write dataframe into postgre DB

    • @notanspameratall7293
      @notanspameratall7293 4 місяці тому

      @@sumitkumar2955 But if the parquet file is on my local computer ? how can i make a dag to upload the data to the postgreSQL db ? By the way, thanks for your response

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      @@notanspameratall7293 where is your airflow running? If it is running local. You can use the same python code in create dag.

    • @notanspameratall7293
      @notanspameratall7293 4 місяці тому

      @@sumitkumar2955 Im currently using Airflow in a Docker compose, im trying to insert datasets from local machine into the postgresql database.

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      @@notanspameratall7293 ua-cam.com/video/qM_jQ7XcJ88/v-deo.htmlsi=e9jOh0kxAQk-fL-r Could you please go through this video. It will be helpful. I am saving file in local and reading this. So you have you move your file in the container first using docker file. Once you have file in ur airflow container you can easily read. Please try. Let me know if you have any issue

  • @jeffersonsilvadiniz7575
    @jeffersonsilvadiniz7575 4 місяці тому

    Solved my problem! I Appreciate it

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      Thanks please share and subscribe 🤠

  • @narcis.nedelut
    @narcis.nedelut 4 місяці тому

    Thank you! It is working. I really appreciate your video and support! 👍

  • @parisaemkani5730
    @parisaemkani5730 4 місяці тому

    can I retrieve data from Twitter by basic developer account? I need data from 01/01/2024 until 31/01/2024. I would be grateful if someone could help me with this issue. I am very new to twitter developer and do not know how to scrape data from twitter for 30 days in January. could u please help me with this issue?

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      Unfortunately My API key not working

  • @bommanasravan8279
    @bommanasravan8279 4 місяці тому

    After so many videos this has worked for me

    • @sumitkumar2955
      @sumitkumar2955 4 місяці тому

      Happy to hear that it helped you. Please share and subscribe 🙏

  • @SouhaCherif-vp2vw
    @SouhaCherif-vp2vw 5 місяців тому

    is it working in a container or do i have to specify that

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      This is AWS managed airflow,you don't have to specify anything

  • @joshisaiah2054
    @joshisaiah2054 5 місяців тому

    Thanks for the tutorial. I tried to use your steps to send value_counts via ses but it wasn’t displaying well. The email was delivered but the result is not well formatted. I was sending df[[‘col1’,’col2’]].value_counts().to_frame(). Any hints?

    • @joshisaiah2054
      @joshisaiah2054 5 місяців тому

      I actually solved it. I transposed the result after converting to a new dataframe

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      Thanks for watching. Happy that it helped you. Please share and subscribe. You can connect with me in case of any issue

  • @HIMANSHUMISHRA-yf5bm
    @HIMANSHUMISHRA-yf5bm 5 місяців тому

    Is there any way to fetch tweets for free?

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      I am not sure. But some of my views have been purchased then also it's not working for him.

  • @ghassanebentahar5695
    @ghassanebentahar5695 5 місяців тому

    Thank you very much for this!!!!!

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      Thanks, please subscribe and share

  • @Shakeel6429
    @Shakeel6429 5 місяців тому

    Nice, can you please show me how to write requirment.txt file, I need to install talend and snowflake

  • @praveena1752
    @praveena1752 5 місяців тому

    Hi, I am trying to install langchain py package with the dockerfile, import is unsuccessful due to python version. How to change python version to 3.10 with same airflow version

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      You have mention python version in your dockerfile

  • @ghazziwang3147
    @ghazziwang3147 5 місяців тому

    bro! nice video!

  • @FaltuKaam-vq7ko
    @FaltuKaam-vq7ko 5 місяців тому

    Thanks Bro, you are a saver.

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      Welcome 🙂 please share and subscribe

  • @alongsandusit8303
    @alongsandusit8303 5 місяців тому

    good tutorial bro

  • @gouseashwakpattekha4450
    @gouseashwakpattekha4450 5 місяців тому

    Instead postgress sql can we use mongodb with airflow to store dag related information

    • @sumitkumar2955
      @sumitkumar2955 5 місяців тому

      Postgress is for structural data(sql) RDBMS and mongo db is nosql. Any specific reason you want to use nosql to store metadata information? I have not used mongo db to store dag related information. I am not sure.

  • @ashutoshgaur5774
    @ashutoshgaur5774 6 місяців тому

    i am using pypi setup, pyspark goes up and running however when i create data or run any code it breaks. any idea if this should work only with anaconda? I tried but breaks with anaconda as well. Edit: there is some issue with pyspark.pandas api which leds to errors particularly when we do df.show(), rest all work perfect on Jupyter notebook. Thank you!

    • @sumitkumar2955
      @sumitkumar2955 6 місяців тому

      May be you need to import findspark

  • @bellapilar3237
    @bellapilar3237 6 місяців тому

    hi, i follow it step by step but i can not start ok de airflow when i try to use dependencies , my container is unhealthy, i do not why

    • @sumitkumar2955
      @sumitkumar2955 6 місяців тому

      Please check docker desktop installation. Please let me know the error message

  • @KundanKumar-gn8dx
    @KundanKumar-gn8dx 6 місяців тому

    Bahut hi acchhe tarike se samjhaya sir aapne

  • @drizzle1866
    @drizzle1866 6 місяців тому

    Solved the problem I was facing with taking my workgroup out of VPC. Appreciate it

    • @sumitkumar2955
      @sumitkumar2955 6 місяців тому

      Happy , that it helped you. Thanks for watching. Please subscribe and share 🙏

  • @juandiegofrancorivera6380
    @juandiegofrancorivera6380 6 місяців тому

    Nice

    • @sumitkumar2955
      @sumitkumar2955 6 місяців тому

      Thanks. Please share with your colleagues and friends

  • @QuangHungLe
    @QuangHungLe 7 місяців тому

    i don t have the path variable in the user variable for

  • @hoshangkaranjekar4852
    @hoshangkaranjekar4852 7 місяців тому

    Bro You made my day... Thanks.. I was struggling for this...

    • @sumitkumar2955
      @sumitkumar2955 7 місяців тому

      I am also happy that it helped you. Thanks for watching. Please subscribe as well😁