- 6
- 22 157
Coding with Café con leche
Приєднався 1 гру 2011
Always open to share my knowledge of coding.
Always eager to learn more.
Always eager to learn more.
Відео
How to open a door remotely with ESP8266 and WhatsApp - Featuring Python, AWS and Twilio
Переглядів 145Рік тому
This project aims to control a door securely and remotely by using ESP8266, WhatsApp and other services. Repository: github.com/coffeeconleche/door-control-esp8266-whatsapp 0:00 Description of project 1:37 Setting up local server with ESP8266 5:51 Opening ports of router 8:55 Creating Lambda function on AWS 12:58 Creating REST API on API Gateway on AWS 15:14 Setting up WhatsApp sandbox on Twili...
Connect Power BI to Amazon Redshift
Переглядів 11 тис.Рік тому
In this video, I connect Power BI to Amazon Redshift. Also I tell you how to fix a common error when connecting these 2 services.
How to import CSV file from Amazon S3 to Redshift using AWS Glue Jobs
Переглядів 5 тис.Рік тому
In this video, I teach you how to create an AWS Glue Job to perform the transfer of CSV files from Amazon S3 to Amazon Redshift. In the next video I tell you how to connect this database on Redshift to Power BI.
How to create a CSV file and upload to Amazon S3 with Python
Переглядів 5 тис.Рік тому
In this video, I give a tutorial on how to create and upload a CSV file to Amazon S3 using Python and AWS CLI on VS Code. In the next video, I tell you how to transfer this CSV file from S3 to Redshift using AWS Glue Jobs.
How to scrape an ecommerce website with Python
Переглядів 550Рік тому
In this tutorial, I replicate the process of scraping a websitefor different purposes. I applied this to a real project (not exactly an eccomerce), but the core of the scraping is the same. The next tutorial will teach you how to create a CSV with the data scraped.
Nice
Can you send that CSV file ?
Thank you , i am stuck for 2 hours in for this
Thanks
how can you assign a dynamic name in glue??
Hi, I am getting an error "An error occurred while calling o128.pyWriteDynamicFrame. Exception thrown in awaitResult:" when I run the job. Please help me with this. Thanks in advance!
Very much helpful , simple, short and covered all details. Thank you!
Good job, I really liked the project, where is the next video with redshift?
Hello. I'm glad you like it. Here's the link for the Redshift part: ua-cam.com/video/-ZXZNsLILwg/v-deo.html
I got this error, trying to create the classifier Unable to add classifier {"message":"Account 012589933891 is denied access.","code":"AccessDeniedException","time":"2023-10-18T02:36:57.382Z","requestId":"e39bf22a-fe34-4685-bf0b-f6a90a4bf665","statusCode":400,"retryable":false}
Very very underrated video. I hope it reaches everyone. A question - what is the use of the classifier ?
I got an error when creating crawler-redshift. I found VPC S3 endpoint validation failed in cloud watch log.
You need to add a VPC endpoint connection - repost.aws/knowledge-center/glue-s3-endpoint-validation-failed
Can you tell me if it is we have 1000 table in S3 then how we dealing with redshift special schema issue if possible suggest proper way to resolve this
Hello. If you have 1000 csv in S3, you can run a first crawl to enable the crawler to record the initial schema. If every time you run a Job, you have 1000 new csv files, then I suggest setting up your crawler for New files only.
@@cafeconlechecodes thanks for reply
Am not able to have successful connection established to redshift. Please help?
Hello. Which error are you getting? And also tell me in which part of the video you are getting the error.
1}} correct me if i am wrong, raw data is stored in AWS RDS, it is then connected to ETL tool like AWS glue/Alteryx or any, afterword it is loaded into warehouse for example AWS redshift. Am i correct? Then MySQL is connected with redshift in order to query for analysis....am i correct? We can also connect Power BI to redshift for analysis. Is this correct cycle from collecting raw data up till analyzing it???? Simple language and friendly tone, many thanks. kindly reply, i am waiting for the answer. 2}} if i want to connect python (numpy, pandas, seabor, scikit) where does python has to be connected? please mention any AWS service. Where is python relevant? 3}} For ML generally python library like scikit-learn is used, now where should i connect this python, i mean to redshift or aws RDS. Here the context is ML. Confusion is we have to do some changes & cleaning in the data to make it suitable for ML models. So on which tool i have to connect this python tool
Thanks for this video, it was really helpful.
Thank you for this video. Could you please try to connect to the db using DirectQuery and show us how it works for live data refresh?
if you can add more videos with some transformation in glue then load data, and some workflow setup that would be great
Hello! Sure, I will try to add more.
great job
Thank you 😃
I'm Having an error in a job! Can't fix it! can you help? An error occurred while calling o131.pyWriteDynamicFrame. Exception thrown in awaitResult:
Please, tell in which part of the video you are getting the error. I guess it's in the Glue Job?
Thank you so much! This was a very helpful video. Keep it up! <3 It is working now. So simple and straightforward tutorial
Hello there! I'm really glad that I helped you. Thanks for your kind words!
@@cafeconlechecodes Hey ! What is the difference between doing this via Glue or DataPipeline, can both be automated in the same fashion?
@@denisgomonov2320 Hello! The main difference for me is that with Glue you "only" focus on the ETL job whereas DataPipeline allows you to manage even the smallest instance details (like VPC in EC2 for example). Yes, both can be automated to do the same job. Fun fact: I have even replaced Glue with only Lambda for some specific tasks.
Awsome!, Congrats Diego!
Thanks 🙌