Design a Data Pipeline for Time Series Data (Temperature Sensor Data)

Scenario to design the System:
------------------------------------------------------
The requirement is to collect and store temperature readings from potentially thousands of sensors.
We also need to be able to quickly retrieve a reading for a given sensor and timestamp.
We need to keep these for 30 days, after which they can be deleted.
Architecture:
----------------------------
github.com/Sat...
You can refer these videos for practical implementation of different components of the architecture discussed in this video--
Change Data Capture for DynamoDB Streams using Amazon Kinesis in-depth intuition
• Change Data Capture fo...
What is DynamoDB TTL (Time To Live?) | Overview and Demo | Part 1
• What is DynamoDB TTL (...
What is DynamoDB TTL (Time To Live?) | Overview and Demo | Part 2
• What is DynamoDB TTL (...
Learn System Design with AWS:
-------------------------------------------------------------
• Data Architect 101 for...

[@syedbabji7550]

Amazing explaination brother 🙌🙌

[@KnowledgeAmplifier1]

Thank you Syed Babji! Happy Learning

[@somenchowdary6300]

i think this is not a good HLD we need more concepts that tools like load balance, database and even queues etc

[@VijayNaramalli]

Ur always good content creator and tutor

[@KnowledgeAmplifier1]

Glad you think so Vijay Kumar Naramalli! Happy Learning

[@JumaleAbdi-tu3zh]

good content, but what about open source tools? I see all of them are AWS

[@himalayasaikia5762]

You can try kafka+cassandra, cassandra supports TTL as well