Amazon EventBridge Pipes | Serverless Office Hours

Learn all about the new Amazon EventBridge Pipes.
Developer Advocate Dave Boyne / boyney123 , Product Manager Jeff Oriecuia, and Solutions Architect Dominik Richter join Julian Wood / julian_wood to show how you can create point-to-point integrations between event producers and consumers. See how to optionally transform, filter and enrich steps to reduce the amount of integration code you need to write and maintain when building event-driven applications.
We are also available to answer any of your serverless questions.
Guests: Dave Boyne / boyney123
Dominik Richter / do-richter
Jeff Oriecuia / jefforiecuia
Host: Julian Wood / julian_wood
🆕📢 What’s new in AWS Serverless? s12d.com/whats-new
✍️ Serverless AWS Compute blog posts: s12d.com/serverless-blogs
Episode Links:
Launch Post: aws.amazon.com/blogs/aws/new-...
Serverless Patterns: serverlessland.com/patterns?s...
#serverless #aws
✅ SUBSCRIBE TO THIS CHANNEL: s12d.com/youtube
🌥️🌥️ SERVERLESS OFFICE HOURS 🌥️🌥️
📃 Playlist: s12d.com/soh-youtube
A weekly live office hours to learn about building serverless applications. We cover a separate topic each week including what's new with serverless, deep dives into feature launches and best practices, and explore real world use-cases. Join us live to ask us anything you want about serverless technologies and applications.
🌟🌟ServerlessLand.com 🌟🌟
Your resource for learning about serverless technology.
Learn to use and build apps that scale automatically on low-cost, fully-managed serverless architecture.
Chapters:
00:00 Last Week in AWS Serverless
7:17 Introducing EventBridge Pipes
15:04 Architectural patterns with Pipes
33:00 Event-driven arhcitectures
39:00 Showing Pipes in action

[@yuyokk]

When EventBridge pipes were released during re:invent I couldn't understand the point why I need them if I can do this with Lambdas. After watching this video I realise that I dont need to write those "glue" Lambdas anymore. Will try pipes. Thanks!

[@daveboyne]

Great to hear!

[@yansongguo8354]

Does pipe guarantee exactly once delivery ? Say I am using fifo sqs and want to trigger my step function as a pipe target and the step function needs to run a 2 hour job to pass down the data to next stage. I cannot afford the step function triggered twice with the exactly same message. I guess I need to do some deduplication logic using dynamodb lock in the enrichment phase?

[@arvindsmylz]

I have an aws pipe which is getting json input from sqs. And the target for the pipe is lambda function.
If i remove the filter from the pipe then target lambda is getting invoked. But if i use the filter, nothing works even i cant see anything in monitoring. Please help me on this problem. Note: i have already tested the json event with the filter pattern, and it works.
i have tried removing the filter step and it works but i need to filter my json based on filter pattern.

[@kiyan1226]

Can the source be events from an event bridge rule?

[@architectelevator]

Currently Pipes supports event sources that are polled, so it doesn't process events directly from EventBridge event bus. You could connect the two via SQS, though.