SaaS Developer Community
SaaS Developer Community
  • 62
  • 44 487
Leveling up your Software Engineering Career
All engineers want to advance their career - whether in a technical or in a management direction. But not everyone advances at the same pace. In every company you see some young engineers move forward rapidly, while others get stuck at the same level for years.
Stanislav Kozlovski joined Confluent's Kafka team with just one year of experience, when he left 6 years later, he was a staff engineer leading a team of 12. One of the fastest growing engineers in the company.
So I invited him to the show to share his advice - how do you level up your engineering career, how can managers support the careers of their team members, how to play politics (spoiler: don't), the role of the company culture... and of course, 2 minutes of Kafka advice, from the engineer behind the popular "2 minutes streams" newsletter: 2minutestreaming.beehiiv.com/subscribe
Переглядів: 497

Відео

Optimizing Cloud Costs for SaaS Startups
Переглядів 1069 місяців тому
You can't manage what you don't measure, and this includes your cloud costs. But how detailed should this measurement be? And how will the data translate into impact? I sat down with Adam Shugar, co-founder and CTO of Dashdive, to discuss his approach to cloud costs. He shared his advice, not only on cost cutting but also technology, growing a startup, the importance of community and more. 00:0...
SaaS: More than just a business model
Переглядів 197Рік тому
Bill Tarr has the most interesting job in the world. He and his team of SaaS Evangelists at the AWS SaaS Factory work with companies large and small to help them build SaaS on AWS. In this conversation, we discuss the different ways technology and business interact when building SaaS - from cool technical options available only to SaaS companies to the importance of knowing the cost of a tenant...
Building Streaming on S3
Переглядів 1,2 тис.Рік тому
Ryan Worl, co-founder and CTO of WarpStream, is on a mission to re-engineer fundamental infrastructure on top of S3. We discuss the "aha" moment when discussing metrics at Uber with his now co-founder. How they took this insight and built a POC for their ideas before getting acquihired by DataDog. From there, they built Husky - DataDog's platform for events, logs and everything except metrics a...
Kora: Cloud Native Platform for Kafka
Переглядів 649Рік тому
We invited Anna Povzner, director of engineering at Confluent, to the show to discuss Kora. Kora is a Cloud Native platform based on Apache Kafka, which her team at Confluent built. Anna and her team recently published a paper about Kora in VLDB 2023, and it won the industry's best paper award. Kora VLDB paper: www.vldb.org/pvldb/vol16/p3822-povzner.pdf In our conversation, we discussed: - Capa...
Cell Based Architecture for Early Stage SaaS
Переглядів 1,6 тис.Рік тому
In the last year or two I started hearing a lot about cell-based architectures. Usually in the form of “We had a lot of issues scaling our infrastructure, but then we moved to cell-based architectures” and “I wish I’ve learned about cell based architectures earlier, it would have saved me a lot of pain”. As a result, I’ve wanted to share knowledge about cell-based architectures with this commun...
Building a Serverless Streaming Platform
Переглядів 218Рік тому
Krishna Raman has many years of experience building platforms for developers. Now he's applying this experience at Delta Streams to build a serverless platform for stream processing in SQL. In our conversation, we discussed the serverless developer experience, some of the secret sauce behind Delta Stream's Flink Operator, how to deliver a bring-your-own-account SaaS, K8s network policies and wh...
Postgres, Performance and Rails
Переглядів 496Рік тому
Andrew Atkinson took a Rails web application that was struggling with load, and optimized it to handle over 9000 HTTP requests per second with an average latency of 35ms end to end. Handling a much higher load, on a smaller RDS instance, with lower latencies. He then shared his expertise by writing a book: "High-Performance Postgres with Rails." Andrew and I discussed Postgres performance, scal...
Building SaaS on Kafka Streams
Переглядів 606Рік тому
Colt McNealy is re-imagining the future of microservices orchestration and he decided to build it entirely on Kafka Streams. In this conversation we discuss how Kafka Streams provides the low latency, reliability, availability and elasticity that is needed for the next generation of microservices orchestration. Colt also shares the most exciting up and coming improvements in Kafka Streams commu...
The Promise of Serverless
Переглядів 539Рік тому
When developers talk about Serverless, they often focus on FaaS. But the best Serverless experience, by far, is delivered by a data store. It is the best - because everyone uses it, but very few people ever need to think about it. It "just works" and lets developers focus on their code. In this video, Ram Subramanian, Nile's CEO, joins us to discuss how S3 inspires his vision of the perfect Ser...
Giving and Receiving Actually Useful Advice
Переглядів 401Рік тому
UA-cam and Twitter is full “things developers should never do”. There's endless demand for simple advice that applies in all situations. And thats not a bad thing. If there's a simple solution that works 80% of the time, this is useful information. More useful than just "it depends". But advice givers and advice getters can do better. The best advice doesn't just solve an immediate problem. It ...
Transaction Isolation - Demystified!
Переглядів 1,1 тис.Рік тому
If you used a relational database at all, you probably heard of transaction isolation levels. Transaction isolation levels have huge impact on the behavior of your application - correctness, performance and error rates. These days your database may be distributed, so you may have to reason about distributed transactions too. In this video, I explain transaction isolation levels with simple exam...
Never Rewrite! And other advice for SaaS Developers
Переглядів 376Рік тому
You are a founding engineer at a SaaS startup. You built the MVP, and to everyone's great delight - usage is picking up. What's next? In this episode, Jeffrey shares how a messy MVP can gradually evolve into a scalable SaaS product. We discuss the critical design decisions engineers have to make in the early days of building the product: Tabs or spaces, pooled tenants or siloed, Micro-services ...
Scalable Multi-tenant Platforms at Loom and at Times
Переглядів 295Рік тому
Shayon wrote a great blog post on the guiding principles he and his team at Loom used to guide them as they evolved Loom's data platform through a period of hypergrowth. I invited Shayon to the show to discuss the challenges he encountered and how he solved them - and I learned that he is now at Tines - solving an entirely new set of challenges with a very different set of solutions. We discuss...
Real-time Data Infrastructure - At Uber and Beyond
Переглядів 1,1 тис.Рік тому
Real-time Data Infrastructure - At Uber and Beyond
Cloudflare: Performance isolation in multi-tenant DB
Переглядів 2,5 тис.Рік тому
Cloudflare: Performance isolation in multi-tenant DB
Trends in Observability and Alerting
Переглядів 326Рік тому
Trends in Observability and Alerting
The Wonders of Postgres Logical Decoding Messages
Переглядів 915Рік тому
The Wonders of Postgres Logical Decoding Messages
Airtable - Migrating a Multitenant Architecture to MySQL 8.0
Переглядів 785Рік тому
Airtable - Migrating a Multitenant Architecture to MySQL 8.0
Designing a Developer Experience - For Stream Processing
Переглядів 292Рік тому
Designing a Developer Experience - For Stream Processing
The Multitenant journey - From 0 to 500M ARR
Переглядів 797Рік тому
The Multitenant journey - From 0 to 500M ARR
The Unified Theory of Batch and Stream Processing
Переглядів 482Рік тому
The Unified Theory of Batch and Stream Processing
How Share Everything Systems Fence Off Zombies
Переглядів 2422 роки тому
How Share Everything Systems Fence Off Zombies
Compute-Storage Separation - Demystified!
Переглядів 1,6 тис.2 роки тому
Compute-Storage Separation - Demystified!
SaaS Developer Trends - 2022 and 2023
Переглядів 5462 роки тому
SaaS Developer Trends - 2022 and 2023
Data Contracts for SaaS Developers with Benn Stancil
Переглядів 5162 роки тому
Data Contracts for SaaS Developers with Benn Stancil
Venice - Data store for Processed Data
Переглядів 3332 роки тому
Venice - Data store for Processed Data
SLO - Best Practices for Reliable SaaS
Переглядів 2182 роки тому
SLO - Best Practices for Reliable SaaS
Shifting Left of API Security
Переглядів 7232 роки тому
Shifting Left of API Security
SaaS Access Control: a customer-centric approach
Переглядів 4272 роки тому
SaaS Access Control: a customer-centric approach

КОМЕНТАРІ

  • @dharmendrarathod7088
    @dharmendrarathod7088 3 місяці тому

    I work as a Senior Data Product Manager. And I can't emphasize more that I really love your video and your explanation of data topics. For me, every 2nd minute I re-learned something new. Would love to watch more of your videos ❤

  • @indrjeetkumar
    @indrjeetkumar 4 місяці тому

    full form of kora

  • @SyedAshrafulla
    @SyedAshrafulla 5 місяців тому

    Great talk-shop conversation! I didn't really internalize the power of free replication and constant networking cost. Software has been trying it seems now for years to split different horizontals (compute, storage, networking). It seems like cloud storage provides the ability to really just focus on compute optimization as that's the largest cost now.

  • @gnanyreddy3030
    @gnanyreddy3030 6 місяців тому

    Awesome video

  • @aberba
    @aberba 7 місяців тому

    I'm at a critical stage where I have to decide how I'm going to price my SaaS before launch. My gut tells me usage based pricing is the way to go for my CRM however most existing solutions are subscription based. Even though I'm concerned about familiarity with my customer base, I still believe strongly metered billing is natural, sustainable and fair overall. It also simplifies my limit logic implementation as I won't have to put checks everywhere in the code to restrict usage based on the subscription plan.

  • @roughriverster
    @roughriverster 7 місяців тому

    Thank You

  • @orwahassan821
    @orwahassan821 8 місяців тому

    great session, thank you

  • @sumithachandran
    @sumithachandran 10 місяців тому

    very intresting for people to create databases

  • @sumithachandran
    @sumithachandran 10 місяців тому

    great inspired me

  • @JoveZhong
    @JoveZhong Рік тому

    Nice talk. One question I always want to ask but didn't really expect a firm answer here: How Kora is implemented? Is that still Java or some native engine, or mixed? Since it's highlighted for Confluent Cloud and Cloud Native, probably it's actually a set of micro-services.

  • @driziiD
    @driziiD Рік тому

    very instructive! thank you

  • @MegaCMrd
    @MegaCMrd Рік тому

    In the begining of video, you were talking how you were angry against junior developers because they wanted quick answers that solve the problems, i have a question about that plz let's say i am learning spring should i go as deep as learing how it works under the hood and look for how it does the scaning of the beans or it's enough to just know that spring does this and that. Like what do you lean by learning topics in depth ? Because in that way i would be stuck in learning one framework/technology for long time and not knowing anything about other technologies, thanks in advance

  • @ColtMcNealy
    @ColtMcNealy Рік тому

    This was fun! Thanks for having me on the show, Gwen!

  • @leonardofg
    @leonardofg Рік тому

    Love your content, Gwen! I have been sharing it with a lot of my friends & co-workers :) I need to come to the Slack and interact more with the community!

  • @DollyBastard
    @DollyBastard Рік тому

    Nice interview. I didn't realize that Rails is still so popular among upstarts, isn't there a strong performance penalty when using Ruby? I guess the book would answer this ;)

    • @andatki
      @andatki Рік тому

      Hello! In the main app as measured by New Relic APM at more than 400k RPM (550k RPM across all services) the Ruby portion of the 35ms average response time was just 5ms. The book focuses more on squeezing everything out of PostgreSQL for web applications like Ruby on Rails, and not at all on the language performance though. In my opinion 5ms is within the latency budget for 90% of web applications. Most web applications I’ve worked on don’t achieve this level of performance, but it is possible! On the other side of the coin developers can build and ship things quickly with Ruby on Rails which provides a lot of value to teams. Ruby on Rails is still quite popular (although definitely not new) and a few survey results are linked to in the book to support this claim. Thanks for checking out the interview and for your interest in the book! 🎉

  • @alembics
    @alembics Рік тому

    Great episode, thank you both.

    • @saas-dev
      @saas-dev Рік тому

      Glad you enjoyed it!

  • @DollyBastard
    @DollyBastard Рік тому

    Thanks a lot!

  • @yogpanjarale
    @yogpanjarale Рік тому

    Okay this came in my feed at 0 views

    • @saas-dev
      @saas-dev Рік тому

      We hope you enjoyed it!

  • @IntuitiveGanesh
    @IntuitiveGanesh Рік тому

    I can't comprehend 50 million+ requests per second.

  • @VaibhavPatil-rx7pc
    @VaibhavPatil-rx7pc Рік тому

    Excellent

    • @saas-dev
      @saas-dev Рік тому

      Thank you so much 😀

  • @stanisgmi
    @stanisgmi Рік тому

    Smart to support per base backup - atlassisn had a 14 day outage because they didn’t

  • @MosheEshel
    @MosheEshel Рік тому

    Really impressive! would like to hear more about how you make sure that indeed it is all working (these distributed clusters) - how do you test for correctness and how do you handle network partitions and split brain (assuming the DB must have more than one leader? or at least one per region/zone?)

  • @jamesdetweiler
    @jamesdetweiler Рік тому

    Great overview! Thank you, Gwen!

    • @saas-dev
      @saas-dev Рік тому

      Glad it was helpful!

  • @kitschgom
    @kitschgom Рік тому

    Mitigation "Open the window" LoL. Thanks for this inspiring talk!

  • @tobyclements4812
    @tobyclements4812 2 роки тому

    Interesting. One question I would have is if there is a dissonance between providing a limited SQL-like DSL for users, presumably to lower the barrier for entry, and asking the same users to make an educated decision about whether they need causal consistency 🤔?

    • @tobyclements4812
      @tobyclements4812 2 роки тому

      Just to clarify: I think SQL is awesome. But I’m not sure how a per query isolation level choice would pan out in most enterprises.

    • @tobyclements4812
      @tobyclements4812 Рік тому

      @Santona Tuli Wow, thanks for such a comprehensive reply :) and thanks for the blog too (anyone who finds this I suggest watching the video linked as 'the optimal level of abstraction' when you get to it). My concern with these super-smart products - and turning causal consistency on or off with one word in SQL is certainly very nifty - is that it's just such a long way from a traditional database. Most engineers I meet aren't so familiar with distributed systems to make an educated decision on this - it's simply not part of their job right now. I remember a conference talk Martin Kleppmann gave where he asked for a show of hands at StrangeLoop for anyone who could define (on the spot) the difference between repeatable read and read committed isolation - one hand went up, and that was at StrangeLoop! I guess, imo, if batch and streaming are to be unified we can't rely on the hive minds at the best SaaS providers in the world; we're going to need to teach a whole lot of people a whole lot of stuff.

  • @mdaverde
    @mdaverde 2 роки тому

    This explanation was so concise and clear! Seems to me predicate push-down is a needed network optimization on top of the compute & storage model. What are the tradeoffs of adopting this pattern though? Possibly more compute hardware on the storage server? Latency less predictable due to the filtering logic?

    • @saas-dev
      @saas-dev 2 роки тому

      Great questions, there is always a catch, right? Here, the main catch that someone needs to write DB-aware storage layer and then integrate it with the DB. This is a serious lift, so in many cases you don't have this option. If you are running this system yourself, you do need to operate two inter-dependent clusters, so there is an operational complexity catch too. Predictable latency is a serious concern, but not unique for those systems. Almost any data store with predicate pushdown also has some kind of query optimizer, one that depends on statistics about data sizes, CPU, etc. Even without the storage layer, a query can go from fast to slow in a blink for many reasons, the storage layer adds a few more factors that can cause performance to flip. The topic of optimizers in complex distributed DBs is worth its own video. More compute hardware on the storage layer could be an issue, but in my experience, the storage layer cores are typically under-utilized. I normally see disk throughput and network throughput as the major bottlenecks, so pushdown balances things out a bit.

  • @VeniceDB
    @VeniceDB 2 роки тому

    Thanks for the interview Gwen!

  • @sumantkhapre6066
    @sumantkhapre6066 2 роки тому

    Wow. Great explanation. Subscribed

  • @siddapuramjangaiahsiddapur9493
    @siddapuramjangaiahsiddapur9493 2 роки тому

    Great job buchi

  • @sriramgoud4115
    @sriramgoud4115 2 роки тому

    Great job anna...

  • @anoopdawar
    @anoopdawar 2 роки тому

    To me a data product is something that takes data as the primary input and create value as opposed to the regular products that create value and as part of that create data as an output. For example a regular bank app that simply allows you to move $ from one account to another is a traditional product. As part of this product data is output (i.e. Person A moved $x from Account A to B). A data product would then take all these account movements across all users and create a new product that maybe shows movement of money across all accounts to help inform macro decisions. Here the primary input is data. So data products require data as the primary input and create value for users.

  • @nehapawar5027
    @nehapawar5027 2 роки тому

    Thanks for explaining, very well done! I was one of those who kept hearing about the term but didn't understand why it is a big deal.

    • @saas-dev
      @saas-dev 2 роки тому

      Glad it was helpful!

  • @swyxTV
    @swyxTV 2 роки тому

    thank you for answering this topic so comprehensively!

  • @ravraj7851
    @ravraj7851 2 роки тому

    Very well explained, thank you Gwen.

    • @saas-dev
      @saas-dev 2 роки тому

      Glad you enjoyed it!

  • @granguyggg
    @granguyggg 2 роки тому

    Note to the deaf: the video is captioned. Hurray! The speaker knows how to present the material in an interesting way.

    • @gwenshapira5757
      @gwenshapira5757 2 роки тому

      Thank you! The captions are because UA-cam is amazing and does it automatically.

    • @felixgv
      @felixgv 2 роки тому

      Captions are probably added via reverse ETL 🙃

  • @atanudasgupta
    @atanudasgupta 2 роки тому

    is there a product demo somewhere

  • @tsjagan1
    @tsjagan1 2 роки тому

    Great chat. I have tremendous amount of respect for both of you.

  • @bigfeetentertainment5473
    @bigfeetentertainment5473 2 роки тому

    very cool. I am a SaaS builder hoping to launch my product that has to do with signin flow!

    • @saas-dev
      @saas-dev 2 роки тому

      Interesting! There are many startups in this space now, so I'm looking forward to seeing how you approach it. I hope you will announce it on the SaaS Community Slack!

  • @zzzggg388
    @zzzggg388 2 роки тому

    This is a 10B idea/startup.

  • @zzzggg388
    @zzzggg388 2 роки тому

    How much revenue does a startup need to worry about these things?

  • @chokha76
    @chokha76 3 роки тому

    Nice talk!

  • @PeterCorless
    @PeterCorless 3 роки тому

    Quality is "conformance with expectations." Which means that a lot of quality is a function of expectancy [measurement of anticipated value] and then instrumentality [measurable to those anticipated values].

    • @PeterCorless
      @PeterCorless 3 роки тому

      For example, with a "beta" there is an expectancy set that this should be usable, but not defect-free.

    • @PeterCorless
      @PeterCorless 3 роки тому

      I highly commend people look at Vroom's expectancy theory of motivation. Motivation = f(valence,expectancy,instrumentality)

  • @itamarwe
    @itamarwe 3 роки тому

    I think that you describe exactly the role and significance of a product manager. At least the way I define it.

  • @sureshnatarajan3609
    @sureshnatarajan3609 3 роки тому

    Great Insights, it was very useful

  • @yesikacaicedo3206
    @yesikacaicedo3206 3 роки тому

    You're not just talking to yourself Gwen, the world needs more of these videos. Thank you.

    • @saas-dev
      @saas-dev 3 роки тому

      Thank you, Yesika!

  • @ikenna.ogbajie
    @ikenna.ogbajie 3 роки тому

    Thanks Gwen! Nice talk.

    • @saas-dev
      @saas-dev 3 роки тому

      You are so welcome, Ikenna!

  • @saas-dev
    @saas-dev 3 роки тому

    You can find the slides here: speakerdeck.com/dschenkelman/all-about-authz and the links about Sandcastle and @auth0lab: Sandcastle playground: learn.sandcastle.cloud/ Auth0 Lab discord: t.co/ybHn8hEOBl?amp=1 Authorization in Software: Subject Matter Expert Chats: ua-cam.com/play/PLZuCrkqyqw9wY0bCosGYDMI9enFpg_tk-.html @auth0lab: twitter.com/auth0lab