Great explanation, I learnt about testcontainers before spring 3.1 and first configuration was a little bit problematic. With this spring-boot-testcontainers approach it seems way easier to configure. Thanks!
That was a fantastic video! It's been extremely helpful in understanding integration testing. I'd love to see a video specifically focused on best practices for integration testing in production environments. This would be a great resource for beginners like myself.
Thanks for sharing! Very useful. Is there a way to speed up the compile time ? I'm using Mysql image for test containers. I takes about a minute to compile before tests are running.
It should not take that long. I have used MySQL / PostgreSQL and it takes seconds. It might help to turn on more logging and see if you notice anything strange going on.
Very great explanation till the last minute 👏🏼 About the last bit though: When we're not specifying orders for our Unit Tests, it might run them in any order, right? So when we're writing tests, they should pass independently and constantly (regardless of the order). Now, when we're inserting a new post, then the vount would be 101. If it runs the count test first, it would be 100. So, either a test on the count is not a good idea, or we should remove the recently added post right after testing insertion in the same test method.
Just discovered your channel these past days, big gold mine! Keep it up and thanks for the help! I was wondering how you easily use the HTTP instead of curl command and the JSON being formatted.. I tried various packages but it did not work for me.
Thank you Dan for this useful video. It seems @Transactional and @Rollback don't work with servlet environment (client and server run in separate threads -> in separate transactions). I have used annotations @Order and @TestMethodOrder to set the order of tests' execution.
Nice video and great explanation! I have one question: If I have so many test classes that share read/write resources, best approach is to decouple dependencies between them first? What about parallelism with multiple container instances? Thank you so much!
Great tutorial as already stated by most commenters. One thing though: Around 31 minutes in, your test fails because you now have 31 objects in your test data. You update the test to make the test pass. Might the reason the test fails in the first place be that the @Transactional and @Rollback does not work when inserting to the database via the RestTemplate? The Spring docs state that: "The Spring Framework does not support propagation of transaction contexts across remote calls, as high-end application servers do." Since this is a call onto the endpoint, not on the repository, this may be the cause of the error. Im all new to both Spring, Spring boot and Spring data jdbc and transactions, so I might very well be wrong.
What are the tradeoffs of using it rather than the docker-compose file with the new docker-compose support of spring boot? Doesn’t it seems you now have two places where you configure your infrastructure? 🤔 One in the docker compose yml file and another with the testcontainer Java code. 😢 Great videos by the way! 😊
@Dan Vega the problem with this setup is that you get errors in the tests since there is no @Transactional to roll back every change, how do you solve that?
In my case i could not get the Rollback annotation to roll back so as to remove the added post in the successful test case, which caused a failed count on the find all test case of 101 instead of 100.
hey @dan!, great resources! I love the way you express the process :D Im also trying to follow best practices, and noted that you skip adding the public modifiers on method? are you following some specific convention that I can check out? or is just for tutorial simplicity and speed? thanks again for your time and effort!
Loved the content and appreciate the effort, I often struggle with writing better logs which actually meaningful when time comes, what your say on it. TIA Anand
Hello Dan. I do not understand why i got this message when i launch test into Intellij IDEA : " java: invalid source release 19 with --enable-preview (preview language features are only supported for release 21) " All is fine, in terminal with mvn command "mvn clean test" but not in the IDE. why ?
I don't think the transactional is working as we think in the video: According to the Spring Boot 3.2 Docs: If your test is @Transactional, it rolls back the transaction at the end of each test method by default. However, as using this arrangement with either RANDOM_PORT or DEFINED_PORT implicitly provides a real servlet environment, the HTTP client and server run in separate threads and, thus, in separate transactions. Any transaction initiated on the server does not roll back in this case. Why are the Spring Boot docs better than the Spring Framework? I have been muddling through this issue.
I assume you are not going to write sql schemas all the time? It's a great video, but my gripe with such tutorials is that they most of the time don't show the complexity of real world scenarios. Two big aspects lacking here in my opinion: 1- handling migrations to the testcontainer in a more realistic way than writing schemas manually. 2- handling authentication. It's a great video nonetheless and much appreciated, but I hope you can talk more about that and show use cases that are more "real-world".
It's not easy at all. We have used testcontainers for blackbox testing. It depends on the microservice, but it took 1-3 min to build up the entire test environment. Their experimental feature allows us to reuse docker networks. So I could reduce the time to build up containers to 20-30 seconds. The second problem is to automate these tests, automic jar is not a solution for this problem. It's just a way of solving a problmen when you have no solution. In conclusion, it's not easy to write integrationtests with testcontainer. It will have consequences for the projects. There are reasons to use this framework for sure but there are also weak points and if you are not solve these weak points, then this framework will turn against you
Hey Dan, I followed along with you, but I'm getting this error: Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.NoClassDefFoundError: org/springframework/data/jdbc/repository/config/AbstractJdbcConfiguration [in thread "main"] Maybe it won't work since I'm using JPA instead of JDBC?
Great explanation, I learnt about testcontainers before spring 3.1 and first configuration was a little bit problematic. With this spring-boot-testcontainers approach it seems way easier to configure. Thanks!
Dan, you are really an asset for whoever wants to learn spring in very easy way.
Dan, Awesome explanation, thanks mate!
That was a fantastic video! It's been extremely helpful in understanding integration testing. I'd love to see a video specifically focused on best practices for integration testing in production environments. This would be a great resource for beginners like myself.
The best explanation on spring boot and integration tests with testcontainer. Your videos are so precious. Thank you so much
Yes you are right, often due to time constraints we often skip writing test cases😅
Right!
Yeah. So called TDD - Testless Driven Development
Good explanation. Thanks Dan
🎉I like the style you show the stuff 🎉
Thanks for sharing It’s gonna be helpful
This video are awsome, better then Testcontainers doc, I'll immediatly start to follow you 😅
Great tutorial. Thanks for that.
Loved the video. Thank you!
Thank you, a great and practical tutorial
Great video thanks 👍
so easy, unbelievable
great tutorial thanks
Learned so much!
Thank you for watching 🤩
You are always best sir!!
Thank you so much 😀
Awesome dude
Thanks for sharing! Very useful.
Is there a way to speed up the compile time ?
I'm using Mysql image for test containers.
I takes about a minute to compile before tests are running.
It should not take that long. I have used MySQL / PostgreSQL and it takes seconds. It might help to turn on more logging and see if you notice anything strange going on.
Dan where can someone get a spring t-shirt? 😢 I have looked everywhere…
Very great explanation till the last minute 👏🏼
About the last bit though:
When we're not specifying orders for our Unit Tests, it might run them in any order, right?
So when we're writing tests, they should pass independently and constantly (regardless of the order).
Now, when we're inserting a new post, then the vount would be 101. If it runs the count test first, it would be 100.
So, either a test on the count is not a good idea, or we should remove the recently added post right after testing insertion in the same test method.
Yes, they run in any order
Just discovered your channel these past days, big gold mine! Keep it up and thanks for the help! I was wondering how you easily use the HTTP instead of curl command and the JSON being formatted.. I tried various packages but it did not work for me.
HTTPie
Hi Dan, thank you a lot for this video. Do you have any examples using Kafka with test containers?
Thank you Dan for this useful video. It seems @Transactional and @Rollback don't work with servlet environment (client and server run in separate threads -> in separate transactions). I have used annotations @Order and @TestMethodOrder to set the order of tests' execution.
Nice video and great explanation! I have one question: If I have so many test classes that share read/write resources, best approach is to decouple dependencies between them first? What about parallelism with multiple container instances? Thank you so much!
Great tutorial as already stated by most commenters. One thing though: Around 31 minutes in, your test fails because you now have 31 objects in your test data. You update the test to make the test pass. Might the reason the test fails in the first place be that the @Transactional and @Rollback does not work when inserting to the database via the RestTemplate? The Spring docs state that: "The Spring Framework does not support propagation of transaction contexts across remote calls, as high-end application servers do." Since this is a call onto the endpoint, not on the repository, this may be the cause of the error. Im all new to both Spring, Spring boot and Spring data jdbc and transactions, so I might very well be wrong.
That's exactly what I noticed; the rollback is not considered when we perform HTTP calls during test execution
Hey Dan, love the videos. Can we consider this still in the scope of Unit Tests? I have the impression this is actually a semi-Integration test
Great video again, Dan. Could you please add the link to the blog post you mentioned at the end of the video. Thank you so much.
Thanks for the great videos, as always.
One small thing: I guess your update test is not doing anything since you never called update endpoint. 😀
Great stuff.
Thanks!
What are the tradeoffs of using it rather than the docker-compose file with the new docker-compose support of spring boot?
Doesn’t it seems you now have two places where you configure your infrastructure? 🤔
One in the docker compose yml file and another with the testcontainer Java code. 😢
Great videos by the way! 😊
The docker compose is used for development. When you run a test you don't have access to that.
Dan, can you cover integration test cases using H2 database
@Dan Vega the problem with this setup is that you get errors in the tests since there is no @Transactional to roll back every change, how do you solve that?
@Dan Vega is it possible to test security context when making these tests? Thanks
In my case i could not get the Rollback annotation to roll back so as to remove the added post in the successful test case, which caused a failed count on the find all test case of 101 instead of 100.
hey @dan!, great resources! I love the way you express the process :D Im also trying to follow best practices, and noted that you skip adding the public modifiers on method? are you following some specific convention that I can check out? or is just for tutorial simplicity and speed? thanks again for your time and effort!
Loved the content and appreciate the effort, I often struggle with writing better logs which actually meaningful when time comes, what your say on it. TIA Anand
which ide theme are you using?
Hello Dan. I do not understand why i got this message when i launch test into Intellij IDEA : " java: invalid source release 19 with --enable-preview
(preview language features are only supported for release 21) " All is fine, in terminal with mvn command "mvn clean test" but not in the IDE. why ?
The spring-boot-starter-data-jdbc was missing in my project.
What is the best way to configure test container in multi-module gradle project?
Does testcontainer support sqlserver as well instead of postgress
I don't think the transactional is working as we think in the video:
According to the Spring Boot 3.2 Docs:
If your test is @Transactional, it rolls back the transaction at the end of each test method by default. However, as using this arrangement with either RANDOM_PORT or DEFINED_PORT implicitly provides a real servlet environment, the HTTP client and server run in separate threads and, thus, in separate transactions. Any transaction initiated on the server does not roll back in this case.
Why are the Spring Boot docs better than the Spring Framework? I have been muddling through this issue.
How to create tables for database while using JDBC?
I assume you are not going to write sql schemas all the time? It's a great video, but my gripe with such tutorials is that they most of the time don't show the complexity of real world scenarios. Two big aspects lacking here in my opinion:
1- handling migrations to the testcontainer in a more realistic way than writing schemas manually.
2- handling authentication.
It's a great video nonetheless and much appreciated, but I hope you can talk more about that and show use cases that are more "real-world".
in public void setup we are using the system undertest . is this ok ?
I have a doubt. Without configuring the datasouce (url, username, password) how it is working and storing the data in db?
Its not you are correct, in fact Im suprised its working here as no jdbc connection has been setup in the repo application.properties file
didnt work for me the image does not get pulled
edit: i was using @Test from junit 4 instead of 5
i think that @Transactional rollback could not be done when we performe http call in integration tests
I am actually facing this issue
@@trimalakismeno u have to use a H2 DB for test.
@@sohaibelbokhari8319 i've seen that suggestion elsewhere as well, thanks!
It's not easy at all. We have used testcontainers for blackbox testing. It depends on the microservice, but it took 1-3 min to build up the entire test environment. Their experimental feature allows us to reuse docker networks. So I could reduce the time to build up containers to 20-30 seconds. The second problem is to automate these tests, automic jar is not a solution for this problem. It's just a way of solving a problmen when you have no solution. In conclusion, it's not easy to write integrationtests with testcontainer. It will have consequences for the projects. There are reasons to use this framework for sure but there are also weak points and if you are not solve these weak points, then this framework will turn against you
you try to cut down on time so much it just turns out sloppy
Hey Dan, I followed along with you, but I'm getting this error: Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.NoClassDefFoundError: org/springframework/data/jdbc/repository/config/AbstractJdbcConfiguration [in thread "main"]
Maybe it won't work since I'm using JPA instead of JDBC?
In case someone else got the issue:
You need to change the annotation of the *RespositoryTest class from @DataJdbcTest to @DataJpaTest