Data-driven testing using Postman
Вставка
- Опубліковано 23 лип 2024
- Data-driven testing can be a very effective approach in testing an API against different data-sets.
Postman collection and the data file: gist.github.com/vdespa/74e21d...
___
// POSTMAN COMPLETE GUIDE ONLINE COURSE
👉 Want to learn more about Postman? Check my Postman online course.
Get it at a special price and help support this UA-cam channel:
vdespa.com/courses/?q=UA-cam
___
// I HAVE A QUESTION!
I do my best to answer all comments here on UA-cam but I cannot make any guarantees.
If you have a question, it is best to ask your question on the Postman User Group on Facebook or on the Postman Community (links below).
If you have purchased the Postman Online Course, please use the Q&A section or send me a message on Udemy.
Please do not email me or contact me on other channels as I might not be able to answer. Sorry!
___
// I HAVE A VIDEO IDEA
Do you want me to create a video on a specific topic? Just fill out the form below:
forms.gle/uWEzXFQ2viJtZtvZ7
___
// P L A Y L I S T S
▸ Learn Postman | bit.ly/2CFaf70
▸ Postman Crash Course | bit.ly/2YwEBBT
▸ Postman Tips & Tricks | bit.ly/2JLkXyU
___
// F R E E R E S O U R C E S
▸▸▸ DOWNLOAD the FREE Postman Quick Reference Guide
bit.ly/postman-quick-reference-yt
▸▸▸ Ask a question on Discord (unofficial)
/ discord
▸▸▸ The OFFICIAL Postman community forum
community.getpostman.com/
▸▸▸ 👉 Subscribe to the "Testing and automation with Valentine" newsletter for bi-weekly tutorials, tips, and news from the industry.
eepurl.com/gPwpU1
___
// YOUR SUPPORT ON PATREON MATTERS
If you enjoy this content, help me create more like this. Consider supporting me on Patreon.
/ vdespa
___
// IMPRINT
vdespa.com/imprint
---
👉 Want to learn more about Postman? Check my complete Postman online course.
vdespa.com/courses/?q=UA-cam
I have a typeError: TypeError: Cannot read property 'id' of undefined
Excellent, from your example, I was able to load data from a .csv, but not only to load it from the Body, but as a pre-request-scritpt and as an expected value in the response. Thank you very much
Congrats, I am glad it helped.
It was really helpful as I was wondering how to create multiple profiles using dynamic data and assert the same in single api call
YOU JUST SAVED ME HOURS OF TOILING!!! I WAS TRYING TO GET A WAY TO CHECK IF THE DATA SUPPLIED IS THE SAME AS THAT RETURNED AND YOU SPOKE ABOUT IT. THANKS A MILLION!!!
I appreciate your enthusiasm! Thanks for your comment.
Thank you for making great tutorials. Excellent video!
Glad you like them!
This is amazing quick tutorial, really helpful.
I am glad it helped. Thanks for watching.
Thanks a lot for your work, Valentin!
Thank you too!
Great video, thanks! Content matches total length of this video :P
You are welcome. Thank you for leaving a comment.
you're so easy to listen to. You should narrate childrens books, too :) Thanks for making Postman easier!
Thanks 👍
I like how you do the zoomed-in screen. Nice vid !
I'm glad you like it
just what i needed for my tests!
Glad that you liked it. Thank you for leaving a comment.
Very nice video. Thanks Valentin, hello from BRAZIL
Obrigado por assistir!
by today i completed all your video series from 1 to 55..nice exaplanation. Thank you very much dear Valantine..!!!
Great job! Thanks for watching so many videos.
@@vdespa i spend almost 20 days...thanks you for the response and your KT.
Thank you very much, this is really helpful
Glad it was helpful! You are welcome. Thank you for leaving a comment.
love it. it helped me greatly
Great to hear that. I am glad that it was helpful.
very helpful, i like your series...
Thank you very much!
Hi Valentin,
Thank you for the video. If I have multiples endpoints in a collection, does it mean I have to have a csv file for each endpoint. And if I were to do a regression test on all those endpoints, what approach would you suggest?
Thanks so much ! :)
I am glad it helped.
Thank you very much for the video, I love it
I had the following doubt
I'm posting XML to a web service. I would like to use Runner to send multiple requests using a datafile. The {{VAR}} syntax works great for JSON but doesn't seem to for XML? Is this possible?
Thanks for the detailed Video . Is it possible to use the data from excel which will be available only in the response which needs to be validated ? For eg I am passing name and student I’d in the request and I am getting score in the response . I want to validate the score in response against the expected score (available in csv) . Is it possible to use variables in params when not I used in request
Hi @vdespa, Can you please let me know how we can read data from excel files and that too will be a file paths in each row? Thanks in advance !
Your videos are awesome. 1)Could you share what are the challenges you faced in api testing using postman. 2) What is the interesting bug you found while api testing using postman, appreciating if you could share your thoughts. Thank you.
Thanks for the appreciation. The biggest challenge is when you use Postman to the maximum and discover its bugs or limitations. The most interesting bugs are the ones that are hard to replicate.
@@vdespa Thank you.
great content and presentation
Much appreciated! You are welcome. Thank you for leaving a comment.
Exactly helpful
Glad you think so! You are welcome. Thank you for leaving a comment.
Much needed
Thanks!
Thanks!
I help myself too much yo understand.
Glad that it helped. You are welcome. Thank you for leaving a comment.
Very helpful tips!
Could you please share which tool you used for writing and saving json/csv files? It was difficult to catch from the video.
Thanks for watching. I have used the Atom text editor, which is free. atom.io/
Thank you so much for the video Valentin. Quick question though, Is there a way I can add the pass/fail status of my postman tests to my csv file? If yes, how do I do it? Is there a command or do you have a video explaining it? Thank you in advance
You can't directly write to files from Postman. To do something like this, you need to build some custom scripts using Node.js, Newman and JavaScript.
Great!!!
Could you please explain how to use an external json file when my collection runner has to run multiple request, holding the data in different CSV-files?
Postman can only work with one file at the time. The best way to approach this is to have a processing step before that merges the files into a single one. Join the Facebook community (see link in the description) and ask your question there. Consider adding more details, including screenshots.
Hi @Valentin despa I have executed requests just as you have shown,but I am receiving the typeerror :Cannot read property 'id' of undefined,could you suggest me for further running of tests
Can you rewatch the video to see if it is really exactly as shown?
Great video! What's the best way/tool to perform a data-driven test concurrently with varying post request bodies?
Thanks for watching. Try the solution proposes to your own problem and see if it works.
Dear Valentin,
I am trying to figure out how to loop through response body parameters under one global variable that are coming from a csv so the I can update all of my tests in a collection easier if a response body parameter changes. Let me know if you have any insight on this? Thanks, great video.
Hey Shane, thanks for asking. Maybe you can share more details about this on the Discord channel (link in the description).
Thanks for this video. However, how can we write test scripts based on different data sets?
e.g. test scripts for invalid name case, invalid email case, success case etc based on the data.csv via runner?
Writing tests based on different data sets follows the same principle.
Please, try to investigate if it is possible to send requests with the help of pm.sendRequest Synchronously. That would be extremely helpful!
And thank you for the video!
I don't think this is possible. Use regular Postman requests and chain them.
Good stuff. Is it possible to use in this way nested data from the json data file? When trying to use such a file, postman seems to understand only the data from the first level. Using the preview, all the nested data is seen as a string, not as separate variables :(
Yes, you can use nested variables, but this does not mean that Postman will do magic with it. You can "prepare" the data in the pre-request script as you need it.
@@vdespa how can I reach for the data in datafile in pre-reguest scripts? It's not part of the response, so responseBody won't work. Postman sees first level data from the file as variables but all nested data is seen under "top level" variable f.e. Person [{"name":"Joe", "age":20}]
Hi Despa, I want to read the data row wise based on header for the same collection for the same row with different headers. Is it possible (Ex : 1st row 4 headers same collection should be run with different header value at a time only one)
Hi, how is this different from the example provided?
Hi @valentin Despa, this is amazing video I have one query let suppose i have multiple GET ALL request and for every request i have to pass different data, so can we create one .csv file and use different work sheet for, if it is possible, who can we do this. Or is any other way (because in my collection there are multiple GET ALL Request and I need to run in one time
fb1
Thank you for the video.
I have question, can data driven use in params instead of request body?
Sure, why note. You can use Postman variables ANYWHERE in the request.
its just an awesome vedio...
Many many thanks
Hello @valentine Despa i have a question how to pass data to multiple requests from the JSON file as currently i am importing only single file
It is hard to answer this with the given information. Join the Discord community (see link in the description) and ask your question there. Consider adding more details, including screenshots. Thanks for understanding.
Thank you Valentin for the video. I have tried this test on a different API but keep getting errors. First question I have is why it is returning a status code of 200 when it is a POST request? Also, when I checked my database, the created data is not showing (The response body on postman is always null). Finally, I got this error (I did a post request on creating a question and storing it in the database. The name of the parameter is Question): Create question | TypeError: Cannot read property 'Question' of undefined
I am sorry you are getting some errors. Before looking into data-driven approaches, make sure you API works with static data. Join the Facebook community (see link in the description) and ask your question there. Consider adding more details, including screenshots. Thanks for understanding.
My response has the string "3-ABC Test" when I hard code this value for the match with response. It passes my test case. But when I read this value from .csv file. It fails. While if the value is just "Test" is passes the test case after reading from .csv file. Is there any difference in how postman read sting data with space or an special character in postman.
It is hard to know what the problem is in this case. Join the Facebook community (see link in the description) and ask your question there. Consider adding more details, including screenshots. Thanks for understanding.
I am not able to pass true/false values from CSV to postman.please help
I have different version of the same API. I have some test cases written in first version of the API. How to move them to the second version of the API. Thanks
Not sure what you mean by that. Join the Facebook community (see link in the description) and ask your question there. Consider adding more details, including screenshots. Thanks for understanding.
Hi @Valentin Despa Can you please provide Coupon code for your Postman: The Complete Guide - REST API Testing Course which is available on UDEMY ?? I really wanted to learn API testing using Postman
Hi Suraj, please got to vdespa.com/courses/ - I am publishing coupons there from time to time.
Hi Despa, I have an api request which is configured to fetch values from CSV file and it runs well using collection runner but when I run the api individually by clicking on send button it shows an error because the values from CSV file are not accessible. Is there a way to solve this problem?
Define the variables in the collection so that it works in Postman as well - if you really need this.
@@vdespa Thank you for replying, but my requirement is to implement api automation using Newman and to use environment/collection variables at the minimum. Can there be another alternative to run a single api request having variable references from CSV file without any issues?
This was a lifesaver! I need help on this scenario: What if I want to skip an empty array in a json file? For example, my file contains a discounts array that does not require values so some of them are blank. Please help, it's driving me crazy! :)
Thanks for watching, Melissa. Consider joining the Discord channel and sharing some additional details there.
@Valentin Despa hai bro, can you help me? how to get newman htmlextra report on colection postman with json table data like this program you made?
if i run the colection it dont ask for the table data so it only give 1 iteration, i have many data iteration in the table
@@martinrmpardedepardede7431 Not sure what you mean. Join on Discord and share more details here.
@@vdespa oke bro thanks. i've send it in the discord. I have searched on google but can't find the solution
Question: is there a way to save the data file the collection so you don't have to reopen it every time?
Hi Ken, this is a good question. The data file is not tied to the collection itself, so it's location can't really be persisted. Most of the time, it is best to use Newman to automate the run.
Hi Valentin, love the way you explain.I have one query and I am sure you gonna be help out asap.
Query- As above video you have achieved data-driven approach through .CSV file. Gave the request values through .CSV file. What about response body?Basically I use GET method mostly where I need to verify the Response body. I want now to verify response body dynamically, How I can achieve?Through the .CSV we can do it?
Looking forward!!
Thanks for your appreciation. Yes, you can verify the response. You can use pm.iterationData.get() to get a value that contains the expected response.
@@vdespa But want to do through dat driven(.csv file)
@@aakashjain4437 - you can load the csv file and write something like this in your test - pm.expect(response.json.).to.eql(pm.iterationData.get())
Hi valentin,
I have one query. Suppose i want to check on the response status code and the basis that i want to run the test cases.
========================
suppose for resposne code 501 and 500 , I just want to print some message in log but other than these two codes, i want to execute test as below. But this is not working.
if( pm.response.to.have.status(501)){
console.log("The response code is 501, please check. ")
}
else if ( pm.response.code.equal(500))
{
console.log("The response code is 500, please check. ")
}
else
{
const response=pm.response.json();
var responseMessage =response.message;
console.log("Response message is : "+responseMessage)
var responseBookingID =response.BookingId;
console.log("Booking ID for iteration no "+ iterationNoToShow +" is :" + responseBookingID);
pm.test("Verify that booking is posted successfully ",function() {
pm.expect(responseMessage).to.equal("Booking created successfully")
}
)
Hi ,
Could you also explain how to Import json files with Nested array values ?
Take a look at this tutorial: ua-cam.com/video/MOdMKrjTOi4/v-deo.html
I mean until unless all the variables used in single payload the values will not loaded This is my concern which we have used in csv file.Is it correct
You you please clarify this? I am not sure what you mean.
I follow your steps, but no result is showing in pass & fail, only getting responce 200/400, & receiving message "not have any test", plz help me to know how to validate if we are entering wrong format of email id in csv file?
It is hard to know what the problem is in this case. Join the Facebook community (see link in the description) and ask your question there. Consider adding more details, including screenshots. Thanks for understanding.
Hello sir, I have a case where I have to pass different query params for multiple GET endpoints. How can I pass that using a CSV file? Today I tried this method but did not work. This is my case for the first endpoint, I want to read A1, A2, A3 and for the second GET endpoint, I want to read from B1, B2, B3. Is it possible?
Join the discord server and share more details there. Link in the description.
@@vdespa Thank you! I've shared on discord
How to read value from multiple sheets within one csv file please ? How to provide the sheet name in postman please
I have not seen any CSV files with multiple sheets.
Hi ,Can we store data file inside Postman or is there any option to use data file without saving in local to use it for integration with Jenkins.
You could store that in a variable but it would more more inconvenient.
@@vdespa Thank you for your reply.Let me clarify your point,so I should use my local folder path where my data file is saved in my newman command to execute it in jenkins.Is that right?Because I can see options for generating API key and can get the url for collection and environment and no option for getting test data like that,which is blocking for me to proceed.
@@anjanar3053 There are many aspects to be explained. I have documented everything in the course.
Instead of creating files like .json or .csv can we do the above internally in postman like write those in the body section
Yes, but that will create a single iteration. This approach is useful when you want to reuse the same address with different data.
@@vdespa Do you have a video on that please or can you please share how to do that in a single post request...
@@sumitpatra2418 i have 1-2 videos on my channel. You will have to search for them.
Can i asynchronously schedule my request after 30 mins from postman collection runner ? (without blocking the other requests)
I don't think this is possible. Why 30 minutes?
Hi Valentin,
Can we input the query and path params for GET request from excel file.
Thanks
Yes, absolutely.
@@vdespa Thanks, I got that Fixed. But how to use the single .csv file with multiple sheet for different requests. Basically I have two GET requests. First request works fine as it reads the data from .csv. Now I have data for another GET request in the second sheet how to let Postman know the data for second GET request is on the second sheet. Thanks
@@rahulprinjay1 please ask in the Facebook group.
what if we have to post the request body different every time for the same API.
i mean not every time, but suppose my API can consume 2 type different body request. so then how we can take the data-drivent test from json file.
You can add the full JSON body to the file.
I have a request body as below
{
"Name": {
"Fname": "Shyam",
"lastname": "Raj"
},
"DOB": {
"Date": "08",
"Month": "12",
"Year": "1994"
}
}
how can i test it. some times I need to remove complete object to test. ex: with DOB
Can we so the same with an excel file ?
No. You need to export the Excel file in the CSV format.
cool
You are welcome. Thank you for leaving a comment.
Hello, I have a question for you.
How can i handle dynamic response status via CSV file?
Depends what you want to assert. An example would be useful.
@@vdespa Same with you example,In CSV data file i have one more "status" collum.
Interation, name, email, age and status(200, 201, 400) for each interation. How can i test difference response code?
@@vdespa
pm.test("Status code is {{status}}", function () {
pm.response.to.have.status({{status}});
});
I want to compare status which i got from server with csv file for each case
@@phucpham6373 {{varname}} does not work from scripts.
If i add a collum "status" into csv file, it include some status(200, 201, 400). How can i handle dynamic response status?