Hi Raghav, Thank you so much for making the latest Beginner videos which is of 2022, is there any plan of uploading the same for Intermediate and Advanced courses too sooner please? Your videos have given confidence and the strength to jump right into performance testing without having any prior knowledge.
Ashish Thanks for the kind words The videos created earlier are still valid, I have also created Masterclasses with recent versions, I will keep adding more, Can find all here - automationstepbystep.com/
Hi raghav loved your video. i have few queries in real we use multiple machines to generate load do we have to install Jenkins on each machines. If yes how can we see the integrated results.
Hello Raghav, this is 2020. What is the correct site to download Jenkins+Jmeter integration(Jenkins performance plugin)? Thanks for all your beautiful videos.
Hello Raghav, how to get individual JMeter test’s metrics on the Jenkins Performance plug-in, currently I am getting only Summary of run one line Thankyou in advance
Hello Raghav thanks for all amazing videos, have a quick question on assertion details Is there a way to see sampler details (req header, url, resp header and data) in jenkins ?
Hi, i have not checked practically, However in the post build action, in jmeter reports, you can add multiple reports. So if you can get some report having this data, should be able to show on Jenkins
Hi Please do a video on jenkins code coverge report "Jacaco" also in above video what is the use of that line you added in bin/user.properties or at the -J option in the jmeter run command as under "Publish Performance test result report " plugin Under "Report files" you gave jtl format instead of that xml file path.
Great Video, has helped a lot. I have a question: On the post-build actions - Publish Performance test results report I don't see the same you see. I notice that you use the 1.4 plugin version in this video and I downloaded the version 3.2 (latest). I have more a Standard Mode and Expert Mode Section. No performance report option. Thanks for your help
Hello Raghav, Hope you are doing well. I need some information, just guide me little bit and provide some links or videos if possibsle. I want to run my testing file from IntelliJ using these tool Jmeter and Taurus. How can I do this ? Second is it good if I use Blazemeter because the website links change with time. What can I do for this? Just tell me the way how can I start this and which steps i should follow. Should i write my own script like Cucumber? I just give example First step create a Jmx file using Blazemeter 2nd step write a taurus code 3rd run from intellij etc etc if I want do any change should in my test case then I run my blazemeter again from start ?
Hi@Raghav, thanks a lot for making a nice video on performance tests running in jenkins. Can you please make a video on running j meter tests using Git repo, that would be great. Or can you please suggest how to run the same tests in bamboo. How would we capture the min, max and average times etc or more parms on the performance dashboard. Your response is much appreciated. Thanks
Hi Raghav, I had gone through both intermediate and beginner Jmeter tutorials and are very helpful to start with performance testing.Just wanted to know if there is any plan of making the advanced Jmeter tutorial videos...
Hi Raghav, I am getting the following error when trying to build in jenkins....Can u help me figure out whats causing this issue? "Error in NonGUIDriver java.lang.NullPointerException"
Hi Ragav, Thanks for a great video. This is very informative when we have Jenkins in our local. What is the process to input JMX file to a Jenkin which is present on a different server and not the same server where Jmeter is present. Hope my question is Clear. Please let me know if it's not. Awaiting for your reply. Thanks in advance.
Bhanu The Publish Performance Test Result Report post-build action is available in the Jenkins Performance Plugin. To install the Performance Plugin, follow these steps: 1. Go to *Manage Jenkins* > *Manage Plugins*. 2. In the *Available* tab, search for "Performance Plugin" and click *Install*. 3. Click *Install*. 4. Once the plugin is installed, click *Restart* to restart Jenkins. Once the Performance Plugin is installed, you will be able to see the Publish Performance Test Result Report post-build action in the *Post-build Actions* section of your job configuration. To configure the Publish Performance Test Result Report post-build action, you need to specify the path to the performance report files. You can use the `${WORKSPACE}` variable to reference the workspace directory. Here is an example of how to configure the Publish Performance Test Result Report post-build action: ``` Publish Performance Test Result Report Source data files: ${WORKSPACE}/*.jtl ``` Once you have configured the post-build action, click *Save* to save your changes. To run your job, click the *Build Now* button. Once the job has finished running, you will be able to view the performance test report in the *Build History* section of your job. If you are still having trouble finding the Publish Performance Test Result Report post-build action, you can try the following: * Make sure that the Performance Plugin is installed and enabled. * Make sure that you are using the latest version of Jenkins. * Try restarting Jenkins. * Clear your browser cache and cookies.
Hello Raghav, First of all I would really appreciate for the video and this is awesome for the beginners to understand. Could you please help me out on how to integrate the Jmeter with the AWS codebuild
Hi Karthik, what exactly you are trying to do, Mostly for integration with any CI CD pipeline, you must have a command that can be executed from command line or a CI job and the setup on the agent machine
selenium (3.4.0) gecko driver not working in Jenkins.but it works on a local system using the command prompt.Please help me.Other drivers chrome driver...etc working
Hi Raghav, is there a way we can parameterize the environment s and run across different environment, can you please share some inputs. I am in need of this help. Today I have implemented my first j meter test in jenkins, your videos has helped a lot and have this query? Would be great if you can help on this.
Hello Raghav, Thanks for the video. I am using windows it actually prints the date but in the build is getting failed. here is the error. C:\ WINDOWS \system32 \config\ systemprofile \AppData\Local \Jenkins\ .jenkins\ workspace \JmeterJenkins >exit 1 Build step 'Execute Windows batch command' marked build as failure Finished: FAILURE I would be grateful for your help. Plus i also wanted to know, doing this way we are also setting up a automated test case which will test case automatically? As i also want to build automated test cases in a springboot application, I have to perform performance test and UAC test. Thanks
Hi Sir I watched all your videos very nice explanation.I I have a question-How to find response time when sending one request to target server & receive request and when i increase no of thread then load will increase then response time will increase? Please any one known then give reply.
Hi Pankaj, Thanks for watching. Response time per request is available in the results file. you can find them in csv. Not sure if you need something else than this.
Hi I am getting following error, when i click on Build now, Please help me. Installing JDK jdk-9-oth-JPR FATAL: command execution failed hudson.AbortException: Couldn't find the right download for WINDOWS and i386 combination
Hi, wiki.jenkins.io/display/JENKINS/Performance+Plugin in this location i'm not able to see plugin and could you please check if the process has chagned now?
Hi Raghav, I am not able to see performance report option in post build options on jenkins I have installed jenkins on windows & placed performance.hpi file in C:\Program Files (x86)\Jenkins\plugins & added "jmeter.save.saveservice.output_format=xml" in user.properties file in J-Meter what is the possible issue please help
Hi Raghav thanks for your revert yes i did installed the plugin but issue was different Mentioning it here since may be some one who has windows and installed jenkins through Windows based installer might face similar issue...Actually you mentioned that after plugin installation we need to restart jenkins and in mac it was supposed to be done through CLI...but in windows if you need to restart Jenkins then you need to restart its web service (Run ->services.msc search for Jenkings and stop start it)....post that my issue is resolved :)
@@RaghavPal Can you do it this weak becasue in my company the big new Project start and we are student in it. It will be very helfill that you give us start . Thanks for quick reply
Yes, it is possible to run Jenkins remotely instead of running it locally. There are several options available, including installing Jenkins on a remote machine, using a cloud-based Jenkins service, or using a Jenkins-as-a-Service provider * Jenkins Server on a Remote Machine: Install Jenkins on a remote machine or server, and access it through a web interface or command-line interface (CLI) from your local machine * Jenkins in the Cloud: Use a cloud-based Jenkins service, such as Jenkins on Amazon Web Services (AWS) or Microsoft Azure, which provides a remote Jenkins server that can be accessed over the internet * Jenkins as a Service: Use a Jenkins-as-a-Service provider, such as Jenkins.io or CloudBees, which offers a remote Jenkins server that can be accessed through a web interface or API -
Hi Raghav , I am facing Socketexception while triggering the load test on one of our post end point. Where as if I trigger load test on get endpoint there is no issue. How to resolve this ? The post method has a big json payload as input.
Thank You Raghav for such helpful video. I have one question here, If I have 5 slave servers which will create virtual user load for my test then how to add those slave servers in above Jenkins Build steps? Currently I am using below step for direct command line execution for JMeter : "jmeter -n -t biz_v1.jmx -GRampUp=1 -GtotalMachines=5 -GThreadCount=50 -R 10.1.X.X,10.2.X.X,10.3.X.X,10.4.X.X,10.5.X.X -l C:\output\biz_v1.jtl" . And also , do we need to do any extra settings for integrating those slave servers to Jenkins ? I am not sure how to add it into Jenkins and fetch report for it. Please share some thoughts here. Thank you in advance !
Hi Maheshwari, performance testing is to test how the application will perform under expected user load in live environment. However we never do performance testing on a live production env. So to do performance testing we create a test env with configuration same as prod env. Some other good practices 1. Always do performance testing on a separate env. Create a sep env which will not be used for other activities 2. Run your tests with the same infrastructure, network stats etc. To get consistent results and can be compared with the baseline 3. Always have a baseline to compare your test against. 4. JMeter checks the server performance and does not care for browser render time. So if you see your jmeter results are good but your application is still slow. Check for client-side performance testing tools 5. Focus on the areas that needs performance testing based on user scenario 6. Always document your results
Hi Raghav, I have seen you Git course. I want to run jmeter scripts via Jenkins Job like once in a week which will pick up the scripts from GitHub rather than my local system. What should I do to make the Jenkins job pick up the scripts from GitHub rather than my local? Can you or someone help me on this? Regards, Akshaj.
Hi Akshaj, you have to do following steps: 1. Create a github account 2. Add project in github and add your jmeter scripts there 3. In jenkins connect to this github 4. In the job under section Source Code Management Select Git and give your repository url 5. In the Build Trigger section you can select Build Periodically and give your interval 6. Run and Validate
Hi Raghav, I have created a repository in GitHub. Pushed my jmeter script to the newly created repository. Now, in Jenkins I have created a job and specified my Git URL as you specified in 4th point above. And have set the time interval as per my requirement as well. The thing is, where should I specify my jmeter command which is as below : jmeter -n -t C:\Users\Akshaj\Desktop\JavatPoint.jmx -l "C:\Users\Akshaj\Desktop\Results.jtl If this command is to be specified under "Add build step" in my Jenkins job, it will execute the script from my local (Windows machine) only. How will it execute the script present in GitHub Repository? Please let me know how to execute the script present in GitHub and also tell me where to specify the jmeter command. Regards, Akshaj.
So Akshaj, before running the jmeter command you need to pull the repo (git pull) in your folder and from there scripts will run. This can help you www.google.co.in/search?q=jenkins+pull+git+repository&oq=jenkins+pull+git&aqs=chrome.1.69i57j0l5.6511j0j1&sourceid=chrome&ie=UTF-8#kpvalbx=1
I have used the following command in my windows system > execute windows command in jenkins jmeter -Jjmeter.save.saveservice.output_format=xml -n -t "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\flight_webtours.jmx" -l "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\RESULTS.jtl" added the line in user.properites but after building the job, it is showing jemter is not recognized
Chandrima Let's break down the issue step by step: Step 1: Verify JMeter installation Check if JMeter is installed on your Windows system. Ensure that the JMeter bin directory is added to the system's PATH environment variable. Open a new Command Prompt or PowerShell and type jmeter -v to verify that JMeter is recognized Step 2: Check Jenkins configuration In your Jenkins job, go to the Configure page and check the Execute Windows command section. Verify that the command you provided is correct and the path to the JMeter executable is correct. Make sure that the Jenkins agent (slave) is running on the same machine where JMeter is installed Step 3: Check user.properties file Verify that you have added the following line to the user.properties file: jmeter.save.saveservice.output_format=xml Ensure that the user.properties file is in the correct location, which is usually in the JMeter bin directory (e.g., C:\Program Files\Apache\JMeter\bin\user.properties). Step 4: Check JMeter executable path In your Jenkins job, try specifying the full path to the JMeter executable in the command: "C:\Program Files\Apache\JMeter\bin\jmeter" -Jjmeter.save.saveservice.output_format=xml -n -t "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\flight_webtours.jmx" -l "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\RESULTS.jtl" Replace C:\Program Files\Apache\JMeter\bin\jmeter with the actual path to the JMeter executable on your system. Step 5: Check Jenkins agent configuration Ensure that the Jenkins agent (slave) is configured to run on the same machine where JMeter is installed. Check the Jenkins agent's environment variables to ensure that the PATH variable includes the JMeter bin directory Step 6: Troubleshoot further Check the Jenkins job's console output for any error messages related to JMeter. Try running the JMeter command manually on the machine where the Jenkins agent is running to see if it works. If you're still facing issues, try setting the JMETER_HOME environment variable in your Jenkins job to point to the JMeter installation directory. By following these steps, you should be able to identify and resolve the issue with JMeter not being recognized in your Jenkins job. -
Hello Raghav, Thanks for the detailed explanation. however, I wanted to know can we pass the values to JMeter script from Jenkins? Scenario - I have 20 servers which I need to execute the same script with just a change in the server name. Thanks in advance...
Hi Sunil, yes you can, So here you will need to put that value as property so that you can send the value from command line. Here is a sample video on how to set any value from command line ua-cam.com/video/0tQXN_knLuA/v-deo.html&index=7&list=PLhW3qG5bs-L-oMT1Cnrurt7gEaLrRub2V Now once you have done this, from jenkins you can parameterize this value and can use different values as per your need. You can also create a drop down with your options. Here is a video on that ua-cam.com/video/hgqBGNPlLlU/v-deo.html ua-cam.com/video/ylWHMnbBzC0/v-deo.html
In case of Windows in the Jenkins build section you will select the option - "Execute Windows batch command" and the command will be same only difference will be, instead of "sh jmeter.sh" you will use "jmeter". Your command will be like. cd "location of your jmeter bin folder" jmeter -Jjmeter.save.saveservice.output_format=xml -n -t “location of test file” -l “location of result file” You can watch this for command line execution of jmeter - ua-cam.com/video/K26q5VgwLKk/v-deo.html
Hello Sir !! The below command is not working jmeter -Jjmeter.save.saveservice.output_format=xml -n -t C:\Users\Debajyoti\Desktop\SampleJM\JmeterJenkinsIntegrationTest.jmx -l C:\Users\Debajyoti\Desktop\TestResult.jtl What I'm doing wrong.
@@RaghavPal Hi Raghav. I need to run Multiple API end point URL for performance using Jenkins. Can you please suggest a solution for that? Thanks in Advance.
I noticed from my Jenkins configure Post-build Actions I select publish performance test report but I couldn't find Add new report and select JMeter. Thus, I don't know how to setup performance report. Please advise further. Thanks
I am on wiindows and My command is: jmeter.save.saveservice.output_format=csv -n -t C:\users\itszakaria_bd\desktop\JmeterJenkinsIntegrationTest.jmx -l C:\apache-jmeter-3.1\bin\examples\JenkinsJmeterIntegration.csv And the ERROR is: 'jmeter.save.saveservice.output_format' is not recognized as an internal or external command, operable program or batch file. Any help please. Thanks in advance.
On windows the command should start with jmeter and you have to give argument -J before the property statement. So it should be like: jmeter -Jjmeter.save.saveservice.output_format=csv -n -t C:\users\itszakaria_bd\desktop\JmeterJenkinsIntegrationTest.jmx -l C:\apache-jmeter-3.1\bin\examples\JenkinsJmeterIntegration.csv You can watch the video and verify it. Also in the video i am using format as xml not csv. Let me know if it works.
Hi Raghav, Thanks a ton for your videos....It helped me several times. Could you please help me on the below situation. I have separate workspace on windows like C:/Ramesh/*.csv files. When I run the test I would need those .csv files only specific to be attached and send through outlook to recipients. Please help me. Workaround so far which is working but attaching all the files which is under workspace -> **/*.csv.
Hi, your video really helped me so big thank you. I have a question, the file .jtl for each build on Jenkins its overwrite? I hope you can reply me! 😊😊
Automation Step-by-Step - Raghav Pal Exist a way to create a file for each build? I tried on Jenkins created the file without compile before on Jmeter through the command line but produce a error.
Automation Step-by-Step - Raghav Pal I fixed! My issue was that the graphics don't show me the last build of Jenkins but show the results when I run the test with Jmeter in the machine. So I have to delete the file .jtl in each build and create again, now works fine. Sorry for my english, I hope you can understande me.
Hi Raghav, I have some problems with Build the JmeterJenkinsTestJob because of the Post-build Actions -> Publish Performance test result report (Well I don't have the same IHM) I cant choose a Performance report ( Jmeter )
Automation Step by Step - Raghav Pal hello Raghav actually I didn’t have the same menu but after searching and talking to my supervisor Who lead my to search on the jtl file I found that I wasn’t deleting it before the build because I had some errors due to the server wich was down. Thank you very much I appreciate your work and I have learned a lot from this serie thanks.
Hi Raghav, I have selected execute windows batch run option. I have given date like you. But it is showing build faliure in console output. Thanks & Regards Dipti
Hi Raghav, Can you plz let me know why Jmeter Webdriver sampler it is not working in Jenkins. When I try to execute the WebDriverSampler In Jmeter(headless mode) through Jenkins, it says that Chrome driver started successfully and exits the script immediately. "org.openqa.selenium.remote.ProtocolHandshake CreateSession" doesn't executes in Jenkins(using the Build in -Windows command prompt). The script works fine in local system command prompt. Plz let me know what else can I configure in Jenkins to make it work?
Hi Saurabh, most probably your ChromeDriver binary details are not getting detected. Pls check this - stackoverflow.com/questions/49518157/org-openqa-selenium-sessionnotcreatedexception-session-not-created-exception-fr
Hi raghav bro...I have one doubt.can we use jmeter if login generating tokens using cognito(cloud service)...??? if jmeter can not then please suggest any tool that test such kind of login pages..bcz if jmeter strucks at login page there is no point of testing remaining pages...thanks in advance plz
hi raghav , Getting Below Error . Please Guide me on the same . I have checked that the jar file mentioned in error is getting executed from the bin folder but jenkins gives this error as below . C:\Program Files (x86)\Jenkins\workspace\JmeterJenkinsTestJob>C:\Users\Harmeet.Saini.BANKAIGROUP\Desktop\apache-jmeter-3.3\bin\jmeter.bat Error: Unable to access jarfile ApacheJMeter.jar errorlevel=1 Press any key to continue . . . Build step 'Execute Windows batch command' marked build as failure Finished: FAILURE
Thanks Raghav...I have the same kind of setup on my one of aws server but jmeter was hanging on "waiting for possible shutdown/..,/.../ on port:445". can u plz help to resolve this?
hi Naga, Can you check the http timeouts set. This is a normal message that Jmeter gives and should anyways execute your test. Here is where you must be getting this: StandardJMeterEngine private void waitForSignals() { 223 byte[] buf = new byte[80]; 224 DatagramSocket socket = null; 225 System.out.println("Waiting for possible shutdown message on port "+UDP_PORT); 226 try { 227 socket = new DatagramSocket(UDP_PORT); 228 DatagramPacket request = new DatagramPacket(buf, buf.length); 229 while(true) { 230 socket.receive(request); 231 InetAddress address = request.getAddress(); 232 // Only accept commands from the local host 233 if (address.isLoopbackAddress()){ 234 String command = new String(request.getData(), request.getOffset(), request.getLength(),"ASCII"); 235 System.out.println("Command: "+command+" received from "+address); 236 log.info("Command: "+command+" received from "+address); 237 if (command.equals("StopTestNow")){ 238 stopTest(); 239 } else if (command.equals("Shutdown")) { 240 askThreadsToStop(); 241 } else { 242 } 243 } 244 } 245 } catch (Exception e) { 246 e.printStackTrace(); 247 } finally { 248 if (socket != null) { 249 socket.close(); 250 } 251 } 252 253 }
thanks for your quick response... basically iam not from qa/perf testing team...it will be great if you could upload any .jmx file for any webpage ie www.google.com ...etc..thanks in advance
Performance testing when done by testers , they have to use jenkins ? Isnt jenkins usually used by developers while running performace tcs of unit tcs ? Please clear my doubt.
Hi Yashu, Jenkins is much more than that. If you go to its website it says, "The leading open source automation server, Jenkins provides hundreds of plugins to support building, deploying and automating any project." So it has great use in CI and Automation.
Hi Avinash Yes, you can test web sockets using JMeter. Here are the steps to test web sockets using JMeter: Add the WebSocket Samplers by downloading the WebSocket plugin for JMeter. Once you have installed the WebSocket Samplers, add a Thread Group to your test plan. Add a WebSocket Open Connection sampler under the Thread Group. Specify the server name and port in the WebSocket Open Connection sampler. Add a WebSocket Message Sampler and specify the message that you want to send to the server. Add a WebSocket Close sampler to close the connection. I will plan for a video on this
Hi, you can create a custom workspace. On Jenkins Job, goto general section, can click on Advanced button at the end of General section and check - use custom workspace
How do you install jmeter into jenkins if you're in a company that doesn't give you access to the server jenkins is on but you have access to the plugins on jenkins website...
Hi Raghav, would you know why my build is always successful even though the total error % is beyond the threshold? I noticed in the console output that it stopped in the "Performance: Parsing JMeter report file 'C/TestResult.jtl'" line. Then proceeded to "Finished: Success". the two lines in between as shown in your video were not shown. Please help thanks!
Hi Jasper, as it could not parse your result file, it did not calculate threshold. Can you check the result file, is there anything missing there. You can try providing a new result filename (not already existing) and try again.
Thanks raghav! It worked now by enabling these settings in the jmeter.properties file: jmeter.save.saveservice.output_format=xml jmeter.save.saveservice.data_type=true jmeter.save.saveservice.label=true jmeter.save.saveservice.response_code=true jmeter.save.saveservice.successful=true jmeter.save.saveservice.thread_name=true :)
Hi , We need an assistance from your side. We are planning to test the application such as "Chat box". How to conduct the Load testing for that application. Planned to Web socket testing.Here we need to increase N of signal R request to server, and how to increase the number of web socket connections. Thanks,
Automation Step by Step - Raghav Pal Hi Raghav, I knew the asking question is wrong,but asking for conformation. The above raised question which is not achieved by Badboy software right. By applying the URL and clicking all the functionalities and export to jmeter then running the .Jmx on j meter and raising the number of threads. Is this right way.
@@RaghavPal Sure ,Gone through your video & followed up the same steps ,In execute windows batch commands in config menu ,I have given the input commands & publish performance test results But it showed the build Got failure .Error Log :- below C:\Users\bbiswal\.jenkins\workspace\JmeterJenkinsTestJob>C:\Users\bbiswal\Documents\JMeter\bin\jmeter.bat-Jjmeter.save.saveservice.output_format=xml -n -t 'C:\Users\bbiswal\Documents\JMeter\bin\jmeter.bat-Jjmeter.save.saveservice.output_format' is not recognized as an internal or external command, operable program or batch file. C:\Users\bbiswal\.jenkins\workspace\JmeterJenkinsTestJob>C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jmx -l C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jtl Error: Unable to access jarfile ApacheJMeter.jar errorlevel=1 Press any key to continue . . . Build step 'Execute Windows batch command' marked build as failure Cannot detect file type because of error: Failed to copy C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jtl to C:\Users\bbiswal\.jenkins\jobs\JmeterJenkinsTestJob\builds\16\temp\HTTP Header Manager.jtl Finished: FAILURE
@@RaghavPal cd C:\Program Files\apache-jmeter3.2\bin\ jmeter.bat -Jmeter.save.saveservice.output _format=xml -n -t C:\Users\username\Desktop\JMeter\JMeter_Jenkins_Integration.jmx -l C:\Users\username\Desktop\JMeter\TestResultJenkins.jtl and it didn't work
Sai, i believe the requirement you have is to pull the script with GIT and run the test. You can watch Git and GitHub playlist on my channel to get some help on this.
Hi Raghav,I tried the below command in execute script as per the video...cd /JMeter/apache-jmeter-3.1/bin sh jmeter.sh -Jjmeter.save.saveservice.output_format=xml -n -t C:/Users/Myname/Desktop/JmeterJenkinsIntegrationTest.jmx -l C:/Users/Myname/Desktop/TestResult1.jtl My question was can I replace the Jmeter script and Testresult locations with the CVS locations.I already checked them into CVS...I tried pointing the CVS location but the build failed....Can you help regarding this???
While trying to download the Jenkins performance plugin it is mentioned as below . Does it mean that we can't no longer integrate with Jenkin and J Meter? This plugin is up for adoption! We are looking for new maintainers. Visit our Adopt a Plugin initiative for more information.
Hi Raghav Sir, Firstly, I would like to say thanks for sharing this video, at last stage i m stuck it while giving path in jenkin and run it it shows failure but all reports are shown .Please help it
Hi Bharat, just check in Jenkins, performance plugin fields where there is error threshold and warning threshold. What values have you given. Can also check the logs.
I love your videos and they have been very helpful, but I have some constructive criticism for this video. First, what did you test in this video? Perhaps I am missing the point, because you did not assert anything. What would cause this "TEST" to fail? If I had an assert in JMeter would it fail this Jenkins build. I am not exactly sure what you are testing here. If there is another video that explains that please point me to it.
I appreciate it, one thing as a developer I have to remember is BMI, Be More Inquisitive... I just had to push harder and google it and stack overflow it. You are almost making my Pluralsight subscription obsolete, you should get paid for these videos.
Hi raughav , I am also facing another issue , please help me out in this also while running java -jar jenkins.war , it is taking default 8080 port and when we enter it shows me "Failed to start jetty" . Please help me how can i solve this .I research on it then i got a solution to change port while running this command in cmd but here the question is that if we run above command in any other port like 8081 it not showing any error but do we need to run localhost on 8081 also and if so then it ask for administrator password and we already used it non 8080 port java - jar jenkins.war Unrecognized option: - Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. C:\Jenkins>java -jar jenkins.war Running from: C:\Jenkins\jenkins.war webroot: $user.home/.jenkins Aug 07, 2018 5:30:21 PM org.eclipse.jetty.util.log.Log initialized INFO: Logging initialized @776ms to org.eclipse.jetty.util.log.JavaUtilLog Aug 07, 2018 5:30:21 PM winstone.Logger logInternal INFO: Beginning extraction from war file Aug 07, 2018 5:30:21 PM org.eclipse.jetty.server.handler.ContextHandler setContextPath WARNING: Empty contextPath Aug 07, 2018 5:30:21 PM org.eclipse.jetty.server.Server doStart INFO: jetty-9.4.z-SNAPSHOT; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_181-b13 Aug 07, 2018 5:30:22 PM org.eclipse.jetty.webapp.StandardDescriptorProcessor visitServlet INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart INFO: DefaultSessionIdManager workerName=node0 Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart INFO: No SessionScavenger set, using defaults Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.HouseKeeper startScavenging INFO: node0 Scavenging every 600000ms Jenkins home directory: C:\Users\abc\.jenkins found at: $user.home/.jenkins Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.handler.ContextHandler doStart INFO: Started w.@66ea810{Jenkins v2.136,/,file:///C:/Users/abc/.jenkins/war/,AVAILABLE}{C:\Users\abc\.jenkins\war} Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.AbstractConnector doStop INFO: Stopped ServerConnector@1b66c0fb{HTTP/1.1,[http/1.1]}{0.0.0.0:8080} Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.session.HouseKeeper stopScavenging INFO: node0 Stopped scavenging Aug 07, 2018 5:30:25 PM hudson.WebAppMain contextDestroyed INFO: Shutting down a Jenkins instance that was still starting up java.lang.Throwable: reason at hudson.WebAppMain.contextDestroyed(WebAppMain.java:388) at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:961) at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:571) at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:938) at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:381) at org.eclipse.jetty.webapp.WebAppContext.stopWebapp(WebAppContext.java:1503) at org.eclipse.jetty.webapp.WebAppContext.stopContext(WebAppContext.java:1467) at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:990) at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:297) at org.eclipse.jetty.webapp.WebAppContext.doStop(WebAppContext.java:569) at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89) at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:149) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:170) at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124) at org.eclipse.jetty.server.Server.doStop(Server.java:490) at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89) at winstone.Launcher.shutdown(Launcher.java:316) at winstone.Launcher.(Launcher.java:176) at winstone.Launcher.main(Launcher.java:363) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at Main._main(Main.java:344) at Main.main(Main.java:160) Exception in thread "Jenkins initialization thread" Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.handler.ContextHandler doStop INFO: Stopped w.@66ea810{Jenkins v2.136,/,null,UNAVAILABLE}{C:\Users\abc\.jenkins\war} java.lang.NoClassDefFoundError: hudson/util/HudsonFailedToLoad at hudson.WebAppMain$3.run(WebAppMain.java:247) Caused by: java.lang.ClassNotFoundException: hudson.util.HudsonFailedToLoad at java.net.URLClassLoader.findClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at java.lang.ClassLoader.loadClass(Unknown Source) at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565) at java.lang.ClassLoader.loadClass(Unknown Source) ... 1 more Aug 07, 2018 5:30:25 PM winstone.Logger logInternal INFO: Jetty shutdown successfully java.io.IOException: Failed to start Jetty at winstone.Launcher.(Launcher.java:165) at winstone.Launcher.main(Launcher.java:363) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at Main._main(Main.java:344) at Main.main(Main.java:160) Caused by: java.net.BindException: Address already in use: bind at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Unknown Source) at sun.nio.ch.Net.bind(Unknown Source) at sun.nio.ch.ServerSocketChannelImpl.bind(Unknown Source) at sun.nio.ch.ServerSocketAdaptor.bind(Unknown Source) at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:331) at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:299) at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80) at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.server.Server.doStart(Server.java:398) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at winstone.Launcher.(Launcher.java:163) ... 7 more Aug 07, 2018 5:30:25 PM winstone.Logger logInternal SEVERE: Container startup failed java.io.IOException: Failed to start Jetty at winstone.Launcher.(Launcher.java:165) at winstone.Launcher.main(Launcher.java:363) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at Main._main(Main.java:344) at Main.main(Main.java:160) Caused by: java.net.BindException: Address already in use: bind at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Unknown Source) at sun.nio.ch.Net.bind(Unknown Source) at sun.nio.ch.ServerSocketChannelImpl.bind(Unknown Source) at sun.nio.ch.ServerSocketAdaptor.bind(Unknown Source) at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:331) at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:299) at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80) at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at org.eclipse.jetty.server.Server.doStart(Server.java:398) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) at winstone.Launcher.(Launcher.java:163) ... 7 more
hi Vinay. In Jenkins for Performance Reports we have 2 modes: 1. Relative Threshold 2. Error Threshold Relative Threshold - is used to mark the build unstable or failed based on the error % difference as compared to the previous build (or some specific build number). Error Threshold - is used to mark the build unstable or failed based on the % of failed samples within the same build/test. To make things more clear, In Jenkins Post Build Actions -> Publish Performance test result report, you will find 2 sections: 1. Use Error thresholds on single build: This is used if you select Error Threshold and it has % value to set for marking build unstable or failed. 2. Use Relative thresholds for build comparison: This comes into picture if you have selected Relative Threshold. Here again you can set % for marking build fail or unstable. It also has further options like if you want to compare to a previous build or some specific build (give build number) Hope this is clear :)
I will plan to add a lecture on this Octa session login can be a tricky aspect of automating with JMeter, especially due to its reliance on cookies and potential multi-factor authentication (MFA) challenges. However, with the right approach and tools, you can successfully capture and handle the login process in your JMeter scripts. Here's a breakdown of Octa session login in JMeter: 1. Understanding the Login Flow: Initial Request: Begin by identifying the initial request for accessing the Octa login page. Capture this request in JMeter using an HTTP Sampler. Authentication Process: Analyze the login form elements and any additional steps involved in authentication, like MFA. Cookie Capture: Pay close attention to the cookies returned after successful login, as these will be crucial for maintaining the session in subsequent requests. 2. Handling Challenges: Cookies and Session Management: Use a Cookie Manager element in JMeter to store and manage the session cookies obtained after login. Ensure these cookies are automatically added to subsequent requests to maintain the authenticated session. MFA Handling: The approach for MFA depends on the specific method used by Octa. One-Time Passwords (OTP): If relying on OTPs via email or SMS, consider external tools like plugins or integrating with dedicated services to extract and use the received OTP within your JMeter script. Hardware Tokens: Capturing responses from hardware tokens might require specific plugins or custom scripting depending on the token type and interaction method. 3. Tools and Techniques: HTTP Header Manager: Use this element to set any required headers for the login request, such as User-Agent or Content-Type. BeanShell Post Processor: This can be helpful for dynamic processing of extracted values, like parsing the response for an OTP or manipulating cookie values. Regular Expressions: Utilize regex patterns to extract necessary information from responses, such as session IDs or token values. Plugins: Explore available plugins for JMeter that specifically address Octa login or MFA handling, which can simplify your script development. 4. Testing and Debugging: Run your script in Debug mode: This allows you to step through each request and response, checking for errors and verifying cookie values at each stage. Correlate values: If elements or values change dynamically, use correlation options in JMeter to ensure your script adapts to these changes during test execution. Consult Resources: Utilize official documentation from Octa and JMeter, along with online tutorials and community forums, for specific guidance and troubleshooting tips. Remember, capturing and handling Octa session login in JMeter can be nuanced, but with careful analysis, appropriate tools, and meticulous testing, you can successfully automate your login process and ensure reliable test execution.
I have a query that I can see the expected url on request tab in view result tree but the response body is blank , meanwhile i need to see some html format there(Expected) but it is not coming @@RaghavPal and i don't know why it is blank??
I Have Jmeter tests on my windows cloud machine (tests, JMeter installation on my cloud system).But Jenkins install in another cloud machine how to integrate my JMeter tests in cloud machine Jenkins
Hi Rgahav, This video was vey helpful, thanks . Could you please show a demo of how to run jmeter in jenkins Pipeline ? It would be very helpful. Looking forward for ur reply :)
Hi sir,Actually i want to load test of an application ,if send virtual users(threads) to an application server beyond the maximum limitation of load of the server then application should go to hang or application should crass and send one virtual user less than maximum limitation load of an application it is work normal ,how can do this in jmeter and how to know what is the maximum limitation of an application server? please guide me sir because this answer is not available in any video. Thanks & Regards Pankaj kumar
Hi Pankaj, the max load of your server is something your internal teams (network teams) can tell you. Basically we go with the requirement of real world and keep a load a little over that to check our servers can handle it. So a good load test will be a combination of 2-3 tests, one with general load and other with max load you can expect and then you can do the comparison and analysis.
Hi raghav, Test run successfully in jenkins but got the failure status at the end of run Build step 'Publish Performance test result report' changed build result to FAILURE Finished: FAILURE
-Jjmeter.save.saveservice.output_format' is not recognized as an internal or external command, operable program or batch file. Anyone have this issue on windows?
Hi Raghav,, when i installed jenkins i got a password from which i was logged in. Now when i am trying to login with that password it is not allowing me to login. Please suggest. Regards Dipti
Good tutorial. but there is a problem in this method for results data trending. The results of all the build gets appended to the result file. As a result, latest build will have results accumulated from previous builds which is incorrect. If we try to give unique results file for each build number by appending the build number to the results file, then we will not get the trend results.
@@RaghavPal Hi raghav, I checked it, this accumulates results in to single jtl file. The number of samples shown in trend table for the same test scenario during each build increases like 2x for second run, 3x third run. This will be clearly seen in the trend table not in the graph. If we open the second build and see the results table for samples and throughput it will be 100% increased from first build.
Hi Raghav. Thanks for informative tutorial. I'm running from windows7 ..I stuck at build part and each time executed failed (windows batch command). This is my script cd "C:\apache-jmeter-4.0\bin>jmeter -Jjmeter.save.saveservice.output_format=xm l" -n -t "C:\apache-jmeter-4.0\bin\View Results in Table_jenkins.jmx" -l "C:\apach e-jmeter-4.0\testresultjenkins.jtl".....I've done with and without quote (") but still fail from jenkins. Please advise further. Thanks
I'm able to run it 'SUCCESS' but got message related to JMETER_HOME. This is the script that i used ***Execute Windows batch command*** C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm l -n -t "C:\apache-jmeter-4.0\bin\View Results in Table_jenkins.jmx" -l C:\apach e-jmeter-4.0\testresultjenkins.jtl This is result from console D:\Jenkins\jenkinshome\workspace\JmeterJenkins>C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm The JMETER_HOME environment variable is not defined correctly This environment variable is needed to run this program Finished: SUCCESS I've added JMETER_HOME PATH to my windows env..but still the same...maybe need to reboot.
After reboot still the same D:\Jenkins\jenkinshome\workspace\JmeterJenkins>C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm The JMETER_HOME environment variable is not defined correctly This environment variable is needed to run this program Performance: Recording JMeter reports 'D:\Jenkins\jenkinshome\jobs\JmeterJenkins\builds\50\temp\testresultjenkins.jtl' Performance: Parsing JMeter report file 'D:\Jenkins\jenkinshome\jobs\JmeterJenkins\builds\50\performance-reports\JMeter\testresultjenkins.jtl'. Performance: No threshold configured for making the test unstable Performance: No threshold configured for making the test failure Performance: File testresultjenkins.jtl reported 0.0% of errors [SUCCESS]. Build status is: SUCCESS Finished: SUCCESS
I've checked online but none related and could resolve JMETER_HOME error above. Anyway those have been set earlier but still the same. Do you suspect any that could lead to this error...
Hi Raghav. Thanks for the videos. Very helpful.
Hi Srinivasa, i am glad it helped.
Thanks Raghav, it is very useful
Awesome video . Very very helpful. Thanks a lot Raghav Pal
You're welcome Harsimranjit
Raghav Pal
I am working on MAC OS and not able to locate Jenkins.war file.
I am not able to execute java -jar jenkins.war
You can search for it. Or get a new one.
Raghav Pal
Thanks for the Reply.
Got it fixed
Hi Raghav, Thank you so much for making the latest Beginner videos which is of 2022, is there any plan of uploading the same for Intermediate and Advanced courses too sooner please?
Your videos have given confidence and the strength to jump right into performance testing without having any prior knowledge.
Ashish
Thanks for the kind words
The videos created earlier are still valid, I have also created Masterclasses with recent versions, I will keep adding more, Can find all here - automationstepbystep.com/
Thank you Raghav very much for clearing my query and guiding me in the right path.
Hi Raghav. Thank you so much for this wonderful tutorials. Very helpful and explanation is damn good. Thanks
Thanks for watching Prashant.
Hi Raghav , How can we do this load runner/ pc & analysis ? Can you please make video on this.
I will plan Jyotiranjan
Hello Ragha. Thank you for video .please share video for how to run jmeter script in remote jenkins via git
You can find that part in this video
ua-cam.com/video/SoW2pBak1_Q/v-deo.html
Can also check more here - automationstepbystep.com/
Hi raghav loved your video.
i have few queries in real we use multiple machines to generate load do we have to install Jenkins on each machines. If yes how can we see the integrated results.
Hi Rajat, we can use multiple remote machines or cloud servers
Hello Raghav, this is 2020. What is the correct site to download Jenkins+Jmeter integration(Jenkins performance plugin)? Thanks for all your beautiful videos.
Hi, I will check if there are any changes will update the videos
Hello Raghav, how to get individual JMeter test’s metrics on the Jenkins Performance plug-in, currently I am getting only Summary of run one line
Thankyou in advance
Hi Stelus, can search for more plugins If I get to know will update in the description
Hello Raghav thanks for all amazing videos, have a quick question on assertion details
Is there a way to see sampler details (req header, url, resp header and data) in jenkins ?
Hi, i have not checked practically, However in the post build action, in jmeter reports, you can add multiple reports. So if you can get some report having this data, should be able to show on Jenkins
Hi Please do a video on jenkins code coverge report "Jacaco" also in above video what is the use of that line you added in bin/user.properties or at the -J option in the jmeter run command as under "Publish Performance test result report
" plugin
Under "Report files" you gave jtl format instead of that xml file path.
Great Video, has helped a lot. I have a question:
On the post-build actions - Publish Performance test results report I don't see the same you see. I notice that you use the 1.4 plugin version in this video and I downloaded the version 3.2 (latest).
I have more a Standard Mode and Expert Mode Section. No performance report option.
Thanks for your help
This is strange, you can try getting diff ver and check.
Hi Raghav, is this Performance plugin also useful/required for rest API tests using Jmeter?
Hi Rizvan, yes, and I believe I have included that in some video.
Hello Raghav,
Hope you are doing well. I need some information, just guide me little bit and provide some links or videos if possibsle.
I want to run my testing file from IntelliJ using these tool Jmeter and Taurus.
How can I do this ?
Second is it good if I use Blazemeter because the website links change with time.
What can I do for this?
Just tell me the way how can I start this and which steps i should follow.
Should i write my own script like Cucumber?
I just give example
First step create a Jmx file using Blazemeter
2nd step write a taurus code
3rd run from intellij etc etc
if I want do any change should in my test case then I run my blazemeter again from start ?
Hi Umer, you will find JMeter plugins for intelliJ. Pls check
Hi@Raghav, thanks a lot for making a nice video on performance tests running in jenkins. Can you please make a video on running j meter tests using Git repo, that would be great. Or can you please suggest how to run the same tests in bamboo.
How would we capture the min, max and average times etc or more parms on the performance dashboard. Your response is much appreciated. Thanks
Hi, I will plan on this, thanks for watching
@@RaghavPal Thanks Raghav, I am really looking forward to it. Pls tag me once you post video on this. I also get notifications.
Hi Raghav, I had gone through both intermediate and beginner Jmeter tutorials and are very helpful to start with performance testing.Just wanted to know if there is any plan of making the advanced Jmeter tutorial videos...
HI Bharat, you can find all JMeter playlists here - ua-cam.com/channels/Tt7pyY-o0eltq14glaG5dg.htmlplaylists?sort=dd&view=50&shelf_id=4
Thanks Raghav
Hi Raghav,
I am getting the following error when trying to build in jenkins....Can u help me figure out whats causing this issue?
"Error in NonGUIDriver java.lang.NullPointerException"
Hi Raghav, could you please give more about Logic controller, Pre-Processor, Post processor and config element ?
sure, will have more sessions on them.
Hi Ragav,
Thanks for a great video. This is very informative when we have Jenkins in our local. What is the process to input JMX file to a Jenkin which is present on a different server and not the same server where Jmeter is present. Hope my question is Clear. Please let me know if it's not.
Awaiting for your reply. Thanks in advance.
Hi Bhavna, You can set slave nodes and run it from master
Hi @Raghav I was following this video and found that the plugin has been deprecated. What can we use in its place?
I will check on this, Can try some online help too
Hi raghav i am not able to find the post build actions (Publish Performance test Result report)in jenkins on my windows machine
Bhanu
The Publish Performance Test Result Report post-build action is available in the Jenkins Performance Plugin. To install the Performance Plugin, follow these steps:
1. Go to *Manage Jenkins* > *Manage Plugins*.
2. In the *Available* tab, search for "Performance Plugin" and click *Install*.
3. Click *Install*.
4. Once the plugin is installed, click *Restart* to restart Jenkins.
Once the Performance Plugin is installed, you will be able to see the Publish Performance Test Result Report post-build action in the *Post-build Actions* section of your job configuration.
To configure the Publish Performance Test Result Report post-build action, you need to specify the path to the performance report files. You can use the `${WORKSPACE}` variable to reference the workspace directory.
Here is an example of how to configure the Publish Performance Test Result Report post-build action:
```
Publish Performance Test Result Report
Source data files: ${WORKSPACE}/*.jtl
```
Once you have configured the post-build action, click *Save* to save your changes.
To run your job, click the *Build Now* button. Once the job has finished running, you will be able to view the performance test report in the *Build History* section of your job.
If you are still having trouble finding the Publish Performance Test Result Report post-build action, you can try the following:
* Make sure that the Performance Plugin is installed and enabled.
* Make sure that you are using the latest version of Jenkins.
* Try restarting Jenkins.
* Clear your browser cache and cookies.
Hello Raghav, First of all I would really appreciate for the video and this is awesome for the beginners to understand.
Could you please help me out on how to integrate the Jmeter with the AWS codebuild
Hi Karthik, what exactly you are trying to do, Mostly for integration with any CI CD pipeline, you must have a command that can be executed from command line or a CI job and the setup on the agent machine
Hi Raghav, Wonderful videos and very informative too. Kindly make such videos on Load runner and Analysis too. It would be very helpful
sure Ranjitha, will do it.
selenium (3.4.0) gecko driver not working in Jenkins.but it works on a local system using the command prompt.Please help me.Other drivers chrome driver...etc working
Hi Raghav, is there a way we can parameterize the environment s and run across different environment, can you please share some inputs. I am in need of this help. Today I have implemented my first j meter test in jenkins, your videos has helped a lot and have this query? Would be great if you can help on this.
Hi Sharma, you can see parameterized jobs videos here - ua-cam.com/play/PLhW3qG5bs-L8T-0JT464rkIvnUz5q4CQC.html
Hello Raghav, Thanks for the video.
I am using windows it actually prints the date but in the build is getting failed. here is the error.
C:\ WINDOWS \system32 \config\ systemprofile \AppData\Local \Jenkins\ .jenkins\ workspace \JmeterJenkins >exit 1
Build step 'Execute Windows batch command' marked build as failure
Finished: FAILURE
I would be grateful for your help. Plus i also wanted to know, doing this way we are also setting up a automated test case which will test case automatically? As i also want to build automated test cases in a springboot application, I have to perform performance test and UAC test. Thanks
Hi Sunesh, Use this if date command is throwing issue:
echo 27-03-2018 | date
OR
use "date \T."
Hi Sir I watched all your videos very nice explanation.I
I have a question-How to find response time when sending one request to target server & receive request and when i increase no of thread then load will increase then response time will increase?
Please any one known then give reply.
Hi Pankaj, Thanks for watching.
Response time per request is available in the results file. you can find them in csv. Not sure if you need something else than this.
Hi I am getting following error, when i click on Build now, Please help me.
Installing JDK jdk-9-oth-JPR
FATAL: command execution failed
hudson.AbortException: Couldn't find the right download for WINDOWS and i386 combination
Hi Tushar, Try this - Manage Jenkins » Global Tool Configuration
Remove the auto-installer for the JDK that downloads it from the Oracle site.
Hi,
wiki.jenkins.io/display/JENKINS/Performance+Plugin in this location i'm not able to see plugin and could you please check if the process has chagned now?
Hi Vivek, you can get it through plugins manager - ua-cam.com/video/KQfoBOK37ms/v-deo.html
Hi Raghav,
I am not able to see performance report option in post build options on jenkins I have installed jenkins on windows & placed performance.hpi file in C:\Program Files (x86)\Jenkins\plugins & added "jmeter.save.saveservice.output_format=xml" in user.properties file in J-Meter what is the possible issue please help
Hi, Mayank did you add the plugin (hpi) file in jenkins. Maybe you can try getting the plugin directly from Jenkins > Plugin Manager and try again.
Hi Raghav thanks for your revert yes i did installed the plugin but issue was different
Mentioning it here since may be some one who has windows and installed jenkins through Windows based installer might face similar issue...Actually you mentioned that after plugin installation we need to restart jenkins and in mac it was supposed to be done through CLI...but in windows if you need to restart Jenkins then you need to restart its web service (Run ->services.msc search for Jenkings and stop start it)....post that my issue is resolved :)
Can you make some vidoes about Taurus with Jmeter
I will do
@@RaghavPal Can you do it this weak becasue in my company the big new Project start and we are student in it. It will be very helfill that you give us start . Thanks for quick reply
Hi, right now I have several engagements. For now you will need to get some online help.
Hello Can we run through remote jenkins instead local jenkin? please share the video
Yes, it is possible to run Jenkins remotely instead of running it locally. There are several options available, including installing Jenkins on a remote machine, using a cloud-based Jenkins service, or using a Jenkins-as-a-Service provider
* Jenkins Server on a Remote Machine: Install Jenkins on a remote machine or server, and access it through a web interface or command-line interface (CLI) from your local machine
* Jenkins in the Cloud: Use a cloud-based Jenkins service, such as Jenkins on Amazon Web Services (AWS) or Microsoft Azure, which provides a remote Jenkins server that can be accessed over the internet
* Jenkins as a Service: Use a Jenkins-as-a-Service provider, such as Jenkins.io or CloudBees, which offers a remote Jenkins server that can be accessed through a web interface or API
-
Hi, I cant download the Performance plugin as it has vulnerabilities , is there any other solution ?can you please help
Hi Mayuri,
As of now I am not aware of any alternative for this, Will need to check online
Hi Raghav
, I am facing Socketexception while triggering the load test on one of our post end point. Where as if I trigger load test on get endpoint there is no issue.
How to resolve this ?
The post method has a big json payload as input.
Hi Lakshmi,
What exactly is the error, what does the logs say? Does it work fine with a single user load. Pls check
Ragav How do I run Jmeter from GITlab any suggestions would help
Hi Sridhar, I have not tried, can check some online examples
Thank You Raghav for such helpful video.
I have one question here, If I have 5 slave servers which will create virtual user load for my test then how to add those slave servers in above Jenkins Build steps? Currently I am using below step for direct command line execution for JMeter : "jmeter -n -t biz_v1.jmx -GRampUp=1 -GtotalMachines=5 -GThreadCount=50 -R 10.1.X.X,10.2.X.X,10.3.X.X,10.4.X.X,10.5.X.X -l C:\output\biz_v1.jtl" . And also , do we need to do any extra settings for integrating those slave servers to Jenkins ? I am not sure how to add it into Jenkins and fetch report for it. Please share some thoughts here. Thank you in advance !
Hi Pankaj, you will need to tell the slaves location by R flag in command line. Check this video ua-cam.com/video/Ok8Cqc0wipk/v-deo.html
@@RaghavPal Thank you so much for your prompt response. It worked for me !
when to do performance testing ?
I mean after deploying my microservice to server or running microservice locally and then do performance testing ?
Hi Maheshwari, performance testing is to test how the application will perform under expected user load in live environment. However we never do performance testing on a live production env. So to do performance testing we create a test env with configuration same as prod env.
Some other good practices
1. Always do performance testing on a separate env. Create a sep env which will not be used for other activities
2. Run your tests with the same infrastructure, network stats etc. To get consistent results and can be compared with the baseline
3. Always have a baseline to compare your test against.
4. JMeter checks the server performance and does not care for browser render time. So if you see your jmeter results are good but your application is still slow. Check for client-side performance testing tools
5. Focus on the areas that needs performance testing based on user scenario
6. Always document your results
@@RaghavPal thank you and I will definitely take care of your points
Hi Raghav,
I have seen you Git course.
I want to run jmeter scripts via Jenkins Job like once in a week which will pick up the scripts from GitHub rather than my local system.
What should I do to make the Jenkins job pick up the scripts from GitHub rather than my local?
Can you or someone help me on this?
Regards,
Akshaj.
Hi Akshaj, you have to do following steps:
1. Create a github account
2. Add project in github and add your jmeter scripts there
3. In jenkins connect to this github
4. In the job under section Source Code Management Select Git and give your repository url
5. In the Build Trigger section you can select Build Periodically and give your interval
6. Run and Validate
Hi Raghav,
I have created a repository in GitHub.
Pushed my jmeter script to the newly created repository.
Now, in Jenkins I have created a job and specified my Git URL as you specified in 4th point above.
And have set the time interval as per my requirement as well.
The thing is, where should I specify my jmeter command which is as below :
jmeter -n -t C:\Users\Akshaj\Desktop\JavatPoint.jmx -l "C:\Users\Akshaj\Desktop\Results.jtl
If this command is to be specified under "Add build step" in my Jenkins job, it will execute the script from my local (Windows machine) only.
How will it execute the script present in GitHub Repository?
Please let me know how to execute the script present in GitHub and also tell me where to specify the jmeter command.
Regards,
Akshaj.
So Akshaj, before running the jmeter command you need to pull the repo (git pull) in your folder and from there scripts will run. This can help you www.google.co.in/search?q=jenkins+pull+git+repository&oq=jenkins+pull+git&aqs=chrome.1.69i57j0l5.6511j0j1&sourceid=chrome&ie=UTF-8#kpvalbx=1
Hi Raghav,
do we need to change the build commands if Jenkins and Jmeter are on different machines, if so what change/changes.
Thanks
Hi Saurabh, the commands remain the same. Just that if the locations (paths) are different. then will have to update accordingly.
I am getting socket exception(s3 bucket) while uploading community certificate..
How to rectify brother??
will need to check logs
I have used the following command in my windows system > execute windows command in jenkins
jmeter -Jjmeter.save.saveservice.output_format=xml -n -t "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\flight_webtours.jmx" -l "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\RESULTS.jtl"
added the line in user.properites but after building the job, it is showing jemter is not recognized
Chandrima
Let's break down the issue step by step:
Step 1: Verify JMeter installation
Check if JMeter is installed on your Windows system.
Ensure that the JMeter bin directory is added to the system's PATH environment variable.
Open a new Command Prompt or PowerShell and type jmeter -v to verify that JMeter is recognized
Step 2: Check Jenkins configuration
In your Jenkins job, go to the Configure page and check the Execute Windows command section.
Verify that the command you provided is correct and the path to the JMeter executable is correct.
Make sure that the Jenkins agent (slave) is running on the same machine where JMeter is installed
Step 3: Check user.properties file
Verify that you have added the following line to the user.properties file:
jmeter.save.saveservice.output_format=xml
Ensure that the user.properties file is in the correct location, which is usually in the JMeter bin directory (e.g., C:\Program Files\Apache\JMeter\bin\user.properties).
Step 4: Check JMeter executable path
In your Jenkins job, try specifying the full path to the JMeter executable in the command:
"C:\Program Files\Apache\JMeter\bin\jmeter" -Jjmeter.save.saveservice.output_format=xml -n -t "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\flight_webtours.jmx" -l "C:\Users\Chandrima\OneDrive\Desktop\jmeter_files\RESULTS.jtl"
Replace C:\Program Files\Apache\JMeter\bin\jmeter with the actual path to the JMeter executable on your system.
Step 5: Check Jenkins agent configuration
Ensure that the Jenkins agent (slave) is configured to run on the same machine where JMeter is installed.
Check the Jenkins agent's environment variables to ensure that the PATH variable includes the JMeter bin directory
Step 6: Troubleshoot further
Check the Jenkins job's console output for any error messages related to JMeter.
Try running the JMeter command manually on the machine where the Jenkins agent is running to see if it works.
If you're still facing issues, try setting the JMETER_HOME environment variable in your Jenkins job to point to the JMeter installation directory.
By following these steps, you should be able to identify and resolve the issue with JMeter not being recognized in your Jenkins job.
-
I use Mac, I followed your steps , but build false, and get error “ cannot cd /Users/...” can you tell me why? Thank you ahead .
Hi, will need to see the command and path you have given
Hello Raghav,
Thanks for the detailed explanation. however, I wanted to know can we pass the values to JMeter script from Jenkins?
Scenario - I have 20 servers which I need to execute the same script with just a change in the server name.
Thanks in advance...
Hi Sunil, yes you can, So here you will need to put that value as property so that you can send the value from command line. Here is a sample video on how to set any value from command line ua-cam.com/video/0tQXN_knLuA/v-deo.html&index=7&list=PLhW3qG5bs-L-oMT1Cnrurt7gEaLrRub2V
Now once you have done this, from jenkins you can parameterize this value and can use different values as per your need. You can also create a drop down with your options. Here is a video on that
ua-cam.com/video/hgqBGNPlLlU/v-deo.html
ua-cam.com/video/ylWHMnbBzC0/v-deo.html
Dear Raghave,
Could you please do the tutorial for " How to scale test automation with jenkins,jmeter and Taurus"
Stap 6: What command for Windows should be in the field Build?
In case of Windows in the Jenkins build section you will select the option - "Execute Windows batch command" and the command will be same only difference will be, instead of "sh jmeter.sh" you will use "jmeter".
Your command will be like.
cd "location of your jmeter bin folder"
jmeter -Jjmeter.save.saveservice.output_format=xml -n -t “location of test file” -l “location of result file”
You can watch this for command line execution of jmeter - ua-cam.com/video/K26q5VgwLKk/v-deo.html
Hello Sir !!
The below command is not working
jmeter -Jjmeter.save.saveservice.output_format=xml -n -t C:\Users\Debajyoti\Desktop\SampleJM\JmeterJenkinsIntegrationTest.jmx -l C:\Users\Debajyoti\Desktop\TestResult.jtl
What I'm doing wrong.
Hi, what does the log / exception say?
Hello raghav.how to run same jmeter testing from two Jenkins slave.and merge report.
Hi Jinia, you can run from jenkins slaves and to merge you can use plugin - jmeter-plugins.org/wiki/MergeResults/
hello sir , Could please create video on load testing of websocket using jmeter?
I will plan Honey
Hi Raghav. can you please share a video on
How to run a Jmeter script in Jenkins with the repository created in Github?
Hi Sam, this can help ua-cam.com/video/mGXGIOpKAos/v-deo.html
@@RaghavPal Hi Raghav. I need to run Multiple API end point URL for performance using Jenkins. Can you please suggest a solution for that?
Thanks in Advance.
You basically will need the command of jmeter to run your test plan and the same can be used on Jenkins, Can check more examples online
I noticed from my Jenkins configure Post-build Actions I select publish performance test report but I couldn't find Add new report and select JMeter. Thus, I don't know how to setup performance report. Please advise further. Thanks
Ok ...done.
I am on wiindows and My command is: jmeter.save.saveservice.output_format=csv -n -t C:\users\itszakaria_bd\desktop\JmeterJenkinsIntegrationTest.jmx -l C:\apache-jmeter-3.1\bin\examples\JenkinsJmeterIntegration.csv
And the ERROR is: 'jmeter.save.saveservice.output_format' is not recognized as an internal or external command,
operable program or batch file.
Any help please.
Thanks in advance.
On windows the command should start with jmeter and you have to give argument -J before the property statement. So it should be like:
jmeter -Jjmeter.save.saveservice.output_format=csv -n -t C:\users\itszakaria_bd\desktop\JmeterJenkinsIntegrationTest.jmx -l C:\apache-jmeter-3.1\bin\examples\JenkinsJmeterIntegration.csv
You can watch the video and verify it. Also in the video i am using format as xml not csv. Let me know if it works.
Hi Raghav, Thanks a ton for your videos....It helped me several times.
Could you please help me on the below situation.
I have separate workspace on windows like C:/Ramesh/*.csv files. When I run the test I would need those .csv files only specific to be attached and send through outlook to recipients. Please help me.
Workaround so far which is working but attaching all the files which is under workspace -> **/*.csv.
Hi Ramesh, are you using some plugin or script for this. Will need to understand the scenario and tools
Hi, your video really helped me so big thank you. I have a question, the file .jtl for each build on Jenkins its overwrite? I hope you can reply me! 😊😊
Great to know this Vale. Yes if the location and name of the jtl file is same, it will get overwritten
Automation Step-by-Step - Raghav Pal Exist a way to create a file for each build? I tried on Jenkins created the file without compile before on Jmeter through the command line but produce a error.
Hi Vale, i am not able to get your exact issue. Please send me the details and error log if any.
Automation Step-by-Step - Raghav Pal I fixed! My issue was that the graphics don't show me the last build of Jenkins but show the results when I run the test with Jmeter in the machine. So I have to delete the file .jtl in each build and create again, now works fine.
Sorry for my english, I hope you can understande me.
Hi Raghav, I have some problems with Build the JmeterJenkinsTestJob because of the Post-build Actions -> Publish Performance test result report (Well I don't have the same IHM) I cant choose a Performance report ( Jmeter )
Hi Hamza, What option are you getting. Have you restarted JMeter after adding plugin.
Automation Step by Step - Raghav Pal
hello Raghav actually I didn’t have the same menu but after searching and talking to my supervisor Who lead my to search on the jtl file I found that I wasn’t deleting it before the build because I had some errors due to the server wich was down.
Thank you very much I appreciate your work and I have learned a lot from this serie thanks.
Hi Raghav,
I have selected execute windows batch run option. I have given date like you. But it is showing build faliure in console output.
Thanks & Regards
Dipti
Hi Dipti,
send me the command
and the error you got. Looks like something simple you are missing here.
Hi Raghav, Can you plz let me know why Jmeter Webdriver sampler it is not working in Jenkins. When I try to execute the WebDriverSampler In Jmeter(headless mode) through Jenkins, it says that Chrome driver started successfully and exits the script immediately. "org.openqa.selenium.remote.ProtocolHandshake CreateSession" doesn't executes in Jenkins(using the Build in -Windows command prompt). The script works fine in local system command prompt. Plz let me know what else can I configure in Jenkins to make it work?
Hi Saurabh, most probably your ChromeDriver binary details are not getting detected. Pls check this - stackoverflow.com/questions/49518157/org-openqa-selenium-sessionnotcreatedexception-session-not-created-exception-fr
Hi Raghav, do you have any tutorial on running Jmeter tests from Gitlab CI tool?
Hi Saranga, I have video for integration with Jenkins but not for Gitlab as of now. You can find all here - automationstepbystep.com/online-courses/
Hi raghav bro...I have one doubt.can we use jmeter if login generating tokens using cognito(cloud service)...??? if jmeter can not then please suggest any tool that test such kind of login pages..bcz if jmeter strucks at login page there is no point of testing remaining pages...thanks in advance plz
Hi, I have not tried and will need to check. You can get more help online meanwhile
hi raghav ,
Getting Below Error . Please Guide me on the same .
I have checked that the jar file mentioned in error is getting executed from the bin folder but jenkins gives this error as below .
C:\Program Files (x86)\Jenkins\workspace\JmeterJenkinsTestJob>C:\Users\Harmeet.Saini.BANKAIGROUP\Desktop\apache-jmeter-3.3\bin\jmeter.bat
Error: Unable to access jarfile ApacheJMeter.jar
errorlevel=1
Press any key to continue . . .
Build step 'Execute Windows batch command' marked build as failure
Finished: FAILURE
Hi Harmeet, just check do you have this jar in bin folder : ApacheJMeter.jar
It's available in that folder
Thanks Raghav...I have the same kind of setup on my one of aws server but jmeter was hanging on "waiting for possible shutdown/..,/.../ on port:445". can u plz help to resolve this?
hi Naga, Can you check the http timeouts set.
This is a normal message that Jmeter gives and should anyways execute your test.
Here is where you must be getting this:
StandardJMeterEngine
private void waitForSignals() {
223 byte[] buf = new byte[80];
224 DatagramSocket socket = null;
225 System.out.println("Waiting for possible shutdown message on port "+UDP_PORT);
226 try {
227 socket = new DatagramSocket(UDP_PORT);
228 DatagramPacket request = new DatagramPacket(buf, buf.length);
229 while(true) {
230 socket.receive(request);
231 InetAddress address = request.getAddress();
232 // Only accept commands from the local host
233 if (address.isLoopbackAddress()){
234 String command = new String(request.getData(), request.getOffset(), request.getLength(),"ASCII");
235 System.out.println("Command: "+command+" received from "+address);
236 log.info("Command: "+command+" received from "+address);
237 if (command.equals("StopTestNow")){
238 stopTest();
239 } else if (command.equals("Shutdown")) {
240 askThreadsToStop();
241 } else {
242 }
243 }
244 }
245 } catch (Exception e) {
246 e.printStackTrace();
247 } finally {
248 if (socket != null) {
249 socket.close();
250 }
251 }
252
253 }
thanks for your quick response... basically iam not from qa/perf testing team...it will be great if you could upload any .jmx file for any webpage ie www.google.com ...etc..thanks in advance
hi Naga, you can find a .jmx file for a simple web page test here. Hope this helps.
www.mediafire.com/file/96j1dld2o01s124/MyFirstTestPlan.jmx
I learnt jmeter from your tutorial. Please release videos for Distributed Load, Fiddler and Perfmon too
Will do that. Thanks for watching.
Performance testing when done by testers , they have to use jenkins ? Isnt jenkins usually used by developers while running performace tcs of unit tcs ? Please clear my doubt.
Hi Yashu, Jenkins is much more than that. If you go to its website it says,
"The leading open source automation server, Jenkins provides hundreds of plugins to support building, deploying and automating any project."
So it has great use in CI and Automation.
How does jenkins helpful for load testing? Only jmeter is not enough?
How test web sockets using jmeter? do you have video for that?
Hi Avinash
Yes, you can test web sockets using JMeter. Here are the steps to test web sockets using JMeter:
Add the WebSocket Samplers by downloading the WebSocket plugin for JMeter.
Once you have installed the WebSocket Samplers, add a Thread Group to your test plan.
Add a WebSocket Open Connection sampler under the Thread Group.
Specify the server name and port in the WebSocket Open Connection sampler.
Add a WebSocket Message Sampler and specify the message that you want to send to the server.
Add a WebSocket Close sampler to close the connection.
I will plan for a video on this
@@RaghavPal
Thankyou sir. Pls upload the video as soon as possible.
great video thanks
You're welcome
How to save in diferent directory this .jtl archice?
Hi, you can create a custom workspace. On Jenkins Job, goto general section, can click on Advanced button at the end of General section and check - use custom workspace
Hi thank you so much it helped me a lot
Glad to know this Biswajit
Hi Raghav I am using the Windows I am getting an Error while Jmeter Integrating with Jenkins pleases help me
Hi, Please send me details on what exactly is the issue with error message or logs
How do you install jmeter into jenkins if you're in a company that doesn't give you access to the server jenkins is on but you have access to the plugins on jenkins website...
You can ask your networks team to do it for you
@@RaghavPal I actually figured out you can install the performance plugin through the configurations plugin manager.
Great, all the best
Hi Raghav, would you know why my build is always successful even though the total error % is beyond the threshold? I noticed in the console output that it stopped in the "Performance: Parsing JMeter report file 'C/TestResult.jtl'" line. Then proceeded to "Finished: Success". the two lines in between as shown in your video were not shown. Please help thanks!
Hi Jasper, as it could not parse your result file, it did not calculate threshold. Can you check the result file, is there anything missing there.
You can try providing a new result filename (not already existing) and try again.
Thanks raghav! It worked now by enabling these settings in the jmeter.properties file: jmeter.save.saveservice.output_format=xml
jmeter.save.saveservice.data_type=true
jmeter.save.saveservice.label=true
jmeter.save.saveservice.response_code=true
jmeter.save.saveservice.successful=true
jmeter.save.saveservice.thread_name=true
:)
Hi, i am unable to add save. Saveservice line inside user. Properties file, getting access denied.. Could you please help me
Are you admin on the system. Try to open it as adminstrator.
can u please steps to run JMeter scripts from Jules
Hi Abraham, I will check on this
Hi , We need an assistance from your side. We are planning to test the application such as "Chat box". How to conduct the Load testing for that application. Planned to Web socket testing.Here we need to increase N of signal R request to server, and how to increase the number of web socket connections.
Thanks,
Hi Fouziya, I have not yet covered web sockets. Will plan to add it soon.
Automation Step by Step - Raghav Pal
Hi Raghav,
I knew the asking question is wrong,but asking for conformation. The above raised question which is not achieved by Badboy software right. By applying the URL and clicking all the functionalities and export to jmeter then running the .Jmx on j meter and raising the number of threads. Is this right way.
Yes, bad boy will not help here
Automation Step by Step - Raghav Pal
Hi Raghav, can we use https on badboy software to generate .Jmx script and run on jmeter to test the load.
You can try but blazemeter is better option
suppose i have .jmx file in git hub. how to trigger from Github for jenkins job
You can get the file from github using Git plugin. Check this video - ua-cam.com/video/mGXGIOpKAos/v-deo.html
Hey Raghav,I am using Windows Machine not able to build & configure jenkins by Batch command .can you please help me on it .
Hi Biswajeet, I will need to know your setup details and logs to troubleshoot
@@RaghavPal Sure ,Gone through your video & followed up the same steps ,In execute windows batch commands in config menu ,I have given the input commands & publish performance test results But it showed the build Got failure .Error Log :- below
C:\Users\bbiswal\.jenkins\workspace\JmeterJenkinsTestJob>C:\Users\bbiswal\Documents\JMeter\bin\jmeter.bat-Jjmeter.save.saveservice.output_format=xml -n -t
'C:\Users\bbiswal\Documents\JMeter\bin\jmeter.bat-Jjmeter.save.saveservice.output_format' is not recognized as an internal or external command,
operable program or batch file.
C:\Users\bbiswal\.jenkins\workspace\JmeterJenkinsTestJob>C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jmx -l C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jtl
Error: Unable to access jarfile ApacheJMeter.jar
errorlevel=1
Press any key to continue . . .
Build step 'Execute Windows batch command' marked build as failure
Cannot detect file type because of error: Failed to copy C:\Users\bbiswal\Documents\JMeter\bin\JMeter Practice\HTTP Header Manager.jtl to C:\Users\bbiswal\.jenkins\jobs\JmeterJenkinsTestJob\builds\16\temp\HTTP Header Manager.jtl
Finished: FAILURE
Hi Biswajeet, Looks like some issue in your command. Did you change dir (cd) before running the command. Pls show me the commands.
@@RaghavPal cd C:\Program Files\apache-jmeter3.2\bin\
jmeter.bat -Jmeter.save.saveservice.output
_format=xml -n -t C:\Users\username\Desktop\JMeter\JMeter_Jenkins_Integration.jmx
-l C:\Users\username\Desktop\JMeter\TestResultJenkins.jtl and it didn't work
i tried without "cd" as well but no chance. not sure what's wrong
Hi Raghav one time i got the response data by accessing cookies manager
Okay, what exactly is the issue or ques here, will need details
Hi Raghav,Can we run the Jmeterscript which is in CVS or GIT rather than in local??
Hi Sai, yes definitely you can.
Can u let me know how we can do it?
Hi Raghav,Can u plz let me know how we can do it?I need this very badly to finish my assignment...Thanks...
Sai, i believe the requirement you have is to pull the script with GIT and run the test. You can watch Git and GitHub playlist on my channel to get some help on this.
Hi Raghav,I tried the below command in execute script as per the video...cd /JMeter/apache-jmeter-3.1/bin
sh jmeter.sh -Jjmeter.save.saveservice.output_format=xml -n -t C:/Users/Myname/Desktop/JmeterJenkinsIntegrationTest.jmx -l C:/Users/Myname/Desktop/TestResult1.jtl My question was can I replace the Jmeter script and Testresult locations with the CVS locations.I already checked them into CVS...I tried pointing the CVS location but the build failed....Can you help regarding this???
Just like we can execute a jmeter test on a remote machine with -R IPofRemoteMachine how can we simulate the same via Jenkins?
Hi Aditya, you just need the right commands for that. and can use them in jenkins job
Hi Raghav
Same way can you please explain how to create with Jenkins job with GitHub.
thanks
I will do soon Srihari
@@RaghavPal
Can you please suggest some videos for that because I need that GitHub with Jenkins integration in jemter . My team planning CI CD
Check this - ua-cam.com/video/Z3S2gMBUkBo/v-deo.html
While trying to download the Jenkins performance plugin it is mentioned as below . Does it mean that we can't no longer integrate with Jenkin and J Meter?
This plugin is up for adoption! We are looking for new maintainers. Visit our Adopt a Plugin initiative for more information.
Hi Bala, you must be able to use it. Just that the current team/person is not maintaining it any longer.
same issue I have! How did you resolve this:?
Hi raghav successfully installed jenkins in my system but i forgot my user i have password how i can get my user details please tell me .....
Hi Siddu, check this - askubuntu.com/questions/849253/how-to-get-username-and-password-for-recently-installed-jenkins
Can u please put a video on how to record an application through VPN
Sure Sneha, can take some time
Hi Raghav Sir,
Firstly, I would like to say thanks for sharing this video, at last stage i m stuck it while giving path in jenkin and run it it shows failure but all reports are shown .Please help it
Hi Bharat, just check in Jenkins, performance plugin fields where there is error threshold and warning threshold. What values have you given. Can also check the logs.
@raghav what if I want to run my jmeter test VM jenkins ?
Hi Nirmal, you can do let me know where exactly did you face any issue
My jmeter is installed locally and jenkins is in aws
How do I map my local jmeter scripts to jenkins
I am not able to download performance.hpi file, could you please help to to download
Hi Alok, you can get the plugin directly on Jenkins
I love your videos and they have been very helpful, but I have some constructive criticism for this video. First, what did you test in this video? Perhaps I am missing the point, because you did not assert anything. What would cause this "TEST" to fail? If I had an assert in JMeter would it fail this Jenkins build. I am not exactly sure what you are testing here. If there is another video that explains that please point me to it.
I did get it to fail for me by changing the error threshold
Hi, this was for a demo for understanding the concept. Glad you did some more work here.
I appreciate it, one thing as a developer I have to remember is BMI, Be More Inquisitive... I just had to push harder and google it and stack overflow it. You are almost making my Pluralsight subscription obsolete, you should get paid for these videos.
Hi raughav ,
I am also facing another issue , please help me out in this also
while running java -jar jenkins.war , it is taking default 8080 port and when we enter it shows me "Failed to start jetty" . Please help me how can i solve this .I research on it then i got a solution to change port while running this command in cmd but here the question is that if we run above command in any other port like 8081 it not showing any error but do we need to run localhost on 8081 also and if so then it ask for administrator password and we already used it non 8080 port
java - jar jenkins.war
Unrecognized option: -
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
C:\Jenkins>java -jar jenkins.war
Running from: C:\Jenkins\jenkins.war
webroot: $user.home/.jenkins
Aug 07, 2018 5:30:21 PM org.eclipse.jetty.util.log.Log initialized
INFO: Logging initialized @776ms to org.eclipse.jetty.util.log.JavaUtilLog
Aug 07, 2018 5:30:21 PM winstone.Logger logInternal
INFO: Beginning extraction from war file
Aug 07, 2018 5:30:21 PM org.eclipse.jetty.server.handler.ContextHandler setContextPath
WARNING: Empty contextPath
Aug 07, 2018 5:30:21 PM org.eclipse.jetty.server.Server doStart
INFO: jetty-9.4.z-SNAPSHOT; built: 2018-06-05T18:24:03.829Z; git: d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_181-b13
Aug 07, 2018 5:30:22 PM org.eclipse.jetty.webapp.StandardDescriptorProcessor visitServlet
INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet
Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: DefaultSessionIdManager workerName=node0
Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.DefaultSessionIdManager doStart
INFO: No SessionScavenger set, using defaults
Aug 07, 2018 5:30:22 PM org.eclipse.jetty.server.session.HouseKeeper startScavenging
INFO: node0 Scavenging every 600000ms
Jenkins home directory: C:\Users\abc\.jenkins found at: $user.home/.jenkins
Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.handler.ContextHandler doStart
INFO: Started w.@66ea810{Jenkins v2.136,/,file:///C:/Users/abc/.jenkins/war/,AVAILABLE}{C:\Users\abc\.jenkins\war}
Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.AbstractConnector doStop
INFO: Stopped ServerConnector@1b66c0fb{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.session.HouseKeeper stopScavenging
INFO: node0 Stopped scavenging
Aug 07, 2018 5:30:25 PM hudson.WebAppMain contextDestroyed
INFO: Shutting down a Jenkins instance that was still starting up
java.lang.Throwable: reason
at hudson.WebAppMain.contextDestroyed(WebAppMain.java:388)
at org.eclipse.jetty.server.handler.ContextHandler.callContextDestroyed(ContextHandler.java:961)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextDestroyed(ServletContextHandler.java:571)
at org.eclipse.jetty.server.handler.ContextHandler.stopContext(ContextHandler.java:938)
at org.eclipse.jetty.servlet.ServletContextHandler.stopContext(ServletContextHandler.java:381)
at org.eclipse.jetty.webapp.WebAppContext.stopWebapp(WebAppContext.java:1503)
at org.eclipse.jetty.webapp.WebAppContext.stopContext(WebAppContext.java:1467)
at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:990)
at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:297)
at org.eclipse.jetty.webapp.WebAppContext.doStop(WebAppContext.java:569)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:149)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:170)
at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:124)
at org.eclipse.jetty.server.Server.doStop(Server.java:490)
at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
at winstone.Launcher.shutdown(Launcher.java:316)
at winstone.Launcher.(Launcher.java:176)
at winstone.Launcher.main(Launcher.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at Main._main(Main.java:344)
at Main.main(Main.java:160)
Exception in thread "Jenkins initialization thread" Aug 07, 2018 5:30:25 PM org.eclipse.jetty.server.handler.ContextHandler doStop
INFO: Stopped w.@66ea810{Jenkins v2.136,/,null,UNAVAILABLE}{C:\Users\abc\.jenkins\war}
java.lang.NoClassDefFoundError: hudson/util/HudsonFailedToLoad
at hudson.WebAppMain$3.run(WebAppMain.java:247)
Caused by: java.lang.ClassNotFoundException: hudson.util.HudsonFailedToLoad
at java.net.URLClassLoader.findClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at java.lang.ClassLoader.loadClass(Unknown Source)
at org.eclipse.jetty.webapp.WebAppClassLoader.loadClass(WebAppClassLoader.java:565)
at java.lang.ClassLoader.loadClass(Unknown Source)
... 1 more
Aug 07, 2018 5:30:25 PM winstone.Logger logInternal
INFO: Jetty shutdown successfully
java.io.IOException: Failed to start Jetty
at winstone.Launcher.(Launcher.java:165)
at winstone.Launcher.main(Launcher.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at Main._main(Main.java:344)
at Main.main(Main.java:160)
Caused by: java.net.BindException: Address already in use: bind
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Unknown Source)
at sun.nio.ch.Net.bind(Unknown Source)
at sun.nio.ch.ServerSocketChannelImpl.bind(Unknown Source)
at sun.nio.ch.ServerSocketAdaptor.bind(Unknown Source)
at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:331)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:299)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:398)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at winstone.Launcher.(Launcher.java:163)
... 7 more
Aug 07, 2018 5:30:25 PM winstone.Logger logInternal
SEVERE: Container startup failed
java.io.IOException: Failed to start Jetty
at winstone.Launcher.(Launcher.java:165)
at winstone.Launcher.main(Launcher.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at Main._main(Main.java:344)
at Main.main(Main.java:160)
Caused by: java.net.BindException: Address already in use: bind
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Unknown Source)
at sun.nio.ch.Net.bind(Unknown Source)
at sun.nio.ch.ServerSocketChannelImpl.bind(Unknown Source)
at sun.nio.ch.ServerSocketAdaptor.bind(Unknown Source)
at org.eclipse.jetty.server.ServerConnector.openAcceptChannel(ServerConnector.java:331)
at org.eclipse.jetty.server.ServerConnector.open(ServerConnector.java:299)
at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(AbstractNetworkConnector.java:80)
at org.eclipse.jetty.server.ServerConnector.doStart(ServerConnector.java:235)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at org.eclipse.jetty.server.Server.doStart(Server.java:398)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
at winstone.Launcher.(Launcher.java:163)
... 7 more
Hi Pradeep, you can run jenkins on any port with command e.g.
java -jar jenkins.war --httpPort=9191
All your passwords, config etc will remain same.
Ok Raughav , Thanks a lot Raghav Pal
what is the difference between Relative Threshold and Error Threshold in Performance report
hi Vinay.
In Jenkins for Performance Reports we have 2 modes:
1. Relative Threshold
2. Error Threshold
Relative Threshold - is used to mark the build unstable or failed based on the error % difference as compared to the previous build (or some specific build number).
Error Threshold - is used to mark the build unstable or failed based on the % of failed samples within the same build/test.
To make things more clear, In Jenkins Post Build Actions -> Publish Performance test result report, you will find 2 sections:
1. Use Error thresholds on single build: This is used if you select Error Threshold and it has % value to set for marking build unstable or failed.
2. Use Relative thresholds for build comparison: This comes into picture if you have selected Relative Threshold. Here again you can set % for marking build fail or unstable.
It also has further options like if you want to compare to a previous build or some specific build (give build number)
Hope this is clear :)
how to include SSL certificate [.p12] into Jmeter Raghav?
Deepak, please see if this helps you - stackoverflow.com/questions/23534429/add-external-certificates-to-jmeter
hi Raghav, please explain about octa session login once to our subscribers It is very challenging for me in Jmeter
I will plan to add a lecture on this
Octa session login can be a tricky aspect of automating with JMeter, especially due to its reliance on cookies and potential multi-factor authentication (MFA) challenges. However, with the right approach and tools, you can successfully capture and handle the login process in your JMeter scripts.
Here's a breakdown of Octa session login in JMeter:
1. Understanding the Login Flow:
Initial Request: Begin by identifying the initial request for accessing the Octa login page. Capture this request in JMeter using an HTTP Sampler.
Authentication Process: Analyze the login form elements and any additional steps involved in authentication, like MFA.
Cookie Capture: Pay close attention to the cookies returned after successful login, as these will be crucial for maintaining the session in subsequent requests.
2. Handling Challenges:
Cookies and Session Management: Use a Cookie Manager element in JMeter to store and manage the session cookies obtained after login. Ensure these cookies are automatically added to subsequent requests to maintain the authenticated session.
MFA Handling: The approach for MFA depends on the specific method used by Octa.
One-Time Passwords (OTP): If relying on OTPs via email or SMS, consider external tools like plugins or integrating with dedicated services to extract and use the received OTP within your JMeter script.
Hardware Tokens: Capturing responses from hardware tokens might require specific plugins or custom scripting depending on the token type and interaction method.
3. Tools and Techniques:
HTTP Header Manager: Use this element to set any required headers for the login request, such as User-Agent or Content-Type.
BeanShell Post Processor: This can be helpful for dynamic processing of extracted values, like parsing the response for an OTP or manipulating cookie values.
Regular Expressions: Utilize regex patterns to extract necessary information from responses, such as session IDs or token values.
Plugins: Explore available plugins for JMeter that specifically address Octa login or MFA handling, which can simplify your script development.
4. Testing and Debugging:
Run your script in Debug mode: This allows you to step through each request and response, checking for errors and verifying cookie values at each stage.
Correlate values: If elements or values change dynamically, use correlation options in JMeter to ensure your script adapts to these changes during test execution.
Consult Resources: Utilize official documentation from Octa and JMeter, along with online tutorials and community forums, for specific guidance and troubleshooting tips.
Remember, capturing and handling Octa session login in JMeter can be nuanced, but with careful analysis, appropriate tools, and meticulous testing, you can successfully automate your login process and ensure reliable test execution.
I have a query that I can see the expected url on request tab in view result tree but the response body is blank , meanwhile i need to see some html format there(Expected) but it is not coming
@@RaghavPal and i don't know why it is blank??
Not too sure on this.. will need to check online
I Have Jmeter tests on my windows cloud machine (tests, JMeter installation on my cloud system).But Jenkins install in another cloud machine how to integrate my JMeter tests in cloud machine Jenkins
In Jenkins you can use master slave concept and use the JMeter machine as node
Thank You.I will Try
Hi Rgahav,
This video was vey helpful, thanks .
Could you please show a demo of how to run jmeter in jenkins Pipeline ?
It would be very helpful.
Looking forward for ur reply :)
Sure will do soon.
@@RaghavPal when soon??
I can take this up after my current assignment after a week.
@@RaghavPal okay... great... thank you...
Hi sir,Actually i want to load test of an application ,if send virtual users(threads) to an application server beyond the maximum limitation of load of the server then application should go to hang or application should crass and send one virtual user less than maximum limitation load of an application it is work normal ,how can do this in jmeter and how to know what is the maximum limitation of an application server? please guide me sir because this answer is not available in any video.
Thanks & Regards
Pankaj kumar
Hi Pankaj, the max load of your server is something your internal teams (network teams) can tell you. Basically we go with the requirement of real world and keep a load a little over that to check our servers can handle it.
So a good load test will be a combination of 2-3 tests, one with general load and other with max load you can expect and then you can do the comparison and analysis.
Hi raghav,
Test run successfully in jenkins but got the failure status at the end of run
Build step 'Publish Performance test result report' changed build result to FAILURE
Finished: FAILURE
Hi Ariff, okay, that means some issue with the step Publish Performance test result report, Pls check the logs in Console Output
-Jjmeter.save.saveservice.output_format' is not recognized as an internal or external command,
operable program or batch file. Anyone have this issue on windows?
Hi Flora, pls show your complete command. Are you running from jmeter bin folder
in post build action , performance report is not present
will need to check the details and steps
Hi Raghav,,
when i installed jenkins i got a password from which i was logged in. Now when i am trying to login with that password it is not allowing me to login.
Please suggest.
Regards
Dipti
Hi Dipti, that must be the admin password. Ideally it should. Not sure why is it happening. Are you using username : admin
having problem with the commands that you used
on cmd window show an error
what error did you get. What command did you run.
Good tutorial. but there is a problem in this method for results data trending. The results of all the build gets appended to the result file. As a result, latest build will have results accumulated from previous builds which is incorrect. If we try to give unique results file for each build number by appending the build number to the results file, then we will not get the trend results.
Hi Siva, I believe this shows an overall trend but still preserves individual results. Pls check again
@@RaghavPal
Hi raghav, I checked it, this accumulates results in to single jtl file. The number of samples shown in trend table for the same test scenario during each build increases like 2x for second run, 3x third run. This will be clearly seen in the trend table not in the graph. If we open the second build and see the results table for samples and throughput it will be 100% increased from first build.
Okay Siva I will check on this and see some options online. Meanwhile you too check online on this
Hi Raghav. Thanks for informative tutorial. I'm running from windows7 ..I stuck at build part and each time executed failed (windows batch command). This is my script cd "C:\apache-jmeter-4.0\bin>jmeter -Jjmeter.save.saveservice.output_format=xm
l" -n -t "C:\apache-jmeter-4.0\bin\View Results in Table_jenkins.jmx" -l "C:\apach
e-jmeter-4.0\testresultjenkins.jtl".....I've done with and without quote (") but still fail from jenkins. Please advise further. Thanks
I'm able to run it 'SUCCESS' but got message related to JMETER_HOME. This is the script that i used ***Execute Windows batch command***
C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm
l -n -t "C:\apache-jmeter-4.0\bin\View Results in Table_jenkins.jmx" -l C:\apach
e-jmeter-4.0\testresultjenkins.jtl
This is result from console
D:\Jenkins\jenkinshome\workspace\JmeterJenkins>C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm
The JMETER_HOME environment variable is not defined correctly
This environment variable is needed to run this program
Finished: SUCCESS
I've added JMETER_HOME PATH to my windows env..but still the same...maybe need to reboot.
After reboot still the same
D:\Jenkins\jenkinshome\workspace\JmeterJenkins>C:\apache-jmeter-4.0\bin\jmeter -Jjmeter.save.saveservice.output_format=xm
The JMETER_HOME environment variable is not defined correctly
This environment variable is needed to run this program
Performance: Recording JMeter reports 'D:\Jenkins\jenkinshome\jobs\JmeterJenkins\builds\50\temp\testresultjenkins.jtl'
Performance: Parsing JMeter report file 'D:\Jenkins\jenkinshome\jobs\JmeterJenkins\builds\50\performance-reports\JMeter\testresultjenkins.jtl'.
Performance: No threshold configured for making the test unstable
Performance: No threshold configured for making the test failure
Performance: File testresultjenkins.jtl reported 0.0% of errors [SUCCESS]. Build status is: SUCCESS
Finished: SUCCESS
Did you check for this online
I've checked online but none related and could resolve JMETER_HOME error above. Anyway those have been set earlier but still the same. Do you suspect any that could lead to this error...
I too checked and could not get some specific answer online.
Hi sir, I am getting an error in Jenkins" An error occurred: Error in NonGUIDriver Problem loading XML from"
Hi Bharathi, check what is the sampler you are using in this request and do you have the required plugins added
@@RaghavPal hi sir, I m running jmx tests via Jenkins. Have emailed you all the details. Kindly help sir. Thank you in advance
Okay