Run Selenium Test on MS Azure Pipeline || Azure Cloud

In this video, I have explained how to setup MS Azure pipeline and how to run selenium maven testNG test cases on Azure Pipeline.
Learn:
What is MS Azure
Setup Azure dev ops account
Setup Azure pipeline
Run Selenium test cases on Azure Pipeline using Maven
How to auto trigger test cases after any checkin/PR
How to schedule the pipeline job
~~~~Subscribe to this channel, and press bell icon to get some interesting videos on Selenium and Automation:
www.youtube.co...
Follow me on my Facebook Page:
/ naveenqtpexpert
Let's join our Automation community for some amazing knowledge sharing and group discussion on Telegram:
t.me/joinchat/...
Paid courses (Recorded) videos:
naveenautomati...
For Java & Selenium - naveenautomatio...
For API (Manual + Automation) - naveenautomatio...

[@Mukeshotwani]

Awesome Naveen you are really amazing.

[@rengarajan1878]

How can we email the extent report or file from this release pipeline ?

[@arkaimps]

Wow.. this is so great to see , two of my favourite KZbinrs from whom I learnt automation, complimenting eachother... 👍👍👍👍

[@singh07neeraj]

you both are awesome

[@sureshb134]

Hi Naveen, Mukesh andAutomation experts, can we do parallel execution here.. Plz Suggest how.. Currently automation scripts are running in Azure Devops pipeline.. But not sure how to proceed parallel execution here. NOTE :IE browser..

[@rengarajan1878]

@@sureshb134 in your XML set as - this runs 5 browser parallel ,each browser test a class,

[@seemaprajapati4734]

Awesome! Thank you for this video

[@sahil0069]

Thanks alot Naveen 💫

[@tri123tri]

Great

[@virenautomationtesting]

good one bhayaaa

[@rathinsaha6505]

Very well explained . I will try by my own.

[@anujaphaltankar3046]

Awesome Naveen. Thanks a lot

[@mkcomic1921]

Thank you so much for the awesome video.

[@oleksandrdyachuk3951]

Thank you for your work!

[@venkatjayakumar1819]

WOWWW... Too Good !!

[@ChanceTEK]

Sensational job! Thank you.

[@naveenautomationlabs]

Glad you liked it!

[@j7samsung301]

@@naveenautomationlabs Hi Sir can you give us the pom.xml file

[@xolimosala2260]

Vital content, very good indeed!

[@hareeshn6524]

very helpful video . Thanks for uploading

[@khuongtranbuingan7637]

Thanks a lot Naveen.

[@asmitachouhan2042]

Please post video on Release pipeline as well.

[@sayedtalha2689]

Thank us so much to you sir for giving knowledge about azure devops..... Sir my honourable request... Explain about the new release CI/CD pipe line Sir this is the main thing to understand sir if u have video about CI/CD Release new pipline send the link sir

[@satishrocking4724]

Nice sir very very usefull for all

[@khayalghosh8383]

This is one of the rare topic on which we see a video on youtube thank you for making this video.

[@AdiAsaf]

Not bad man. What was your url target?

[@navjyot_ironman]

We are running selenium testcases from visual studio to azure devops pipeline. Thanks for this video.

[@naveenautomationlabs]

Awesome

[@SureshS-vm5hh]

Is there anyway to handle file upload test cases in Azure vs test, please let me know if you can help

[@mdniyazhashmi458]

Can you please create video on azure release pipeline

[@mzamomahaeng268]

The question is why was I not subscribed?????? I quickly did and gave you a like.Thank you

[@amuthansakthivel3393]

Awesome Naveen 👌👌

[@lokeshsharma-gd1xo]

I really dont know any one in this testing world, who did this much amount of favour to the testing cummunity. You are the Sanjeev kappor of testing world, bless you brother

[@akshaybasatwar4914]

Thank you so much :) I am very happy I am able to create Selenium Pipeline

[@j7samsung301]

can you share the project ?

[@JatinBakshi-bv6br]

What a video i must say great Naveen... I have a question that can we configure karate framework with azure and view reports in azure..

[@JatinBakshi-bv6br]

Thanks Naveen what a great work u are doing.. i have question that is it possible to configure karate framework with azure and view the reports there in azure.

[@HarshalChopade-i3c]

Hi Naveen Can we see the script execution video also? Is there any setting in the azure which will capture the entire execution video? I would appreciate if you response. Thanks in advance.

[@rahulnani1143]

My code running properly in local but getting no such element expectation in pipeline any help on this?

[@NishantKumar-lq9kn]

How we can run the testcases with annotation such as @smoke or @regression in the Azure devops pipeline .

[@deepanshuaggarwal7042]

what would you prefer Jenkin or Azure ?

[@darshangowda317]

How to add maven commands for the run ?

[@nurlanshukurlu]

Amazing instructor ever !

[@nainapancholi4482]

Can I use selenium java with azure pipeline. Please post a video that shows agent construction for selenium java pipeline

[@surya-ti8gm]

Very useful video to learn selenium and azure devops integration.

[@maheshharish6415]

Nice naveen , it's helpful for us .

[@aasasout]

Hi all. Please tell me if it is possible to connect auto tests with manual test on stack Selenium Java + Maven in Azure DevOps?

[@tejas4054]

How to add jenkins here and run test from jenkins please add this step too

[@Shwetank0512]

Awsome !! I have a Query - My Project is based on .net + TFS + AWS and My Automation selenium script is Java + Maven. Could new dev build automatically triggered to my Java code. Here, CI-CD piplene shows triggered new build of my Java script code. How can we triggred dev new build ?

[@TejasSonavane-b2q]

How to see allure reports after the execution? How can my client see the reports? Also, How to parameterize different xml files in pom.xml

[@mariapeterchrisalagose2204]

I have a query like for manual testers, if they are not good with automation testing, what all other jobs they can apply for ?

[@solomonsheppard9392]

how to change those test cases names in results ?

[@shilupg]

How this Selenium scripts will be executed when developers integrate or release the build

[@User.2024.1]

This was 3 years ago. Can you please update this for 2024 ? Thank you!

[@ajithkumar5563]

how to host the selenium in docker with DB using pipelines

[@AjeetSingh-hs2ec]

Hi Naveen, Thanks for creating a video it's very helpful, i have one query for login function I have to keep the username and password is secret can you plz help me how it can we.

[@kailaspoduval]

Awesome! Simple and Crisp 👌🥰

[@gopalprince7755]

How to send TestNG report or extent report to an email?

[@manaspal5]

In my case Tests tab not showing after build completed.

[@kaurkaur1257]

Can you show how to setup VPN to run test … ? I can run public site but not private

[@sandeepbonagiri5150]

Thanks Naveen , u are really amazing

[@anuragmurali3842]

Hi I'm no getting Azure Pipelines option in Agent Pool select box. How to fix this issue?

[@mrgurudeesh8299]

Awesome Thank you for this video and am waiting for next video for release build process....!

[@shanthiprabhu2100]

Hi Naveen, if i run any maven project with simple test case it got succeed but if i try to selenium UI test getting the below error Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project CICDTestProj: There are test failures. Can i get a help from you

[@kdkvai]

Hello Naveen , Did you find anything related to Extent report. how to publish it? I am not using Testng /Junit report. Any comment from your research will help me. thanks

[@PradeepKumar-tn6cf]

Did you get the solution to this problem?

[@Dhukur_Nginx_Proxy]

How to add my teammates to get report on PowerBi via E-mail ? any idea

[@valerietiyiselani6049]

After running the pipeline , mine does'nt send the test report. it shows on Ahent job that it is success but i cant see the test rests , how can i fix that. Basical it doesnt show the executed test cases. pls help

[@UjjawalKumar-k7o]

im geting this error ##[error]Unhandled: Not found mavenPOMFile: D:\a\1\s\pom.xml,,,,, when i run a pipeline can you please help me

[@YkrishnaAppa]

If automation test failing in pipeline but passed in local execution what could be the reasons

[@gaorutweandrewmosala1288]

Brilliant!!

[@ItsmeChaitu777]

I'm getting chrome browser issues.. browser is not launching...getting ip issues.. can someone suggest on this please

[@raghur5678]

Hi my requirement is to send email test report to the developer who commits the code into repo then he runs the pipeline he need to get email notification of the test report. how can i achieve this?

[@vrana_fitness]

Thanks Naveen for sharing the session. I have also recently done same set up in our team automatiion project for TFS. We are running Selenium test cases on TFS using Maven.

[@sandeepnegi4939]

Do we need to configure the remote web driver and driver capabilities if we are running using azure dev ops

[@vrana_fitness]

@@sandeepnegi4939 nope.. You don't need to configure remote driver capabilities. You must ensure that a agent is configured properly to support automates test execution.

[@sandeepnegi4939]

@@vrana_fitness ok understood in my case the build server is acting as an agent and that agent is not having firefox currently I am running tests in firefox also I am not able to build the project since my maven project needs some jars and the build server is not able to access the internet I am in a corporate environment

[@vrana_fitness]

@@sandeepnegi4939 Ok.. You have to make ensure the proper access of agent which you can access and install maven, java, firefox and other utilities. in my case my agent is vm and I am able to access vm explicitly where I have made all the configuration to support automated tests execution.

[@vrana_fitness]

Please contact your IT support team to make open internet at agent otherwise maven will not configured as it need dependences to be downloaded.

[@srinivasans3394]

how to run grid cases on this

[@sureshb134]

Someone please suggest on parallel execution here

[@deepalipatil8759]

@@sureshb134 Did you get a solution on parallel execution ?

[@sureshb134]

@@deepalipatil8759 I tried multi agent configuration if you have 2 agents.. So, my project has 2testng.xml files... So, running agent1 with maven : in goal parameterzng testng1.xml and for agent2: testng2. Xml.... The setup u can ask Devops guy in project

[@sureshb134]

Setup:This is like one azure server.. automation configuration in both agents... In Azure pipeline u have to configure both agents and split ur testcases by parameterized in maven build goals..

[@srinivasans3394]

@@sureshb134 any video reference for azure just for selenium automation and devops for that automation project

[@j7samsung301]

Sir please share the code

[@manimaddy8079]

Even i gave the wrong xpath i did not get the failed agent. Even its passed😢 pls solution me

[@owaisjilani2108]

Waiting for the next part . Great job 👏

[@sandeepnegi4939]

Hi naveen You were saying that we should not use the driver object in our Test Class but you are using it here The problem I am facing is I just have one driver instance and it is used by all the test cases so I am not able to run those test cases in parallel can you provide some solution or share some code samples on gihub

[@sureshb134]

Even i want to implement parallel execution. In Azure cloud.. Could someone please suggest here

[@sandeepnegi4939]

@@sureshb134 what is your issue parallel execution or the selenium hub and docker configuration for Azure I was able to run the test cases in docker container in amazon aws

[@sureshb134]

@@sandeepnegi4939 IE browser doesn't support docker.. So need to implement in Azure cloud pipeline.. But if we use testing. Xml parallel configuration.. Does we get thread localizatn issues?? Should we need selenium grid here to avoid multi threading concept?

[@sandeepnegi4939]

@@sureshb134 currently I have also stucked their only I am able to run the tests in local in serial fashion also I am able to run the tests in EC2 serial but now I am trying to run a tests using azure dev ops but in this case the build agent that we have to use for our pipeline that agent is in ON premise server and that is not having internet connection so not able to build the project

[@laxmikantghuli679]

@sandeep, @suresh, can onyone now able to execute ui code in pipeline..... For me it's getting stuck at one point and won't go beyond that since everything in headless mode so not able to check where exactly failing. I checked by putting logger msgs at each step, whenever wait.until() method executing it's getting stuck there itself, tried with static wait, working fine.... Can anyone pls let me know how u resolved this problem. Because explicit wait is used everyone in framework and we can't change it

[@arifkurniawan3654]

hi bro, can help me? Build failed in Maven pom.xml [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.10.1:compile (default-compile) on project (Project Name): Fatal error compiling: invalid target release: 16 -> [Help 1]

[@raisangeeta1107]

I am also facing the same issue Any hep would be appreciated

[@nasreenkhan-yy3tj]

This is Awesome !!!! Can you please share the video for whenever a new build is created from dev side these test cases should run first, if Passes then the build will be create

[@omega6094]

Is this possible to deploy a dev build if only it passes selenium tests in Azure devops? Could anyone help sharing a video or any material

[@gauravirane1542]

i have done same but it gives error: bad class file: C:\Users\VssAdministrator\.m2 epository\org\seleniumhq\selenium\selenium-api\4.16.1\selenium-api-4.16.1.jar(org/openqa/selenium/By.class) class file has wrong version 55.0, should be 52.0 Please remove or make sure it appears in the correct subdirectory of the classpath.

[@amudarajesh8519]

Naveen can you post a video to send selenium code to azure repository please

[@aasthasharma6896]

Hi Guys, I am trying to run my code from Azure pipeline, but I am getting this error: [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test (default-test) on project Auto: There are test failures. [ERROR] [ERROR] Please refer to D:\a\1\s\target\surefire-reports for the individual test results. [ERROR] Please refer to dump files (if any exist) [date].dump, [date]-jvmRun[N].dump and [date].dumpstream. [ERROR] There was an error in the forked process [ERROR] [ERROR] Cannot instantiate class com.crm.qa.testcases.LoginPageTest [ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException: There was an error in the forked process [ERROR] [ERROR] Cannot instantiate class com.crm.qa.testcases.LoginPageTest [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:733) [ERROR] at org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:305) Pom.xml content for surefire: org.apache.maven.plugins maven-surefire-plugin 3.0.0-M5 3 true src/main/resources/testng.xml Can you please help me with where I am going wrong

[@moulalishek2466]

@Naveen, Can you please upload a video on how to update java selenium test results in TFS?...Please help us on this?...Thanks in advance...

[@goldfan5523]

1 question..why people still use Jenkins instead of azure? Azure has such a good user friendly ui and also it's like a complete package with dashboard kind of features.

[@shapbnil]

Hi Naveen, When I running in Azore DevOps I am getting ##[error]Unhandled: Not found mavenPOMFile: D:\a\1\s\pom.xml What to do, please?

[@mohammedsaif7916]

You have to select the path of Pom.xml file from your project inside the GitHub repo. Hope it helps :)

[@AnickRazibul]

Quick Question Naveen; how about I am running test on cloud agent; and I don’t have any browser installed. Also Could show was a demo where we can integrate Continuous delivery pipeline as well?

[@AnickRazibul]

Thank you so much for your awesome demonstration. You are an amazing teacher!

[@shababe2243]

Naveen , this is really useful .Thank you very much

[@gollum5652]

How can we take screenshot for java code and that screenshot should be in ATTACHMENTS OF AZURE PIPELINE? something like textContext in python.

[@sukanyachitikela5805]

Hi.. I have run the pipeline in Azure but my testcases are not executed in pom.xml could please tell what plugins i need to add.. thanks in advance

[@chinnaduraimuthupandi8984]

I am not able to see the Test tab after executing the pipeline, what might be the reason? and you help me out in this?

[@mohammedsaif7916]

+1

[@Rajkumar0986]

Hi Naveen, I'm using azure pipeline, assume that agent has been configured in "machine A" but we running the script from "machine B" once the execution completed and reports are generated but the screenshot are not visible to machine B which display along with extent report.

[@pitambarmishra3934]

Hi Naveen, I am getting FileNotFoundException for Global.properties file while running the selenium script from Azure Pipeline. I am providing the path like .\\src\\test\ esources\\Global.properties to read data from properties file. It’s running in local without any issue but in Azure pipeline it throws exception as it’s not able to find the path. Any help or suggestions to resolve this error will be appreciated. Thanks

[@gello2777]

Thanks a lot Naveen. I could execute my pipeline in mac. However in Ubuntu its failing.Can i get some suggestion.

[@khuongtranbuingan7637]

Hi Naveen, How can we trigger the selenium automation run when the system has just done deployment with the Azure DevOps pipeline? My scenario is having 2 java projects: - Developer team is implementing a system in the Rest API project "D1" - API automation scripting is implementing in the Maven project "A1" with TestNG Expectation: when the "D1" project has just deployed, the "A1" project will be trigging to execute and add the report to pipeline.

[@navdeepkumar1055]

Hi Navin, when I tried to run in actual cases like launch browser and do some test then it's giving null pointer exception because driver it self not executed and step are skipping. if you can make some video on this..🙏

[@kalaivanianbazhagan1001]

I understand by means of Azure, automated test scripts can be triggered.. but curious to know, what special Azure will give than Jenkins (to my understanding, looks Jenkins and Azure are same CI/CD). Can somebody pls explain?

[@prafulanand6548]

Is there any way we can log into the cloud VM to actually see the jobs running ?

[@sandeepnegi4939]

Do we need to configure the remote web driver and driver capabilities if we are running using azure dev ops

[@goldfan5523]

@@sandeepnegi4939 not mandatory..azure just pulls your GitHub code and executes the test cases...no matter even if you have used remote Webdriver or not.

[@prathvichannapparatnappago3694]

Hi Naveen, Is it possible to run automated scripts without Release pipeline, I mean to say just like on Jenkins server how we can run the scripts/suites/jobs on demand ( when ever we want to) can we do the same on Azure DevOps ? Please help

[@SureshKumar-no7rs]

Hi, Thanks for sharing. Could you please let me know how to setup Agent pool? in your case it is defaulted to Azure pipeline, but for me it is empty.

[@powerseeker]

Go to project settings > agents Pool (in Pipelines section). Here you can find all the agent which have been already installed. If you don't have anything, click on "add a pool" and follow the process. You have 2 choices, use your personnal computer like a remote agent, or configure a agent on a remote server.

[@rohitalhat8618]

How can we see the extent reports generated for UI validation

[@arundada89]

Hi Rohit, Where you able to resolve this?Looking for the same. We have extent report generated in a seperate Results folder with timestamp for eachrun.Need to understand how this can be viewed for Azure runs. Thanks!

[@ragavendrad574]

That was nice video, thank you... Please upload a video with azure + aws + docker integration

[@naveenautomationlabs]

Noted

[@YogeshKumar-ok4nb]

Really appreciate your efforts man. Thanks Naveen!

[@balakathiravan7]

Can we add screenshot to capture in this pipeline

[@parveenchauhan5132]

How can we automation script on each developer commit in azure devops repo?

[@laxmikantghuli679]

Hi Naveen, in our project we are trying to run pipeline. I have used windows-2019 as vmImg, api scripts are working fine but problem is with UI script..... Wherever we're using wait.until(expectedcondition) method it's not getting executing that step on agent machine.... Is there any way to check how agent is responding?

[@ParasJoshiPj]

Naveen,why it is not opening the browser,r u running the code in non gui...And please make a full CI CD video..I mean if dev team will give the new build so in the same time my scripts should trigger automatically in azure devops

[@beenushrestha4246]

Hello Naveen! I am getting the error which says: "This agent request is not running because you have reached the maximum number of requests that can run for parallelism type 'Microsoft-Hosted Public'. Current position in queue: 1 Job preparation parameters" Do you have any solution regarding this and also on the top section a message also pop up telling: "Pipelines in your region may be impacted by a live site incident, resulting in possible pipeline delays. Check the status here."

[@singh07neeraj]

Thanks, Naveen you really explain very well. Appreciate your work

[@ArturoCerecero]

Thanks great video, It really help me. I was wondering if there is a way to connect those pipelines to a testplan there in azure devops?

[@arthivigneshwari8393]

Hi Naveen, for JAVAFX based project which is a good Interactive UI test automation tool?