Skip to content
This repository has been archived by the owner on Nov 29, 2018. It is now read-only.

Impossible to run tests in parallel via TestNG and IEDriverServer_x64_2.25.2 #4320

Closed
lukeis opened this issue Mar 3, 2016 · 7 comments
Closed

Comments

@lukeis
Copy link
Member

lukeis commented Mar 3, 2016

Originally reported on Google Code with ID 4320

It's impossible to get proper test finalization if you run 3 or more tests in 3 threads
at the same time.
Steps to reproduce:
Presetup:
- 3 test classes with a single test method respectively
- Drivers starts and stops in @BeforeClass and @AfterClass (TestNG)
- testng.xml with parallel="classes" thread-count="3"
- All 3 classes are added to testng.xml with methods that are specified by "included"
- Run tests via testng.xml
Test Results:
I get 3 different behaviors for test results:
1.
- 3 driver instances started
- 3 browsers opened
- 3 tests passed
- 3 browsers closed
- 3 driver instances stopped
2.
- 3 driver instances started
- 2 browsers opened
- 2 tests passed
- 2 browsers closed
- 2 driver instances stopped
- 1 browser is not opened
- 1 test hasn't started
- 1 driver instance is not stopped
3.
- 3 driver instances started
- 1 browsers opened
- 1 test passed
- 1 browser closed
- 1 driver instances stopped
- 2 browsers are not opened
- 2 tests haven't started
- 2 driver instances are not stopped

The similar situation when number of threads is 2.

The logs report that 
server.cc(233) Command: POST /session {"desiredCapabilities":{"platform":"WINDOWS","ensureCleanSession":true,"ignoreProtectedModeSettings":true,"browserName":"internet
explorer","version":""}} 
is the final point for hanged instances.

Environment:
OS Name:                   Microsoft Windows 7 Professional
OS Version:                6.1.7601 Service Pack 1 Build 7601
System Type:               x64-based PC
Browser:                   IE9, 64
Selenium:                  selenium-server-standalone-2.25.0
IE driver:                 EDriverServer_x64_2.25.2

Please find my simple test suit attached to reproduce the issue.
Note, that libraries are not included. Please add:
- selenium-server-standalone-2.25.0
- EDriverServer_x64_2.25.2
- testng-6.0.1-nobsh-noguice
- log4j-1.2.12

Reported by kyrylo.keis on 2012-07-26 15:12:41


- _Attachment: [Simple.zip](https://storage.googleapis.com/google-code-attachments/selenium/issue-4320/comment-0/Simple.zip)_
@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Please note, that detailed logs are added to the project.

Reported by kyrylo.keis on 2012-07-26 15:14:31

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Hi,

i reproduced this issue at Vista+IE9 configuration.
With additional logging i find out that mostly iedriver hang after processing WM_CREATE
- method IECommandExecutor::OnCreate is successfully completed but nothing happended
after that.

From my point, reason is that COM (IEdriver uses it) doesn't support multi thread.

Reported by a.u.savchuk on 2012-07-29 11:10:10

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Reported by barancev on 2012-08-02 19:24:24

  • Labels added: Component-WebDriver, Browser-IE

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Has this issue been resolved? We are facing issues with parallel runs with testng-6.8
which was working fine with 6.3.1 , especially wrt test.xml has <classes> vs <packages>
- packages doesn't work

Reported by sridharev on 2012-09-25 22:11:06

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

This issue has been closed by r17974.

Reported by james.h.evans.jr on 2012-10-16 22:32:42

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Reported by barancev on 2012-10-17 12:11:01

  • Status changed: Fixed
  • Labels removed: Status-Untriaged

@lukeis
Copy link
Member Author

lukeis commented Mar 3, 2016

Reported by luke.semerau on 2015-09-17 18:15:52

  • Labels added: Restrict-AddIssueComment-Commit

@lukeis lukeis closed this as completed Mar 3, 2016
@SeleniumHQ SeleniumHQ locked and limited conversation to collaborators Mar 4, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant