This Bugzilla instance is a read-only archive of historic NetBeans bug reports. To report a bug in NetBeans please follow the project's instructions for reporting issues.

Bug 249654 - Protractor: Misinterpreted results when running in multiple browsers
Summary: Protractor: Misinterpreted results when running in multiple browsers
Status: VERIFIED FIXED
Alias: None
Product: javascript
Classification: Unclassified
Component: Testing (show other bugs)
Version: 8.1
Hardware: PC Linux
: P3 normal (vote)
Assignee: Theofanis Oikonomou
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2015-01-06 08:55 UTC by Vladimir Riha
Modified: 2015-01-12 07:39 UTC (History)
0 users

See Also:
Issue Type: DEFECT
Exception Reporter:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Vladimir Riha 2015-01-06 08:55:08 UTC
Please try following:
 - clone and open [1] project in IDE, invoke NPM install
 - set Protractor configuration in project properties
    - conf. file is test/protractor-conf.js
    - protractor binary set to your globally installed protractor (e.g. /usr/local/bin/protractor ), see issue 249653
 - open test/protractor-conf.js and replace the capabilities property with

  multiCapabilities: [{
  'browserName': 'chrome'
}, {
  'browserName': 'firefox'
}],

 - run selenium tests

=> once the tests are finished, Test Results window contains only results from one browser, not from both. The output window contains:


"/usr/local/bin/node" "/usr/local/bin/protractor" "/home/vriha/Downloads/netbeans/webcommon/protractor/netbeans-configuration.js"
WARNING - chromeOnly is deprecated. Use directConnect
WARNING - You have specified both capabilites and multiCapabilities. This will result in capabilities being ignored
[launcher] Running 2 instances of WebDriver
....F.....
------------------------------------
[chrome #1] PID: 12922
[chrome #1] Specs: /home/vriha/NetBeansProjects/AngularJSPhoneCat1/test/e2e/scenarios.js
[chrome #1] 
[chrome #1] WARNING - chromeOnly is deprecated. Use directConnect
[chrome #1] Using ChromeDriver directly...
[chrome #1] /phones
[chrome #1] 
[chrome #1] 
[chrome #1] 
[chrome #1] Failures:
[chrome #1] 
[chrome #1]   1) PhoneCat App Phone list view should render phone specific links
[chrome #1]    Message:
[chrome #1]      Expected undefined to be '/phones/nexus-s'.
[chrome #1]    Stacktrace:
[chrome #1]      Error: Expected undefined to be '/phones/nexus-s'.
[chrome #1]     at /home/vriha/NetBeansProjects/AngularJSPhoneCat1/test/e2e/scenarios.js:72:35
[chrome #1] 
[chrome #1] Finished in 18.101 seconds
[chrome #1] 7 tests, 11 assertions, 1 failure
[chrome #1] 

[launcher] 1 instance(s) of WebDriver still running
F...
------------------------------------
[firefox #2] PID: 12924
[firefox #2] Specs: /home/vriha/NetBeansProjects/AngularJSPhoneCat1/test/e2e/scenarios.js
[firefox #2] 
[firefox #2] WARNING - chromeOnly is deprecated. Use directConnect
[firefox #2] Using FirefoxDriver directly...
[firefox #2] /phones
[firefox #2] 
[firefox #2] 
[firefox #2] 
[firefox #2] Failures:
[firefox #2] 
[firefox #2]   1) PhoneCat App Phone list view should render phone specific links
[firefox #2]    Message:
[firefox #2]      Expected undefined to be '/phones/nexus-s'.
[firefox #2]    Stacktrace:
[firefox #2]      Error: Expected undefined to be '/phones/nexus-s'.
[firefox #2]     at /home/vriha/NetBeansProjects/AngularJSPhoneCat1/test/e2e/scenarios.js:72:35
[firefox #2] 
[firefox #2] Finished in 16.727 seconds
[firefox #2] 7 tests, 11 assertions, 1 failure
[firefox #2] 

[launcher] 0 instance(s) of WebDriver still running
[launcher] chrome #1 failed 1 test(s)
[launcher] firefox #2 failed 1 test(s)
[launcher] overall: 2 failed spec(s)
[launcher] Process exited with error code 1
Done.



Thank you


Product Version: NetBeans IDE Dev (Build 201501060001)
Java: 1.7.0_71; Java HotSpot(TM) Client VM 24.71-b01
Runtime: Java(TM) SE Runtime Environment 1.7.0_71-b14
System: Linux version 3.13.0-35-generic running on i386; UTF-8; en_US (nb)
Comment 1 Theofanis Oikonomou 2015-01-07 22:09:52 UTC
Changeset: 2626b739ddd6
Author:    Theofanis Oikonomou <theofanis@netbeans.org>
Date:      2015-01-07 23:08
Message:
Comment 2 Theofanis Oikonomou 2015-01-07 22:12:56 UTC
browser info should be available for every test suite eg

[chrome] PhoneCat App Phone
    -> list view should render phone specific links
...
[firefox] PhoneCat App Phone
    -> list view should render phone specific links

Thanks
Comment 3 Quality Engineering 2015-01-09 03:38:08 UTC
Integrated into 'main-silver', will be available in build *201501090001* on http://bits.netbeans.org/dev/nightly/ (upload may still be in progress)

Changeset: http://hg.netbeans.org/main-silver/rev/2626b739ddd6
User: Theofanis Oikonomou <theofanis@netbeans.org>
Log: Task #249654 - Protractor: Misinterpreted results when running in multiple browsers
Comment 4 Vladimir Riha 2015-01-09 09:30:44 UTC
Thank you, verified


Product Version: NetBeans IDE Dev (Build 201501090001)
Java: 1.7.0_67; Java HotSpot(TM) Client VM 24.65-b04
Runtime: Java(TM) SE Runtime Environment 1.7.0_67-b01
System: Linux version 3.13.0-35-generic running on i386; UTF-8; en_US (nb)
Comment 5 Vladimir Riha 2015-01-12 07:39:35 UTC
Fanis, it maybe caused regression for single browser setup, see issue #249738. Thank you