Commit Graph

45 Commits (5ac5e46ee2954fdff7a32fa5df2923e99744efb7)

Author SHA1 Message Date
Dmytro Nochevnov 10a8006af7
Exclude flaky selenium tests from execution by default (#12296)
* Exclude flaky selenium tests from execution by default

Signed-off-by: Dmytro Nochevnov <dnochevn@redhat.com>

* Fix e2e selenium tests documentation

Signed-off-by: Dmytro Nochevnov <dnochevn@redhat.com>

* Restore CreateWorkspaceFromNodeStackTest test

Signed-off-by: Dmytro Nochevnov <dnochevn@redhat.com>
2018-12-28 11:50:49 +01:00
Dmytro Nochevnov 562e105391
Get suite from 'target/test-classes/suite' directory (#11847)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-11-06 18:30:58 +02:00
Dmytro Nochevnov 11a20f1f69
Do not execute selenium tests under repair by default (#11689)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-11-02 14:37:22 +02:00
Dmytro Nochevnov 97c703c719
Store logs of test workspaces created by E2E tests from Dashboard (#11542)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-10-10 15:52:24 +00:00
Dmytro Nochevnov 1bbdee3010
Stores logs of test workspaces which do not have RUNNING status (#11233)
* Store logs of workspaces which do not have RUNNING status
* Handle exception when verifying condition in WaitUtils.waitSuccessCondition()
* Do not wait 6 minutes if start of test workspace failed
* Suppress displaying removing selenium containers ids
* Suppress warnings if it's impossible to get failed test workspace logs
* Get read of AbstractTestWorkspaceProvider; remake WorkspaceTemplate to enum
* Use single command to stop and remove selenium docker containers

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-09-18 18:28:03 +03:00
Dmytro Nochevnov e37425a0ca
Update selenium chrome-node to 3.14.0 (#10869)
* Update selenium chrome-node to 3.14.0
* Fix ContributeTabTest to close notification popup
* Stabilize getting list of git markers in selenium tests
* Fix attaching links to test report in case of tests successed
* Fix StaleElement exception when closing notification popup, and increase waiting on its closing
* Fix formatting
* Fix path to che_server_logs.zip
* Close all existed notification panels
* Fix DownloadProjectTest
* Fix CheckGeneratingMavenArchetypeTest
* Fix FindUsagesBaseOperationTest
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-09-05 16:00:20 +00:00
Dmytro Nochevnov 38e7e90efd
Various changes of Eclipse Che selenium tests result handling (#11049)
* Attach screenshots and links into failsafe-report.html in alphabetical order

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Prevent "Workspace with id 'null' doesn't exist" error

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Do not treat SeleniumTestHandler error as test failure

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Capture test result objects in case of configuration method error

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Capture html dumps and logs from all opened windows

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Add link to Che server logs into E2E test report

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Add millis into test result resources files

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-09-04 14:42:32 +00:00
Dmytro Nochevnov cc06caa501
Make E2E tests screenshots available in report on CI (#10939)
* Make E2E tests screenshots available in report on CI

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Add links to htmldumps, webdriver and workspace logs into the failsafe-report.html

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>

* Fix style for screenshot displaying in the report

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-08-30 17:38:42 +03:00
Dmytro Nochevnov 449d884a38
Fix selenium test groups management (#10791)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-08-19 17:47:52 +03:00
Mykhailo Kuznietsov 07263f1e30
Fix license header text (#10629) 2018-08-02 11:18:04 +03:00
Igor Ohrimenko d28fdd46d2 Selenium: Fix selenium tests after updating licenses headers (#10627)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-08-01 18:35:59 +03:00
Igor Ohrimenko 5eb240af0d
Selenium: Fix unexpected fail of "che-multiuser-master-ocp-oauth-test" and "che-multiuser-master-ocp-recreate-strategy-test" jobs (#10438) 2018-07-16 19:28:06 +03:00
Maxim Musienko fc91a438ba Add K8S infrastructure for selenium tests (#10384)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-07-13 17:38:10 +03:00
Dmytro Nochevnov d879c3faf2
Move test user creating from selenium tests launcher to framework (#9357)
* Treat  user as a constant
* Avoid error because of outdated auth token of test user
* Create test user from selenium framework
* Add test user providers
* Remove test user injection from DashboardAccount page object
* Fix check up on Che launch location on OpenShift
* Fix injection of test user credentials
* Fix check if Che is run locally
* Remove TestUser on selenium tests PreDestroy phase

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-04-16 17:52:19 +02:00
Dmytro Nochevnov 14748dc483
Add ability to exclude github-specific selenium tests from test execution (#9069)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-03-14 11:31:22 +02:00
Maxim Musienko d39ca3e80b Store webdriver console and network logs of failed tests (#8926)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-03-05 11:03:51 +00:00
Dmytro Nochevnov be48da761b
Fix creation of test users for selenium testing (#8878)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-02-22 13:27:03 +00:00
Dmytro Nochevnov 05886de269
Save meaningful logs of failed tests workspaces in the target directory (#8803)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-02-16 09:54:58 +00:00
Dmytro Nochevnov a6010e55cd
Renew URLs of CI servers to compare local selenium testing results (#8541)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-01-31 14:12:23 +00:00
Dmytro Nochevnov e7a5e977da
Avoid removal of non-test workspaces at the cleanup environment stage of selenium testing (#8481)
* Define default values of che offline tokens in selenium tests launcher
* Avoid removal of test from CheOneThreadTestsSuite.xml from running tests list
* Do not remove all workspaces of test user at shutdown step
* Restore removal ot test workspace in CheckSimpleGwtAppTest
* Restore removal of test workspaces after their startup were failed
* Move checkWebDriverSessionCreation() to the constructor of SeleniumTestHandler

Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-01-26 17:40:35 +02:00
Dmytro Nochevnov 8919144ba6
Adapt selenium tests to work with openshift.io REST API (#8396)
* Read cliend_id from keycloak settings
* Authenticate on RH Che 6 server by using offline token
* Set offline token to be specific for test user
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-01-22 13:07:38 +00:00
Dmytro Nochevnov 67f405236b
Add ability to add several tests users to selenium tests (#8342)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2018-01-18 17:17:54 +02:00
Dmytro Nochevnov b78c2d93d4
Fix output message in selenium tests (#8103)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2017-12-29 13:48:05 +02:00
Dmytro Nochevnov 78c2e5762a
Add ability to mark infrastructure-specific selenium tests (#8057) 2017-12-27 20:02:22 +02:00
Roman Iuvshyn 98bc582ad6
fix keycloak containerID evaluation in webdriver.sh (#8054) 2017-12-27 11:06:44 +02:00
Dmytro Nochevnov a6efd2d986
Fix github-specific selenium tests after adding support of Identity brokering mechanism of Keycloak (#7999)
* Avoid redundant revoking of github token in selenium tests
* Fix clean up after github-related tests execution; remove ssh-key of github.com
* Remove test user which has been created by selenium tests launcher
2017-12-21 16:30:22 +02:00
Roman Iuvshyn 758d400e5f
Clean up after merge che6 to master (#7979) 2017-12-20 17:28:34 +02:00
Dmytro Nochevnov db70d737bf
Create test user at start of selenium tests execution (#7965)
* Create test user at start of selenium tests execution
* Rename 'CHE_SELENIUM_INFRASTRUCTURE' to 'CHE_INFRASTRUCTURE' in selenium tests
2017-12-20 12:50:24 +00:00
Dmytro Nochevnov 16d82d0c59
Adapt webdriver.sh to Multiuser Che; add ability to set rerun attempts (#7823)
* Move --multiuser parameter from selenium-test.sh to webdriver.sh
* Compare selenium testing results with multiuser CI job
* Differ 'CI job' from 'build' in terms of comparasion of test results
* Add an ability to set exact number of rerun of selenium tests
2017-12-12 18:20:39 +02:00
Dmytro Nochevnov 4f8e34df87
Remove separation of selenium tests on stable/unstable/failed (#7750) 2017-12-06 15:46:17 +00:00
Anatoliy Bazko 62611aee78
CHE-6846: Suspend breakpoint policy (#7347) 2017-11-16 07:13:43 +00:00
Dmytro Nochevnov 84eb3b6f61
Fix 'Auth fail' error in github-related selenium tests (#7254)
* Handle NotFoundException when ssh-key to remove is absent
* Fix multiple call of beforeInvocation method of SeleniumTestHandler
* Extract code to upload ssh-key into github.com in tests
* Don't run CheOneThreadTestsSuite.xml in unstable test execution
* Move hook to the constructor of SeleniumTestHandler
* Add html dumps into the selenium tests report
* Remove useless code from rerun function of webdriver.sh
* Rewrite AddSshKeyForGitHubTest to not duplicate other tests
2017-11-13 10:18:12 +00:00
Anatoliy Bazko 40ff60038d
CHE-6845: Disable breakpoints (#7204) 2017-11-07 09:32:08 +00:00
Anatoliy Bazko b9f3374a22
webdriver.sh respects system properties (#7142) 2017-11-03 07:51:48 +00:00
Dmytro Nochevnov bda6d136c3 Add ability to setup test workspace pool size in selenium tests (#6853) 2017-10-20 17:46:05 +02:00
Artem Zatsarynnyi 22c21265aa Merge branch 'master' into spi 2017-10-11 10:16:43 +03:00
Dmytro Nochevnov 03d5e47b4d Fix URL with selenium test report on CI (#6644)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2017-10-10 10:20:07 +03:00
Sergii Kabashniuk ee01b2998f Multi-user Eclipse Che (#6441)
Multi-user Eclipse Che (#6441)
#### How to run it.
```docker run -it -e CHE_MULTIUSER=true -e CHE_HOST=<your ip> -e CHE_KEYCLOAK_AUTH-SERVER-URL=http://<your ip>:5050/auth -v /var/run/docker.sock:/var/run/docker.sock -v ~/.che-multiuser:/data eclipse/che:nightly start --skip:pull --skip:nightly```
#### How to manage it
 - Keycloak configured with two realms. ```Master``` and ```che```. Also we have one user admin/admin in both realm. Admin user in master realm is  - super admin. 
-  Eclipse Che configured for che realm
- We enabled user registration in ```Che``` realm
#### Known limitation
 - swagger would not work. We need to upgrade a version. to support openid authentification https://github.com/eclipse/che/issues/6015
- It's working on local docker. We are going to provide scalable version based on OpenShift on next versions.
- Invitation of non-existent users to Eclipse Che organization https://github.com/eclipse/che/issues/6335
#### How to run it when it is in a branch


To run an multiuser Che version, the following steps are required after building the branch:
 - Rebuild init, cli and che images (in the given sequence). To do that, proceed to folder _dockerfiles/<image_name>_ and run _build.sh_
 - Run Che in a  usual way using cli, with additional parameters:  `-e CHE_MULTIUSER=true` and `--skip:pull --skip:nightly`  
   Full command example:
   `docker run -it --rm -v /var/run/docker.sock:/var/run/docker.sock -v /home/user/.che:/data -e CHE_MULTIUSER=true eclipse/che-cli:nightly start --skip:pull --skip:nightly`
 - MacOS users may need to edit _che.env_ file in the data folder, changing `CHE_HOST` and `CHE_KEYCLOAK_AUTH__SERVER__URL` values to their specific IP.
 
When start is succeeded, the following docker containers should be created:  
 - che, exposing 8080 port;
 - che_keycloak, exposing 5050 port;  
 - che_postgres, exposing 5432 port;
2017-10-06 17:27:27 +03:00
Artem Zatsarynnyi 4bc18519db Merge branch 'che-multiuser' into spi 2017-10-05 16:30:22 +03:00
Ihor Okhrimenko 9844c2439c Change predefined host for start tests on the webdriver.sh to localhost 2017-10-03 15:11:19 +03:00
Artem Zatsarynnyi 81bce959ce Merge branch 'che-multiuser' into spi 2017-10-02 14:59:55 +03:00
Dmytro Nochevnov 178a0cfce1 Fix comparing selenium tests execution results with CI (#6477)
Signed-off-by: Dmytro Nochevnov <dnochevnov@codenvy.com>
2017-09-29 16:07:55 +03:00
Oleksandr Garagatyi a614b2c88d CHE-6083: Allow to specify Che port in selenium tests script
Add option --port=<che port> to webdriver.sj script to run tests against
Che deployed in Minishift.
Signed-off-by: Oleksandr Garagatyi <ogaragat@redhat.com>
2017-09-15 12:56:55 +03:00
Oleksandr Garagatyi 00cbcef263 CHE-6083: Refactor webdriver.sh script to simplify it
Moved all the code from script main body to its functions to simplify it.
Add set -e directive to prevent ignorance of possible bugs.
Signed-off-by: Oleksandr Garagatyi <ogaragat@redhat.com>
2017-09-15 12:56:55 +03:00
Anatoliy Bazko 3c9df76538 Add selenium tests (#5759)
* Add selenium tests
2017-08-22 11:24:25 +00:00