Difference between revisions of "System Tests Working Group"
From Joomla! Documentation
Javiparati (talk | contribs) |
Javiparati (talk | contribs) |
||
(10 intermediate revisions by 2 users not shown) | |||
Line 3: | Line 3: | ||
* Puneet Kala (Working Group Coordinator) | * Puneet Kala (Working Group Coordinator) | ||
− | * Javier Gómez (PLT liaison) | + | * Javier Gómez (PLT liaison: javier.gomez at commmunity.joomla.org) |
* Kshitij Sharma | * Kshitij Sharma | ||
* Tanaporn Pantuprecharat | * Tanaporn Pantuprecharat | ||
* Mark Dexter | * Mark Dexter | ||
+ | * Milton Bryant | ||
+ | == Goals == | ||
+ | * to improve the Quality of Joomla CMS software | ||
+ | * to create learning material about "how to test" for the Joomla Community | ||
== Roadmap== | == Roadmap== | ||
Line 19: | Line 23: | ||
=== Improvements in current tests === | === Improvements in current tests === | ||
− | * '''(done)''' Create an Assert in all test that makes sure there is not any warning, even if the test passes. See this example: | + | * '''(done)''' Create an Assert in all test that makes sure there is not any warning, even if the test passes. See this example:{{-}}[[File:System tests-example of warning.png|450px]]{{-}} |
− | [[File:System tests-example of warning.png| | ||
* '''(done)''' Create a graphical test coverage report | * '''(done)''' Create a graphical test coverage report | ||
− | * Move to Codeception framework | + | * Move to Codeception framework. Some tests are being done here: https://github.com/joomla-projects/com_localise/tree/codeception#testing-with-codeception |
* Create a Best Practice in System testing Joomla! extensions with https://github.com/joomla-projects/com_localise component | * Create a Best Practice in System testing Joomla! extensions with https://github.com/joomla-projects/com_localise component | ||
+ | |||
+ | === Travis === | ||
+ | We have Travis complaining about this: | ||
+ | <source lang="php"> | ||
+ | E.................E......... | ||
+ | I'm sorry but your test run exceeded 50.0 minutes. | ||
+ | One possible solution is to split up your test run. | ||
+ | </source> | ||
+ | We need to find a solution, for example: http://blog.travis-ci.com/2012-11-28-speeding-up-your-tests-by-parallelizing-them/ | ||
+ | |||
+ | === Test Joomla extension === | ||
+ | The goal of this project is to test com_localise extension https://github.com/joomla-projects/com_localise/ to create a proof of concept and documentation to teach others how to test their Joomla Extensions. | ||
== Documents == | == Documents == | ||
− | [[Writing_System_Tests_for_Joomla!_-_Part_1|Writing System Tests for Joomla!]] | + | * [[Writing_System_Tests_for_Joomla!_-_Part_1|Writing System Tests for Joomla!]] |
+ | * GSOC-Webdriver_system_tests_for_CMS repository: https://github.com/joomla-projects/GSOC-Webdriver_system_tests_for_CMS | ||
+ | |||
+ | == Projects == | ||
+ | * com_localise: https://github.com/joomla-projects/com_localise/tree/codeception project for testing a Joomla extension with Codeception framework adding parallel testing and Saucelabs or BrowserStack integration. | ||
+ | * https://github.com/joomla-projects/Codeception/ fork of original Codeception project for bug fixing and contributing to the main project. | ||
+ | |||
+ | [[Category:Working Groups]] | ||
+ | [[Category:PLT]] |
Revision as of 02:47, 26 August 2014
Team Members[edit]
- Puneet Kala (Working Group Coordinator)
- Javier Gómez (PLT liaison: javier.gomez at commmunity.joomla.org)
- Kshitij Sharma
- Tanaporn Pantuprecharat
- Mark Dexter
- Milton Bryant
Goals[edit]
- to improve the Quality of Joomla CMS software
- to create learning material about "how to test" for the Joomla Community
Roadmap[edit]
The next steps in this team are:
GSoC 2014[edit]
Sauce Labs integration[edit]
- Test SauceLabs and Travis integration with the repo at GitHub: https://saucelabs.com/opensource/travis. It will require the use of Paratest, to run several tests at the same time, otherwise it will take too long (more than 8 hours just the /Adminitrator/ tests)
Improvements in current tests[edit]
- (done) Create an Assert in all test that makes sure there is not any warning, even if the test passes. See this example:450px
- (done) Create a graphical test coverage report
- Move to Codeception framework. Some tests are being done here: https://github.com/joomla-projects/com_localise/tree/codeception#testing-with-codeception
- Create a Best Practice in System testing Joomla! extensions with https://github.com/joomla-projects/com_localise component
Travis[edit]
We have Travis complaining about this:
E.................E.........
I'm sorry but your test run exceeded 50.0 minutes.
One possible solution is to split up your test run.
We need to find a solution, for example: http://blog.travis-ci.com/2012-11-28-speeding-up-your-tests-by-parallelizing-them/
Test Joomla extension[edit]
The goal of this project is to test com_localise extension https://github.com/joomla-projects/com_localise/ to create a proof of concept and documentation to teach others how to test their Joomla Extensions.
Documents[edit]
- Writing System Tests for Joomla!
- GSOC-Webdriver_system_tests_for_CMS repository: https://github.com/joomla-projects/GSOC-Webdriver_system_tests_for_CMS
Projects[edit]
- com_localise: https://github.com/joomla-projects/com_localise/tree/codeception project for testing a Joomla extension with Codeception framework adding parallel testing and Saucelabs or BrowserStack integration.
- https://github.com/joomla-projects/Codeception/ fork of original Codeception project for bug fixing and contributing to the main project.