Difference between revisions of "System Tests Working Group"

From Joomla! Documentation

(10 intermediate revisions by 2 users not shown)
Line 3: Line 3:
  
 
* Puneet Kala (Working Group Coordinator)
 
* Puneet Kala (Working Group Coordinator)
* Javier Gómez (PLT liaison)
+
* Javier Gómez (PLT liaison: javier.gomez at commmunity.joomla.org)
 
* Kshitij Sharma
 
* Kshitij Sharma
 
* Tanaporn Pantuprecharat
 
* Tanaporn Pantuprecharat
 
* Mark Dexter
 
* Mark Dexter
 +
* Milton Bryant
  
 +
== Goals ==
 +
* to improve the Quality of Joomla CMS software
 +
* to create learning material about "how to test" for the Joomla Community
  
 
== Roadmap==
 
== Roadmap==
Line 19: Line 23:
  
 
=== Improvements in current tests ===
 
=== Improvements in current tests ===
* '''(done)''' Create an Assert in all test that makes sure there is not any warning, even if the test passes. See this example:
+
* '''(done)''' Create an Assert in all test that makes sure there is not any warning, even if the test passes. See this example:{{-}}[[File:System tests-example of warning.png|450px]]{{-}}
[[File:System tests-example of warning.png|thumbnail]]  
 
 
* '''(done)''' Create a graphical test coverage report  
 
* '''(done)''' Create a graphical test coverage report  
* Move to Codeception framework
+
* Move to Codeception framework. Some tests are being done here: https://github.com/joomla-projects/com_localise/tree/codeception#testing-with-codeception
 
* Create a Best Practice in System testing Joomla! extensions with https://github.com/joomla-projects/com_localise component
 
* Create a Best Practice in System testing Joomla! extensions with https://github.com/joomla-projects/com_localise component
 +
 +
=== Travis ===
 +
We have Travis complaining about this:
 +
<source lang="php">
 +
E.................E.........
 +
I'm sorry but your test run exceeded 50.0 minutes.
 +
One possible solution is to split up your test run.
 +
</source>
 +
We need to find a solution, for example: http://blog.travis-ci.com/2012-11-28-speeding-up-your-tests-by-parallelizing-them/
 +
 +
=== Test Joomla extension ===
 +
The goal of this project is to test com_localise extension https://github.com/joomla-projects/com_localise/ to create a proof of concept and documentation to teach others how to test their Joomla Extensions.
  
 
== Documents ==
 
== Documents ==
[[Writing_System_Tests_for_Joomla!_-_Part_1|Writing System Tests for Joomla!]]
+
* [[Writing_System_Tests_for_Joomla!_-_Part_1|Writing System Tests for Joomla!]]
 +
* GSOC-Webdriver_system_tests_for_CMS repository: https://github.com/joomla-projects/GSOC-Webdriver_system_tests_for_CMS
 +
 
 +
== Projects ==
 +
* com_localise: https://github.com/joomla-projects/com_localise/tree/codeception project for testing a Joomla extension with Codeception framework adding parallel testing and Saucelabs or BrowserStack integration.
 +
* https://github.com/joomla-projects/Codeception/ fork of original Codeception project for bug fixing and contributing to the main project.
 +
 
 +
[[Category:Working Groups]]
 +
[[Category:PLT]]

Revision as of 02:47, 26 August 2014

Team Members[edit]

  • Puneet Kala (Working Group Coordinator)
  • Javier Gómez (PLT liaison: javier.gomez at commmunity.joomla.org)
  • Kshitij Sharma
  • Tanaporn Pantuprecharat
  • Mark Dexter
  • Milton Bryant

Goals[edit]

  • to improve the Quality of Joomla CMS software
  • to create learning material about "how to test" for the Joomla Community

Roadmap[edit]

The next steps in this team are:

GSoC 2014[edit]

Sauce Labs integration[edit]

  • Test SauceLabs and Travis integration with the repo at GitHub: https://saucelabs.com/opensource/travis. It will require the use of Paratest, to run several tests at the same time, otherwise it will take too long (more than 8 hours just the /Adminitrator/ tests)

Improvements in current tests[edit]

Travis[edit]

We have Travis complaining about this:

E.................E.........
I'm sorry but your test run exceeded 50.0 minutes. 
One possible solution is to split up your test run.

We need to find a solution, for example: http://blog.travis-ci.com/2012-11-28-speeding-up-your-tests-by-parallelizing-them/

Test Joomla extension[edit]

The goal of this project is to test com_localise extension https://github.com/joomla-projects/com_localise/ to create a proof of concept and documentation to teach others how to test their Joomla Extensions.

Documents[edit]

Projects[edit]