m (→Test Execution)
m (Testing Joomla! With WebTest moved to Testing Joomla! With WebTest - Environment Setup: Splitting the article into two new articles: - Environment Setup - Test Execution)
This page will hold documentation on using WebTest to create test suites for Joomla!
See System Testing
The smoke tests shall make sure, that the very basic functionality of a new Joomla! installation is working. This means, a smoke test will verify the availability of menus, pages or other elements.
The successfully executed smoke tests provide the entry criteria for the regression testes. However, there is no clearly defined border between regression and functional tests.
Regression tests are generally written against requirements and/or stories, which define the functionality and behavior of a system.
If a project is missing these specifications it can be helpful to write the regression tests against stories. These stories describe basic use cases.
The regression test with WebTest will be based on stories. These shall be simple stories such as:
These stories can be extended over time, but will give the possibility to grow easily.
To get a first impression, you can watch the following screencast:
Eclipse is an open source community, whose projects are focused on building an open development platform comprised of extensible frameworks, tools and run times for building, deploying and managing software across the lifecycle. For more details, see here.
The testing code is part of the Joomla! code.
The testing repository for the WebTest test suite can be found here:
Note: If a login mask comes up, use
The WebTest test suite is organized in smoke tests and regression tests.
The test suite can be executed in different ways. The easiest way is to call it as follows
webtest -Durl=http://www.mydomain.com/administrator -Dusername=Admin -Dpasswd=1234
Note: The user name, password will only be used by WebTest on the machine you are executing the test suite. But the log files and reports can contain the user name and password and therefore you have to be careful exchanging them!