Actions

Difference between revisions of "Testing Joomla! With WebTest - Environment Setup"

From Joomla! Documentation

m
(Repository)
 
(7 intermediate revisions by one user not shown)
Line 1: Line 1:
This page will hold documentation on using [http://webtest.canoo.com WebTest] to create test suites for Joomla!
+
This page will hold documentation on using [http://webtest.canoo.com WebTest] to setup a test environment for test suites for Joomla!
  
== Functional Testing ==
 
See [http://en.wikipedia.org/wiki/Functional_Testing System Testing]
 
 
=== Smoke Tests ===
 
The smoke tests shall make sure, that the very basic functionality of a new Joomla! installation is working. This means, a smoke test will verify the availability of menus, pages or other elements.
 
 
The successfully executed smoke tests provide the entry criteria for the regression testes. However, there is no clearly defined border between regression and functional tests.
 
 
=== Regression Tests ===
 
Regression tests are generally written against requirements and/or stories, which define the functionality and behavior of a system.
 
 
If a project is missing these specifications it can be helpful to write the regression tests against stories. These stories describe basic use cases.
 
 
The regression test with WebTest will be based on stories. These shall be simple stories such as:
 
 
* Add a new section
 
* Add a new category to the section
 
* Add a new article to the section and category
 
* Make the article visible on the frontpage
 
 
These stories can be extended over time, but will give the possibility to grow easily.
 
  
 
== Canoo WebTest ==
 
== Canoo WebTest ==
Line 48: Line 27:
  
 
=== Prerequisite ===
 
=== Prerequisite ===
 +
* A platform that is able to run Java.
 +
* An installed [http://java.sun.com JDK] version 5 or higher.
  
=== Installation ===
+
=== Installation & Configuration ===
 
+
* todo
=== Configuration ===
+
  
 
== Test Suite ==
 
== Test Suite ==
 +
The testing code is part of the Joomla! code.
  
 
=== Repository ===
 
=== Repository ===
 +
The testing repository for the WebTest test suite can be found here:
 +
 +
* [http://joomlacode.org/svn/joomla/testing/trunk/1.5/functionaltest/webtest/ http://joomlacode.org/svn/joomla/testing/trunk/1.5/functionaltest/webtest/]
 +
* [http://joomlacode.org/svn/joomla/testing/trunk/1.6/functionaltest/webtest/ http://joomlacode.org/svn/joomla/testing/trunk/1.6/functionaltest/webtest/]
 +
 +
 +
Note: If a login mask comes up, use </br>
 +
:User: anonymous </br>
 +
:Password: <empty>
  
 
=== Structure ===
 
=== Structure ===
 +
The WebTest test suite is organized in smoke tests and regression tests.
  
 
=== Test Execution ===
 
=== Test Execution ===
 +
The test suite can be executed in different ways. The easiest way is to call it as follows
 +
 +
* webtest -Durl=<URL> -Dusername=<USERNAME> -Dpasswd=<PASSWORD>
 +
 +
whereas
 +
 +
* URL is the URL to the administrator page
 +
* USERNAME is the user name of the administrator
 +
* PASSWORD is the password of the administrator
 +
 +
E.g.:
 +
<pre>webtest -Durl=http://www.mydomain.com/administrator -Dusername=Admin -Dpasswd=1234</pre>
  
=== Reports ===
+
'''Note: The user name, password will only be used by WebTest on the machine you are executing the test suite. But the log files and reports can contain the user name and password and therefore you have to be careful exchanging them!'''
  
  
 +
[[Category:Development]]
 
[[Category:Testing]]
 
[[Category:Testing]]
 
[[Category:Bug Squad]]
 
[[Category:Bug Squad]]

Latest revision as of 15:32, 13 December 2009

This page will hold documentation on using WebTest to setup a test environment for test suites for Joomla!


Contents

Canoo WebTest

Canoo WebTest is a free Open Source tool for automated testing of web applications. Here you can find a short overview of WebTest characteristics.

To get a first impression, you can watch the following screencast:

Screencast WebTest CreateFirstWebTestProject.png

Creating a first WebTest project.

Prerequisite

  • A platform that is able to run Java.
  • An installed JDK version 5 or higher.
  • Ant version 1.7.0 or newer (optional). WebTests distribution contains the necessary part from ant 1.7.0 ready to run
  • A tool to unzip.

See here.

Installation & Configuration

See here.

Eclipse

Eclipse is an open source community, whose projects are focused on building an open development platform comprised of extensible frameworks, tools and run times for building, deploying and managing software across the lifecycle. For more details, see here.

Prerequisite

  • A platform that is able to run Java.
  • An installed JDK version 5 or higher.

Installation & Configuration

  • todo

Test Suite

The testing code is part of the Joomla! code.

Repository

The testing repository for the WebTest test suite can be found here:


Note: If a login mask comes up, use

User: anonymous
Password: <empty>

Structure

The WebTest test suite is organized in smoke tests and regression tests.

Test Execution

The test suite can be executed in different ways. The easiest way is to call it as follows

  • webtest -Durl=<URL> -Dusername=<USERNAME> -Dpasswd=<PASSWORD>

whereas

  • URL is the URL to the administrator page
  • USERNAME is the user name of the administrator
  • PASSWORD is the password of the administrator

E.g.:

webtest -Durl=http://www.mydomain.com/administrator -Dusername=Admin -Dpasswd=1234

Note: The user name, password will only be used by WebTest on the machine you are executing the test suite. But the log files and reports can contain the user name and password and therefore you have to be careful exchanging them!