This page describes automated tests for a Murano project:
Murano project has separate CI server, which runs tests for all commits and verifies that new code does not break anything.
Murano CI uses OpenStack QA cloud for testing infrastructure.
Murano CI url: https://murano-ci.mirantis.com/jenkins/ Anyone can login to that server, using launchpad credentials.
There you can find each job for each repository: one for the murano and another one for murano-dashboard.
Other jobs allow to build and test Murano documentation and perform another useful work to support Murano CI infrastructure. All jobs are run on fresh installation of operating system and all components are installed on each run.
The murano project has a web user interface and all possible user scenarios should be tested. All UI tests are located at the https://git.openstack.org/cgit/openstack/murano-dashboard/tree/muranodashboard/tests/functional.
Automated tests for the Murano web UI are written in Python using special Selenium library. This library is used to automate web browser interaction from Python. See official Selenium documentation for details.
Install the Python module called nose using either the easy_install nose or pip install nose command. This will install the nose libraries, as well as the nosetests script, which you can use to automatically discover and run tests.
Install external Python libraries, which are required for the Murano web UI tests: testtools and selenium.
Verify that you have one of the following web browsers installed:
Mozilla Firefox 46.0
Note
If you do not have firefox package out of the box, install and remove it. Otherwise, you will need to install dependant libraries manually. To downgrade Firefox:
apt-get remove firefox
wget https://ftp.mozilla.org/pub/firefox/releases/46.0/linux-x86_64/en-US/firefox-46.0.tar.bz2
tar -xjf firefox-46.0.tar.bz2
rm -rf /opt/firefox
mv firefox /opt/firefox46
ln -s /opt/firefox46/firefox /usr/bin/firefox
Google Chrome
To run the tests on a remote server, configure the remote X server. Use VNC Software to see the test results in real-time.
Specify the display environment variable:
$DISPLAY=: <value>
Configure remote X server and VNC Software by typing:
apt-get install xvfb xfonts-100dpi xfonts-75dpi xfonts-cyrillic xorg dbus-x11
"Xvfb -fp "/usr/share/fonts/X11/misc/" :$DISPLAY -screen 0 "1280x1024x16" &"
apt-get install --yes x11vnc
x11vnc -bg -forever -nopw -display :$DISPLAY -ncache 10
sudo iptables -I INPUT 1 -p tcp --dport 5900 -j ACCEPT
To download and run the tests:
Verify that all additional components has been installed.
Clone the murano-dashboard git repository:
git clone git://git.openstack.org/openstack/murano-dashboard*
Change the default settings:
Specify the Murano Repository URL variable for Horizon local settings in murano_dashboard/muranodashboard/local/local_settings.d/_50_murano.py:
MURANO_REPO_URL = 'http://localhost:8099'
Copy muranodashboard/tests/functional/config/config.conf.sample to config.conf.
Set appropriate URLs and credentials for your OpenStack lab. Only Administrator user are appropriate.
[murano]
horizon_url = http://localhost/dashboard
murano_url = http://localhost:8082
user = ***
password = ***
tenant = ***
keystone_url = http://localhost:5000/v3
All tests are kept in sanity_check.py and divided into 10 test suites:
To specify which tests/suite to run:
In case of successful execution, you should see something like this:
In case of failure, the folder with screenshots of the last operation of tests that finished with errors would be created. Itis located in muranodashboard/tests/functional folder.
There are also a number of command line options that can be used to control the test execution and generated outputs. For more details about nosetests, type:
All Murano services have tempest-based automated tests, which allow to verify API interfaces and deployment scenarios. Tempest tests for Murano are located at https://git.openstack.org/cgit/openstack/murano/tree/murano/tests/functional.
The following Python files contains basic tests suites for different Murano components.
Murano API tests are run on devstack gate and located at https://git.openstack.org/cgit/openstack/murano/tree/murano/tests/functional/api.
Murano Engine Tests are run on murano-ci at https://git.openstack.org/cgit/openstack/murano/tree/murano/tests/functional/engine:
Murano CLI tests are currently in the middle of creation. The current scope is read only operations on a cloud that are hard to test through unit tests. All tests have description and execution steps in there docstrings.