Introduction¶
Keyword-driven testing is a software testing methodology which uses keywords (or action words) to symbolize a functionality to be tested. This method separates the description of the tests from its implementation and therefore reduces the future maintenance time caused by changes in the AUT. In the case of GUI changes in the AUT, only very small changes or even no changes have to be completed in test case documentation. Some changes need to be applied to keyword documentation only.
Robot Framework is a test automation framework which utilizes the keyword-driven testing approach. Its advantage is that users can create new higher-level keywords from existing ones. To integrate the Squish GUI Testing tool with Robot Framework, the keywords library needs to be implemented with Python using the squishtest module.
As an example, the Qt AddressBook application was chosen, which ships with Squish. Using a similar approach, we can automate Java, Windows, Mac, iOS, Android and Web applications.
Test case¶
A test case can be defined in a plain text file with the txt extension. Test cases are constructed in test case tables and built from the available keywords. Keywords can be imported from test libraries or resource files (e.g. resource.txt). The first column in the test case table contains test case names (e.g. Add Entry, Empty AddressBook). The second column normally contains keyword names (e.g. New Addressbook, Add Entry), columns after the keyword name contain possible arguments for the specified keyword (e.g. Tom Paw tom@m.com 12345). Please note, keywords and arguments are tab separated. Additionally we can define test setup and teardown actions. A test setup is something that is executed before a test case, and a test teardown is executed after a test case. In the example below the Start AddressBook action is executed before every test case.
*** Settings ***
Documentation A test suite with two tests for addressbook.
...
... This test has a workflow that is created using keywords in
... the imported resource file.
Resource resource.txt
Test Setup Start AddressBook
*** Test Cases ***
Add Entry
New AddressBook
Add Entry Tom Paw tom@m.com 12345
Entries Should Be 1
Empty AddressBook
New AddressBook
Entries Should Be 0Keywords resource file¶
A resource file contains keywords definitions used in test cases. To define keywords we utilize low level keywords provided by the SquishLibrary.
*** Settings ***
Documentation A resource file with reusable keywords and variables.
...
... The system specific keywords created here form our own
... domain specific language. They utilize keywords provided
... by the imported SquishLibrary.
Library SquishLibrary
*** Variables ***
${WRAPPER} Qt
*** Keywords ***
Start AddressBook
Start Application addressbook ${WRAPPER}
New AddressBook
Click Button Address Book.New_QToolButton
Add Entry
[Arguments] ${forename} ${surname} ${mail} ${phone}
Click Button names.AddressBook_Add_QToolButton
Enter names.Forename_LineEdit ${forename}
Enter names.Surname_LineEdit ${surname}
Enter names.Email_LineEdit ${mail}
Enter names.Phone_LineEdit ${phone}
Click Button names.AddressBook_AddOK_QPushButton
Entries Should Be
[Arguments] ${num}
Property Should Be names.AddressBook_File_QTableWidget rowCount ${num}SquishLibrary¶
SquishLibrary is a static keyword library which utilise Python module squishtest. It allows us to use Squish API and Application Convenience API, in our example Qt Convenience API. This is initial version of SquishLibrary with a very limited functionality, presented here as an example to build your own SquishLibrary by extending it.
import names
import squishtest
class SquishLibrary:
""" This is initial version of Squish Library for Robot Framework"""
ROBOT_LIBRARY_SCOPE = 'TEST CASE'
def __init__(self):
pass
def start_application(self, aut, wrapper):
""" Starts AUT, args=(aut, wrapper) """
squishtest.setTestResult("xml3.2", "results.xml")
print "*INFO* Starting AUT: "+str(aut)+" with "+wrapper+" wrapper"
# Remove double quotes for setWrappersForApplication
if aut.startswith( '"' ):
aut = aut[1:]
if aut.endswith( '"' ):
aut = aut[0:-1]
squishtest.testSettings.setWrappersForApplication(aut, wrapper)
# Add double quotes for startApplication
if ' ' in aut:
aut = '"' + aut + '"'
squishtest.startApplication(aut)
def __LookupRealName__(self,name):
split = name.split('.')
module = sys.modules.get(split[0])
return module.__getattribute__(split[1])
def click_button(self, objName):
""" Clicks on button, args=(objName)"""
squishtest.clickButton(squishtest.waitForObject(self.__LookupRealName__(objName)))
def enter(self, objName, txt):
""" Enters given text into TextField, args=(objName, txt) """
print "*INFO* Entering \""+txt+"\" into object \""+objName+"\""
squishtest.type(squishtest.waitForObject(self.__LookupRealName__(objName)), txt)
def property_should_be(self, objName, prop, expected):
""" Verifies that given object has property with expected value, args= (objName,prop,expected)"""
print "*INFO* Got arguments (%s,%s,%s)" % (objName, prop, expected)
obj = squishtest.waitForObject(self.__LookupRealName__(objName))
val = getattr(obj, prop)
if not (str(val) == expected):
raise AssertionError("Expected value is "+expected+", but got: "+str(val))
print "*INFO* Assertion passed, value is "+str(val)Execution¶
To run our test suite we need to start squishserver and call pybot addressbook_tests.
==============================================================================
Addressbook Tests
==============================================================================
Addressbook Tests.Add Entry :: A test suite with a single test for addressb...
==============================================================================
Add Entry
Add Entry | PASS |
------------------------------------------------------------------------------
Empty AddressBook
Empty AddressBook | PASS |
------------------------------------------------------------------------------
Addressbook Tests.Add Entry :: A test suite with a single test for... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Addressbook Tests | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Output: /home/tomasz/robot/SquishDemo/output.xml
Log: /home/tomasz/robot/SquishDemo/log.html
Report: /home/tomasz/robot/SquishDemo/report.html
Additional notes¶
To run tests the following environment variables need to be defined.
export SQUISH_PREFIX=<location of Squish> # on linux: export PYTHONPATH=$SQUISH_PREFIX/lib:/home/tomasz/robot/lib # on macos: export DYLD_LIBRARY_PATH=$SQUISH_PREFIX/lib # on linux: export LD_LIBRARY_PATH=$SQUISH_PREFIX/lib:$SQUISH_PREFIX/python/libOn Linux & macOS set SQUISH_PREFIX=<location of Squish> set PYTHONPATH=%SQUISH_PREFIX%\bin;c:\users\tomasz\robot\lib set PATH=%SQUISH_PREFIX%\bin;%PATH%On Windows The presented solution was prepared using:
- 64bit Ubuntu Linux
- Squish 5.1
- robotframework 2.8.4
Directory structure
lib/SquishLibrary.py
SquishDemo/addressbook_tests/add_entry.txt
SquishDemo/addressbook_tests/resource.txt