CERN using Squish for Multi-Platform SCADA GUI Regression Testing

Ten years ago CERN developed a toolkit called the JCOP (Joint Controls Projects) Framework for the development of industrial control systems. This framework was designed to support the creation of systems for controlling experiments, particle accelerators, and CERN's technical infrastructure.

The JCOP Framework is a software layer designed to simplify and unify access to the underlying SCADA (Supervisory Control and Data Acquisition) technology built with WinCC-OA, itself built on Qt. The JCOP Framework consists of both code libraries and also a substantial amount of GUI software. Since the Framework is so widely used throughout CERN, it was necessary to create a formalized automated quality assurance process to provide confidence and ensure stability. This demanded a tool that would reliably support daily regression testing on both Windows and Linux.

After evaluating various GUI test tools, CERN test engineers, Paul Burkimsher, Manuel Gonzalez-Berges, and Stefan Klikovits chose to use Squish, and CERN acquired its first Squish license in 2006.

The CERN test engineers' initial approach was to make extensive use of Squish's test recording facility (in their case they chose to have the tests recorded in Python). Unfortunately, this wasn't always as robust as they had hoped because changes to their complex software stack (Qt, WinCC-OA, JCOP itself), or improvements in newer versions of Squish, could sometimes affect Squish's reliability of playback.

To meet this challenge the CERN test engineers analysed their recorded Squish tests and used this as the basis for creating their own high level object-oriented test library. Their library contains a class for every GUI widget they test. Having the library has allowed them to drastically cut down the duplicate code produced by simply recording tests, and to abstract GUI interactions into calls to their library. This has resulted in them being able to reduce their tests to library calls and verifications. And this in turn has made test development much faster and easier, since test engineers can build on all the predefined functionality. Of course, this work has also made all of their test cases far more robust, since any change to the underlying software stack that affects the tests can now be addressed by updating a single library, rather than having to check and change a large body of test cases.

Another important matter for the CERN test engineers is the ability to test on both Windows and Linux. They tried a number of different solutions and in the end adopted a CI (Continuous Integration) approach using the Hudson tool (and for which there is a Squish integration). Initially they ran all their tests on different physical machines, but they have now switched to using Virtual Machines hosted in the CERN Computer Centre—a change which made no difference to their testing or to Squish.

Recently, the CERN test engineers published a brief technical paper describing their use of Squish, the challenges that arose, and the solutions they found. This paper was presented at the 13th International Conference on Accelerator and Large Experimental Physics Control Systems, and is available from http://www.esrf.eu/icalepcs2011/papers/thbhmust01.pdf.

About Squish

Squish is the leading functional, cross-platform GUI and regression testing tool that can test applications based on a variety of GUI technologies, including Nokia's Qt Software Development Frameworks, Java SWT/Eclipse RCP, Java AWT/Swing, native Windows MFC and .NET, Mac OS X Carbon/Cocoa, iOS CocoaTouch, and Web/HTML/AJAX. Squish stands out from other GUI testing tools by giving test engineers the freedom to record and write tests using familiar scripting languages such as JavaScript, Perl, Python, and Tcl. Furthermore, Squish provides extremely tight integration with the specific GUI technologies it supports. This gives testers unprecedented access to the internals of the applications they are testing (to data items, controls, and widgets, etc.), and also leads to the production of very robust and stable GUI tests.

Squish itself, and all the tests created with it, are completely cross-platform, and work on Windows, Linux/Unix, Mac OS X, and embedded Linux.

If you are interested in evaluating or purchasing Squish, please contact sales@froglogic.com or visit www.froglogic.com/squish.

About froglogic

froglogic GmbH is a software company based in Hamburg, Germany. Their flagship product is Squish, the market-leading automated testing tool for GUI applications. More about froglogic is at http://www.froglogic.com.

About CERN

CERN, the European Organization for Nuclear Research, is one of the world's largest and most respected centres for scientific research. Its business is fundamental physics, finding out what the Universe is made of and how it works. At CERN, the world's largest and most complex scientific instruments are used to study the basic constituents of matter—the fundamental particles. By studying what happens when these particles collide, physicists learn about the laws of Nature.

froglogic GmbH
Gasstr. 18, Haus 1
22761 Hamburg Germany

+494078897137
press@froglogic.com

This release was published on openPR.