Channels ▼

Jolt Awards

Jolts 2007: Testing

Jolt Winner

Agitar Software

Jerry Rudisin, CEO and President

AgitarOne continues to advance the innovative testing solutions developed by Agitar Software. Their Agitator product was a Jolt winner for 2004 and 2005, and AgitarOne continues the tradition.

AgitarOne improves the team quality experience by offering new features to the developer tool kit, including JUnit test generation, continuous integration support, and code rules auditing. Managers can access new levels of quality reports on their development teams’ progress through the managers. AgitarOne integrates these features into a server-based solution that integrates with several IDEs and frameworks.

The earlier Agitator product’s "software agitation" techniques for testing Java programs is fully incorporated into AgitarOne. You can still supply your own JUnit tests. Now AgitarOne creates JUnit tests for you. This can be especially useful for legacy code that has no unit tests and for sections of code that are particularly resistant to creating good tests. AgitarOne knows about several types of mock objects and uses them in the unit tests. The JUnit test-generation capability works with developers by integrating custom helper methods developed by the individual programmer into the JUnit test set. All of these features provide unparalleled code-coverage capability for any Java development team.

Enforcing coding standards and detecting common programming errors has become common practice on most development teams. AgitarOne supports this through a code-rule enforcement feature. The development team can configure rules for their own set of standards and be sure that they are followed by the team. The results of code rules audits are available in the dashboard feature so anyone can check on the adherence to the group’s standards.

AgitarOne incorporates support for a continuous build process. This feature is based upon the popular CruiseControl software and integrates with any version-control system. This makes it easy for developers to get feedback quickly about code they develop. The continuous builds incorporate the latest code, run the tests, and make the results available immediately in the dashboard. The dashboard completes the tool set in AgitarOne. It gives the whole team visibility on the current state of the project.

Teams who are trying to improve their overall quality process should look at incorporating AgitarOne into their set of tools. The value it can add to any project team quickly pays for the investment.

--Gary Pollice

Productivity Award

Mindreef SOAPscope

You'll find a lot to like in Mindreef SOAPscope, which this year earns another Productivity Award for testing web services (an earlier version was a winner in 2004).

SOAPscope provides a highly intuitive interface (or direct access to the underlying XML) to invoke services and examine the generated results. The tool's new automated testing feature extends this with the ability to record tests and play them back, automatically comparing returned data to expected results and reporting anomalies. Recorded scripts can even save specific results in variables that can be used in later scenarios allowing you to build up comprehensive test suites. Other standout features of this new version include auto-generated JAVADOC-style documentation for your services, and the ability to easily prototype and test services before they’re actually implemented.

With the continued growth in service-oriented solutions, we think Mindreef SOAPscope merits a well-deserved spot in your toolchest.

--Robert A. DelRossi

Productivity Award

Parasoft SOAtest

Parasoft has been busy expanding their stable of testing tools. Recognizing the momentum behind Service-Oriented Architecture (SOA) implementations, they have addressed the need to test for quality of service, performance, and cascading interaction issues associated with this new approach to standards-based distributed application architectures. Given the alphabet soup complexity and all the moving parts associated with SOA deployments, Parasoft's SOAtest can consume and interact with many SOA-related messaging protocols including SOAP and POX over HTTP, JMS, IBM MQ, Tibco Rendezvous, and RMI.

Test cases can then be automatically generated for most of the technologies called upon in SOA including REST, WS-Addressing, WS-I Interoperability, WS-Parlay and WS-Security, UDDI, and popular MIME, DIME, MTOM attachment types. Such cases can be applied toward functional, service unit and regression tests to help identify code-level service changes that could impact the delicate paths of distributed business processes. SOAtest can even be used for security penetration testing associated with web services such as SQL and XPath injections.

--Mike Riley

Productivity Award


To call Automated QA’s TestComplete 5 "full-featured" would be an understatement. A Jolt Award winner in 2003 (that was Version 3), TestComplete 5 is a relatively value-priced suite of tools to handle a wide range of testing needs for .NET, Java, and web developers. The list of compiler versions it supports would take the rest of this column. Recorded (or hand-coded) test scripts can be saved in as many as five different languages. Test designers can even add pop-up windows so that the person running the tests can introduce changes to key test parameters. Beyond simply recording and playing back actions, the suite can even handle web apps stress testing by simulating just about any number of virtual users when distributed across multiple computers.

We like the way AutomatedQA has priced the different parts of TestComplete so that even smaller companies can license what they need. With the neverending rise in software complexity, tools like TestComplete can mean the difference between success and failure.

--Robert A. DelRossi

Related Reading

More Insights

Currently we allow the following HTML tags in comments:

Single tags

These tags can be used alone and don't need an ending tag.

<br> Defines a single line break

<hr> Defines a horizontal line

Matching tags

These require an ending tag - e.g. <i>italic text</i>

<a> Defines an anchor

<b> Defines bold text

<big> Defines big text

<blockquote> Defines a long quotation

<caption> Defines a table caption

<cite> Defines a citation

<code> Defines computer code text

<em> Defines emphasized text

<fieldset> Defines a border around elements in a form

<h1> This is heading 1

<h2> This is heading 2

<h3> This is heading 3

<h4> This is heading 4

<h5> This is heading 5

<h6> This is heading 6

<i> Defines italic text

<p> Defines a paragraph

<pre> Defines preformatted text

<q> Defines a short quotation

<samp> Defines sample computer code text

<small> Defines small text

<span> Defines a section in a document

<s> Defines strikethrough text

<strike> Defines strikethrough text

<strong> Defines strong text

<sub> Defines subscripted text

<sup> Defines superscripted text

<u> Defines underlined text

Dr. Dobb's encourages readers to engage in spirited, healthy debate, including taking us to task. However, Dr. Dobb's moderates all comments posted to our site, and reserves the right to modify or remove any content that it determines to be derogatory, offensive, inflammatory, vulgar, irrelevant/off-topic, racist or obvious marketing or spam. Dr. Dobb's further reserves the right to disable the profile of any commenter participating in said activities.

Disqus Tips To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy.

Jolt Awards Video