Coming October 25: PeerSpot Awards will be announced! Learn more

Conformiq OverviewUNIXBusinessApplication

Conformiq is #2 ranked solution in top Test Design Automation tools and #11 ranked solution in top Quality Management Tools. PeerSpot users give Conformiq an average rating of 8.0 out of 10. Conformiq is most commonly compared to Tricentis Tosca: Conformiq vs Tricentis Tosca. Conformiq is popular among the large enterprise segment, accounting for 79% of users researching this solution on PeerSpot. The top industry researching this solution are professionals from a computer software company, accounting for 34% of all views.
Buyer's Guide

Download the Test Management Tools Buyer's Guide including reviews and more. Updated: September 2022

What is Conformiq?

Conformiq Creator provides a solution for automating testing processes and speeding up the software development lifecycle of Enterprise IT applications. Conformiq Creator is used in various sectors, including Telecom, Banking, Finance, Insurance, Retail, and Public Sector services. Launched initially in 2013, Creator quickly gained popularity among its users for its functional testing, application testing, system testing, and end-to-end testing.

Conformiq Transformer shortens the path to test automation, simplifies model-based testing (MBT) adoption using existing methods, and automates manual test execution. Along with Conformiq Creator, which generates executable test cases, scripts and documentation from models, it automates and transforms test design, extending the Conformiq 360° Test Automation™ solution for complex system testing at the speed of development.

Conformiq was previously known as Conformiq Creator, Conformiq Transformer.

Conformiq Customers

Alcatel-Lucent, Avaya, Daimler, Ericsson

Conformiq Video

Conformiq Reviews

Filter by:
Filter Reviews
Industry
Loading...
Filter Unavailable
Company Size
Loading...
Filter Unavailable
Job Level
Loading...
Filter Unavailable
Rating
Loading...
Filter Unavailable
Considered
Loading...
Filter Unavailable
Order by:
Loading...
  • Date
  • Highest Rating
  • Lowest Rating
  • Review Length
Search:
Showingreviews based on the current filters. Reset all filters
reviewer1518657 - PeerSpot reviewer
QE Manager at Capgemini
Real User
Top 10Leaderboard
Feature-rich stable tool with multiple options to control output, good integration with other tools, and knowledgeable support team
Pros and Cons
  • "Though optimized and automated test generation is the core functionality, the product's integration with other tools sets it apart."
  • "Even though the 4.1 version is a far-improved version from its earlier avatars, the performance of test generation is still an issue on real-time models we have."

What is our primary use case?

We had our test cases in BPT format. However, the creation of duplicate components resulted in significant manual and automation maintenance efforts. The implementation of the concept of model-based testing was thought to reduce that effort.

Within the MBT Tools space, Conformiq has a lot of options for data optimization and path optimization logic. Its keyword-based modeling approach had fit properly with our automation framework. 

How has it helped my organization?

Conformiq generates a unique and optimized set of test cases. The test cases are optimized for both data and path. 

It offers easy maintainability of models - a functional change may only require updating the model at appropriate places (and tool will take care of TC generation) when compared to updating the entire test case suite. It maintains test cases to the current application version and removes test cases for obsolete functionality. 

Since the models map to current application version, it acts as a knowledge repository for any future training.

The UI definition of models is based on keywords. With proper integration to the automation framework, in-release/in-sprint automation has been achieved. 

What is most valuable?

The core functionality of the tool is automated test generation of optimized test suite; the tool has extensive list of options for the same. The product's integration with other tools sets it apart. It has integrations with many upstream (for requirements mapping) and downstream (export of test cases to various tools) products. It is like "plug-and-play". 


For any customized downstream tool, like our proprietary automation framework, support is provided for custom development. It is has features - Business AD - to use in Agile implementations. The latest version seems to have support for BDD/Gherkin as well, which we have not used much. 

What needs improvement?

Though I understand every tool will have limitations, an effort can be put in to better understand and acknowledge the issues (not every issue is a problem with Conformiq) encountered in real-time implementation, even if there is no solution.

Even though the 4.1 version is a far-improved version from its earlier avatars, the performance of test generation is still an issue on real-time models we have.

The reverse engineering logic, to generate models with existing manual/BPT test cases, did not work for us.

Buyer's Guide
Test Management Tools
September 2022
Find out what your peers are saying about Conformiq, Broadcom, Cognizant and others in Test Management Tools. Updated: September 2022.
634,325 professionals have used our research since 2012.

For how long have I used the solution?

We have been using Conformiq Creator for the past four years and six months.

What do I think about the stability of the solution?

The output of Conformiq is predictable - it generates the same output for same input and settings again and again. Its integrations with other tools like Rally, ALM (both Import and Export), MS Excel, GitHub work well. 

This helped us expand the solution to multiple applications under test, rather than worrying about whether the output is correct.

What do I think about the scalability of the solution?

Performance of test generation process takes a hit, but we have really huge/too many models. We have used other modeling techniques to work around the issue. Also, understanding the way the tool works (ie., internal processes/threading, RAM and processor usage) had helped us create manual processes to work around the issues.

A proof of concept has been completed to schedule/automate the trigger/export test generation; with proper toolset availability, automation framework tweak and further support from Conformiq team, Conformiq can be integrated into DevOps tool chain.

How are customer service and support?

The team is knowledgeable. They were able to answer all our technical queries in relation to the product itself. The team was able to answer questions related to real-time implementation and the process surrounding it most of the times; in other instances, it could have been better approached, if not answered to our satisfaction.

Which solution did I use previously and why did I switch?

For optimization, we were using another tool, but it was giving only test data combinations and not test cases. There was not much integration with other tools, including any of the automation frameworks.

How was the initial setup?

The reverse engineering option to convert existing BPT/manual test cases into Conformiq models did not result in a usable and scalable solution. Therefore, we had to engineer the models brand new and it took a lot of effort.

Also, our models grew too huge in a short span of time and ran into issues with TC generation. However, the Conformiq team were able to re-engineer the backend logic for faster processing and made a huge improvement.

What about the implementation team?

It was implemented through an in-house process and technical approach definition .

What's my experience with pricing, setup cost, and licensing?

Test Cases can be generated with a local system as the server. However, depending on the number of models and their size, it is better to set up a system with higher RAM and a faster processor and use it as a server. 

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
reviewer1505883 - PeerSpot reviewer
Sr Software Engineer at IdeaBytes
Real User
Leaderboard
Saves us time writing manual test cases and scripts, promotes reusability
Pros and Cons
    • "I would like to see the output data optionally used as input for the model, as further action in the flow."

    What is our primary use case?

    We use this product to design the model and generate manual test cases, then export them into the user-required Excel format.

    We reuse the existing components and convert them into the design model. We then use the output for further uses in the organization and to further change or make additions to the project.

    We also use it for maintaining the version control of the project when multiple resources are required.

    How has it helped my organization?

    This product helps with understanding the design tool for the test case generation without manual writing of test cases in Excel.

    It is time-consuming to write the manual test cases, which has now been reduced. It gives us more time to spend on model design. The time spent writing test scripts has also been reduced, as it automatically generates test scripts based on user requirements.

    The maintenance of projects in versions from the tool itself is very helpful, as we can skip version control tasks from the command prompt.

    We can quickly design the test cases and generate manual test cases, which can be shown at a high level as well.

    What is most valuable?

    The ability to reuse existing components is very useful when we work on a project that is already started.

    The reverse engineering concept, where I can convert manual test cases into the design-level and then make further use of them in the project, is very helpful.

    We are able to convert existing components into other languages based on user requirements. It is very useful to migrate the scripts from one automation tool to another automation tool.

    The use of external data in the model, allowing us to use it for test generation and scripts, is another valuable feature.

    What needs improvement?

    When modifying the existing model, re-generate test cases and test scripts, it should overwrite the existing data from previous scripts and test cases.

    Improvements on the List item widget and Table widget are needed.

    I would like to see the output data optionally used as input for the model, as further action in the flow.

    It would be helpful to have support for combinatorial action on two different business activity nodes.

    The ability to use the result from the Response Message action widget as a variable object for further uses in the test case flow would be useful.

    We went to merge conflicting texts based on user request in git version control concepts.

    For how long have I used the solution?

    We have been using Conformiq for the past four years.

    Which solution did I use previously and why did I switch?

    We did not use another similar solution prior to this one.

    Which other solutions did I evaluate?

    We did not evaluate other solutions.

    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Buyer's Guide
    Test Management Tools
    September 2022
    Find out what your peers are saying about Conformiq, Broadcom, Cognizant and others in Test Management Tools. Updated: September 2022.
    634,325 professionals have used our research since 2012.
    reviewer1517112 - PeerSpot reviewer
    Technical Architect at Hexaware Technologies Limited
    Real User
    Top 20Leaderboard
    Easy to set up, integrates well with other tools, and maintains traceability in STLC process
    Pros and Cons
    • "The tool has the ability to integrate with various requirement management, test management, and version control tools."
    • "It would be helpful to have a feature in the tool's UI to map object locators within the system."

    What is our primary use case?

    We use the Conformiq tool as part of the end-to-end automation solution provided by our organization, where right from test design to test execution to reporting, everything is automated.

    We automate test design through Conformiq and generate both manual test cases (Excel-based) and automated scripts. Conformiq plays a key role in speeding up the STLC process and improving product quality.

    We have developed various custom plugins for our customized Selenium/UFT frameworks.

    We have also integrated this product with various test management and requirement management tools like JIRA, ALM, etc.

    How has it helped my organization?

    Conformiq integrates well with various automation tools and auto-generates between 60% and 80% of the automation scripts. This feature has helped us to improve automation coverage and enabled us to run regression tests repetitively.

    Conformiq provides easy maintenance for change requests. The tool will generate auto-generate impact analysis data, which can be carried to test automation as well, easing efforts for automation script maintenance.

    This product has the ability to integrate with various test management tools and version control tools.

    What is most valuable?

    The tool has the ability to integrate with various requirement management, test management, and version control tools. It allows for maintaining traceability throughout the STLC.

    Other than generating automation scripts tool implements algorithms to ensure 100% coverage with the optimized test set. This avoids the fear of over-testing/Under testing. Also, graphical representation helps to identify the possible requirement gaps

    Reusability of exiting components helps to reduce duplicate efforts and allows to maintain project properly.

    What needs improvement?

    There is room for improvement, including the following:

    1. We have limited widgets available in the tool to design UI flow. We would like to see other frequently used widgets like spin boxes, sliders, etc.
    2. The table widget options such as display tables, modify tables, and select rows, should be enhanced.
    3. It would be helpful to have a feature in the tool's UI to map object locators within the system. This will help to maintain automation scripts, keeping them in synchronization with Conformiq models.
    4. Currently, we don't have an integration with the test data management tool. Having this feature will help for generating and maintaining test data.

    For how long have I used the solution?

    I have been working with Conformiq for the past six years.

    Which solution did I use previously and why did I switch?

    I have explored various test design solutions in the market and I prefer Conformiq.

    How was the initial setup?

    We use an on-premise setup. Setting up the tool is easy, but it is recommended to use a system with a good configuration for better performance results.

    Which deployment model are you using for this solution?

    On-premises
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Buyer's Guide
    Download our free Test Management Tools Report and find out what your peers are saying about Conformiq, Broadcom, Cognizant, and more!
    Updated: September 2022
    Buyer's Guide
    Download our free Test Management Tools Report and find out what your peers are saying about Conformiq, Broadcom, Cognizant, and more!