IBM Rational Test Workbench vs Perfecto comparison

IBM and Perforce are both solutions in the Performance Testing Tools category. IBM is ranked #21, while Perforce is ranked #17. IBM holds a 0.7% mindshare in PTT, compared to Perforce’s 1.2% mindshare. Additionally, 100% of IBM users are willing to recommend the solution, compared to 88% of Perforce users who would recommend it.

IBM Rational Test Workbench

Read 4 IBM Rational Test Workbench reviews

124 Views
59 Comparison Views

100% willing to recommend

Perfecto

Read 23 Perfecto reviews

179 Views
120 Comparison Views

88% willing to recommend

IBM Rational Test Workbench

Perfecto

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Dec 15, 2024

IBM Rational Test Workbench and Perfecto compete in software quality assurance. Perfecto has the upper hand due to its robust feature set and integration capabilities, making it worth the investment despite higher initial costs.

Features: IBM Rational Test Workbench supports various protocols, providing flexibility and advanced automated testing, especially in complex scenarios. It integrates well with other IBM tools. Perfecto is notable for cloud-based mobile testing, enabling real-device testing across numerous devices and operating systems, and offers strong CI/CD integration.

Room for Improvement: IBM Rational Test Workbench could enhance its mobile testing capabilities and reduce dependency on on-premise deployment. Greater flexibility in test configurations would also be beneficial. Perfecto might improve its initial setup process to be more cost-effective and streamline some cloud-based processes for even faster integration. Additionally, enhancing user interface intuitiveness could further its user experience.

Ease of Deployment and Customer Service: IBM Rational Test Workbench requires on-premise deployment, which can be resource-intensive, but benefits from comprehensive support. Perfecto's cloud-based nature ensures quicker deployment and is praised for responsive and effective customer support.

Pricing and ROI: IBM Rational Test Workbench is competitively priced with favorable ROI due to lower initial costs. Perfecto justifies its higher initial investment by offering greater long-term ROI through extensive mobile testing capabilities and cloud integration benefits.

To learn more, read our detailed IBM Rational Test Workbench vs. Perfecto Report (Updated: May 2025).

Buyer's Guide

IBM Rational Test Workbench vs. Perfecto

May 2025

Download the complete report

Helped 857,028 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

IBM Rational Test Workbench

Ranking in Performance Testing Tools

21st

Ranking in Test Automation Tools

39th

Average Rating

7.6

Reviews Sentiment

7.3

Number of Reviews

Ranking in other categories

API Testing Tools (15th)

Perfecto

Ranking in Performance Testing Tools

17th

Ranking in Test Automation Tools

23rd

Average Rating

8.4

Reviews Sentiment

7.4

Number of Reviews

Ranking in other categories

Functional Testing Tools (14th), Mobile App Testing Tools (5th)

Mindshare comparison

As of June 2025, in the Performance Testing Tools category, the mindshare of IBM Rational Test Workbench is 0.7%, up from 0.2% compared to the previous year. The mindshare of Perfecto is 1.2%, up from 0.5% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Performance Testing Tools

Featured Reviews

KashifJamil

CEO at Xcelliti

Good integration with other tools, stable, scales easily

There are a number of things that they can do to simplify the tools, but the most important thing that they need to do is simplify the installation. This includes the workbench as well as the other tools. In the future, I would like to see the other types of tests supported, that are not already covered in the DevOps approach. This would include, for example, penetration testing.

Read full review

Roland Castelino

QA Lead at BMO Financial

Its reporting allows us to have a clear view regarding what tests have been executed

The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"Reporting is pretty good. Its interface is also good. I'm overall pretty happy with the functionality and use of IBM Rational Test Workbench."

"This solution provides for API testing, functional UI testing, performance testing, and service virtualization."

"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."

"The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto."

"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost."

"There are a whole bunch of things that I like about the solution, but I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. The reports are very detailed."

"One of the good things about Perfecto is the scalability that it provides."

"It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle."

"We are continuously doing testing on different environments, devices, and platforms. It executes seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices."

"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."

More Perfecto pros

Cons

"It should have more interfaces. In terms of interfaces or protocols, what you can do with Rational is far limited as compared to other products out there. What it does, it does great, but it only gives you limited types of protocols. It supports between 8 to 15 types of protocols, whereas other test tools give you 20 to 30 types of protocols with which you can do testing and convert to script. It records Javascript-based scripts, and you got to know a little bit of Java to basically be able to edit them, but the level of editing you got to do is very low. I like that, but the ability to edit the script is not as good as Parasoft or LoadRunner, which have C-Script."

"There are a number of things that they can do to simplify the tools, but the most important thing that they need to do is simplify the installation."

"It is slow compared to physical device testing. The interactive speed could be improved."

"I would like to see the inclusion of machine learning features. If we can have that, it will be a better tool."

"The monitoring features, in particular network traffic monitoring, could be improved."

"I'm hoping that Perfecto will come up with browser testing as well because it would be easier to access it."

"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."

"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."

"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."

"There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively."

More Perfecto cons

Pricing and Cost Advice

"It doesn't really concern me. Licensing is on a yearly basis."

"The pricing is a little bit on the higher side, although it is really good."

"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."

"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."

"This is an expensive solution compared to others, by 30% to 40%."

"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."

"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."

"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."

"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."

More Perfecto pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.

See recommendations

857,028 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

31%

Computer Software Company

12%

Manufacturing Company

10%

Government

Financial Services Firm

23%

Computer Software Company

18%

Manufacturing Company

Healthcare Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Comparisons

ReadyAPI Test vs IBM Rational Test Workbench

Compared 35% of the time

OpenText Enterprise Performance Engineering (LoadRunner Enterprise) vs IBM Rational Test Workbench

Compared 32% of the time

OpenText UFT One vs IBM Rational Test Workbench

Compared 32% of the time

More IBM Rational Test Workbench Competitors

BrowserStack vs Perfecto

Compared 35% of the time

Sauce Labs vs Perfecto

Compared 22% of the time

Appium vs Perfecto

Compared 13% of the time

LambdaTest vs Perfecto

Compared 4% of the time

Eggplant Test vs Perfecto

Compared 4% of the time

More Perfecto Competitors

Product Reports

Buyer's Guide

Performance Testing Tools

May 2025

Download IBM Rational Test Workbench product report

Buyer's Guide

Perfecto

May 2025

Download Perfecto product report

Also Known As

Rational Test Workbench, IBM Rational Performance Tester, IBM Functional Tester, IBM Rational Test Virtualization Server

Perfecto Mobile, Perfecto Web

Overview

IBM Rational Test Workbench provides a comprehensive test automation solution for mobile applications, regression testing, integration technologies and performance and scalability testing. It helps you build intelligent and interconnected enterprise applications that can be deployed on traditional and cloud infrastructures. With Rational Test Workbench, you can significantly reduce test cycle times, moving integration testing earlier in the development lifecycle.

IBM

Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

Perfecto Features

Perfecto has many valuable key features. Some of the most useful ones include:

Live Stream analysis
Reporting/analytics
Activity dashboard
Action-word testing
Bug tracking
Debugging
BDD & codeless automation
Model-based testing
Real-time monitoring
Role-based permissions
User management
Test failure analysis
Real user simulation

Perfecto Benefits

There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.

Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.

Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.

AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.

Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

Reviews from Real Users

Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

Perforce

Sample Customers

Financial Insurance Management Corp.

Virgin Media, Paychex, Rabobank, R+V, Discover

Buyer's Guide

IBM Rational Test Workbench vs. Perfecto

May 2025

Free Report: IBM Rational Test Workbench vs. Perfecto

Find out what your peers are saying about IBM Rational Test Workbench vs. Perfecto and other solutions. Updated: May 2025.

DOWNLOAD NOW

857,028 professionals have used our research since 2012.

See our IBM Rational Test Workbench vs. Perfecto report.

See our list of best Performance Testing Tools vendors and best Test Automation Tools vendors.

We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.