Valuable for us is the ability to identify objects by using Find methods. I am able to process whole pages at once rather than doing everything one by one.
Senior Consultant at a tech services company with 10,001+ employees
Using this solution I am able to process whole pages at once rather than doing everything one by one
What is most valuable?
What needs improvement?
Using object spy can be slow sometimes and seems to require a lot of resources.
For how long have I used the solution?
We have been using the solution for six months.
What do I think about the stability of the solution?
The solution freezes sometimes, but not very often. Sometimes it doesn’t find any objects from the browser and needs to restart the browser or the whole machine. This happens with Internet Explorer.
Buyer's Guide
SmartBear TestComplete
February 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: February 2024.
763,955 professionals have used our research since 2012.
What do I think about the scalability of the solution?
It is very difficult to have multiple developers when using Name Mapping. You can’t merge all the files and this creates conflicts.
It scales better for multiple users when using pure script, which reduces the amount of files that cannot be merged.
How are customer service and support?
Support calls were helpful at the beginning, and I haven’t used the support since then.
Which solution did I use previously and why did I switch?
We used TestPlant eggPlant and are still using it for thick clients where objects are not available. The development speed for TestComplete is faster and more reliable when objects can be seen.
How was the initial setup?
It is easy to install and use.
Which other solutions did I evaluate?
We went through quite a few of them. This product seemed best for usability and recording features.
What other advice do I have?
Test the trial, then go for it. Keyword tests seem viable for straightforward test cases, but to create dynamic architecture you might want to stick only with scripts and drop Name Mapping.
Keyword tests are easy and fast to record, but adding complex logic for them can be tricky and time consuming.
Disclosure: My company has a business relationship with this vendor other than being a customer: We are partners with SmartBear.
Principal Software Engineer - Automation at a tech services company with 10,001+ employees
Our testing team can spend more time testing new features, but there often are issues with web test execution.
What is most valuable?
- Object Browser is the most powerful feature. This has helped me tear apart every single component of the application under test. It's an awesome feature.
- Test Editor and Debugger: This has really made my life easy as I can trace memory and stack values very easily.
- Data driven testing has been made very easy. I am comfortable using any sort of backend to support data driven testing such as Excel/databases/etc.
- It supports using third party DLLs has given me an edge on several occasions.
How has it helped my organization?
Previously, we had to wait for the end-of-sprint to make a stable release. Now, rolling out a release is not a problem. As soon as a build is deployed, the scheduler quickly executes User Acceptance Tests, and verifies that the build is fit to be delivered to the clients.
What needs improvement?
- Support for working with COM and ActiveX objects should be more powerful. Currently we have to drill down a lot to find solutions for certain tasks.
- Cross browser testing is a bit complex when it comes to scripting. Developers have to take care with it care, or else issues may arise at deployment time.
For how long have I used the solution?
Overall, I have used this for more than two years, including v1040. Currently I have been using it hands on for the last year.
What do I think about the stability of the solution?
There often are issues with web test execution. Web pages often do not load on the first attempt.
How are customer service and technical support?
Customer Service:
Customer server is absolutely robust. The team respond within 12 hours.
Technical Support:I never needed to use paid technical support as their forum is extremely helpful. The community members respond to issues within 24 hours. It’s really amazing that within the past twelve months, I have never had a technical question I asked remain unanswered.
Which solution did I use previously and why did I switch?
I am an expert on the following:
- Selenium RC and Servers/Java - but this has multiple limitations
- IBM Rational Functional Tester - it's expensive, and not as powerful as TestComplete
- AppPerfect - is not in competition with any of the above, it’s pathetic
How was the initial setup?
It was straightforward. Both the node locked and floating licenses were easily deployed, and now the whole team is using it.
At one point, we had to update the hardware of the servers where the licenses were deployed, and this was very easy. We just disabled the licenses from the account and deployed them onto the upgraded servers.
What about the implementation team?
I did it myself in-house. It’s very simple. No rocket science needed. Just read the manuals and you can do it.
What was our ROI?
We are saving a lot in terms of client satisfaction. We are not yet in a phase where we have savings in terms of a reduced QA team, but our clients are happy that they get bug free software. Moreover, our testing team spends more time testing new features, and we are confident enough at build roll out time that all previously developed modules are stable.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Buyer's Guide
SmartBear TestComplete
February 2024
Learn what your peers think about SmartBear TestComplete. Get advice and tips from experienced pros sharing their opinions. Updated: February 2024.
763,955 professionals have used our research since 2012.
Project Manager at a computer software company with 51-200 employees
Easy to maintain tests, easy to use, and good support and documentation
Pros and Cons
- "It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
- "There could be API interfaces with this tool."
What is our primary use case?
It is useful for functional testing, testing backend database, and frontend user interface.
I am using the latest version.
What is most valuable?
It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained.
It is a very easy-to-use tool. You don't have to be an expert in a specific syntax. You can just use graphical logic. If needed, it also allows you to apply some code. It is very useful from all perspectives.
What needs improvement?
There could be API interfaces with this tool.
For how long have I used the solution?
I have been using this solution for about 10 years.
What do I think about the stability of the solution?
It is very stable. Their tests are running fluently.
What do I think about the scalability of the solution?
We have three testers.
How are customer service and technical support?
I have contacted them, and I got a very fast response and solution. Their support team was very helpful. Every question was answered professionally and quickly.
The help guides are also very useful.
Which solution did I use previously and why did I switch?
I had used a browser tool.
How was the initial setup?
It is very easy to install. It took about one hour to deploy the tool.
What about the implementation team?
I implemented it with the guidance and help of the support team. It can be done by the testing team without any help from a consultant.
What's my experience with pricing, setup cost, and licensing?
It costs a few hundred per year, but I am not sure. It is not at all expensive as compared to other tools.
What other advice do I have?
I would recommend this tool. You don't have to be an expert in this tool to start using it. You can start by using the help guides. It is very easy to understand how to make it work.
I would rate SmartBear TestComplete a 10 out of 10.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Automation Architect at Watronix Information Technology Ltd
Speed, configuration consistency, and accuracy of tests with fantastic results
Pros and Cons
- "In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
- "To bring it up to a 10, I would be looking for the addition of some key functional API testing."
What is our primary use case?
I built it for a demonstration for my team and it's currently dealing with procurement as far as cost, et cetera. The demonstration deals with how the tool is easy to use for desktop and web applications and, of course, web applications on mobile devices as well. No mobile device applications yet. I was able to spend that also using the TestComplete cloud. Instead of building my own grid, I used the test Selenium cloud, which you could use selecting different platforms and different web browsers per platform and you could span them across multiple devices and that was extremely helpful. Building is the hardest part about the frameworks because there's really no right way to do it.
How has it helped my organization?
In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great. Because we use JavaScript, we convert to JavaScript and then we just expand it from there and that was wonderful. The easiest way to start the test case or test scenario for design purposes is to put it on record, click it and I start messing with the automation. I was very impressed because I didn't have to step out of bounds of TestComplete and that's the kind of tool I've been looking for since I've been automating.
What is most valuable?
The most useful feature is the name mapping. It allows me to not have to worry about the object's name; I just use my alias.
This affected the way my client's organization functions in several ways. Number one is the consistency of the versioning. Everyone's using the same tools, same kind of code, same kind of coding methods. In case somebody's sick or out, another team member can pick up where they left off and keep going.
It's also great because that record feature is not for the mindless. The recording plate is not only there to help you start writing the test, it helps you as a tester or an engineer understand the business mindset of how they built the application. You have to go in yourself and click around. Then, it puts everything in code and then helps you understand. We were testing sites like pharmacies, hotels, insurance providers, and other commercial companies like PetSmart. That's where I was using it and that's where the conformity got a lot better.
What needs improvement?
I was going to say load and performance but I really didn't get a chance to get into the load and performance part of TestComplete.
I can sense there's still a little bit more room for improvement in terms of making the whole testing process easier. Because it was desktop first, it kind of focused on COTS-based testing and API's because everyone's using it at the moment.
To bring it up to a 10, I would be looking for the addition of some key functional API testing. What I mean by key is like the video streaming or a consistent flow of data being used and then how much can it handle and how much API testing can it do because that's where the load and performance comes in. The API testing is where I would see a lot more improvement.
For how long have I used the solution?
I've been using this solution on and off for about four years. About a year in total.
What do I think about the scalability of the solution?
I have to say that scalability is pretty sufficient for now. I'm the test architect for the company and I have eight employees under me and we are all using the solution.
How are customer service and technical support?
I would rate my experience with tech support as 10 out of 10. I had two emails and two calls with tech support. Within five minutes, my problem was solved. They were immediately aware of what I was having difficulty with and then showed me the right way to implement the solution.
Which solution did I use previously and why did I switch?
We've been using Selenium with Java and it's too hard to manage the framework because everyone's changing it because they're running it locally and then they'll put it off the grid, but locally, they're building on the machine. I incorporated a Docker and I containerized the test framework so that now, new employees can go and just install the container but then there's still that engineering mindset. They want to go out and play, so it's just hard to manage. With TestComplete it's all encapsulated in one.
How was the initial setup?
The initial setup was very straightforward. I didn't experience any bugs, glitches, or crashing. I was running 16 tests at one time using half of using my grid and half using the cloud and everything was running fine. I had to test and see if TestComplete could actually go on a Selenium grid and it did.
Which other solutions did I evaluate?
We're still kind of in the evaluation phase. The new requirements are still in development. So we're using this time to hang up our testing environment.
We're looking for more COTS-based tools or tool so we don't have to do as much management. We want a tool that does the management as versions up and then we just lock it down.
What other advice do I have?
My advice to others is: If you're looking for speed, configuration consistency, and accuracy of tests with fantastic results, go get TestComplete. If you're starting with it, you'll see how much more you can expand on it.
Which deployment model are you using for this solution?
On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Integration Specialist at a financial services firm with 10,001+ employees
Good regressions tool, SoapUI tools, and cross-browser capabilities
Pros and Cons
- "The most valuable feature of this solution is regression testing tools."
- "The artificial intelligence needs to be improved."
What is our primary use case?
I use this solution for functionality testing, API testing, and performance testing.
We are moving away from this solution to use Eggplant Functional.
What is most valuable?
The most valuable feature of this solution is regression testing tools.
The SoapUI tools are very good, as well as cross-browser capabilities.
The GUI is very good.
What needs improvement?
There is a problem with usability because the speed decreases, which could be an issue with scalability because of too many hits on the site. It depends on how distributed their systems are, and how well they can handle multiple connections.
The artificial intelligence needs to be improved.
For how long have I used the solution?
I have been using this solution for between six and twelve months.
What do I think about the stability of the solution?
This is a good product in terms of stability.
How are customer service and technical support?
The technical support for this solution is always available. They have an online chat that is quick.
How was the initial setup?
The initial setup of this solution was quite smooth. It was not complicated and within a week it was working. It did not take long.
What about the implementation team?
We performed the implementation in-house.
What's my experience with pricing, setup cost, and licensing?
This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team.
Which other solutions did I evaluate?
We have also been using Eggplant Functional, and the decision has been made to move forward with that solution, instead of SmartBear. It is not for technical reasons. I also find Eggplant to be a little bit pricey.
What other advice do I have?
This product is quite mature, able to compete with other products in the market, and I would highly recommend it. Overall, we're very pleased with the implementation.
My advice to anybody who is considering this solution is to do a PoC and try this solution out. They can always reach out to me for help, and I can assist.
The biggest lesson that I have learned from using this solution is that there is a lot of hard work going on behind the scenes with this tool, to make each customer's journey easier. This tool is simple to implement and easy to use. If you don't have much time to do a lot of reading then it is still easy to take each case and adopt it quickly.
I would rate this solution a nine out of ten.
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner.
QA Team Manager at Mer Telemanagement Solutions Ltd
Saves a lot of human resources by running full regression tests prior to each release.
Pros and Cons
- "The database checkpoints detect problems which are difficult for a human resource to find."
- "Customer service and technical support responsiveness are high. Everyone is very professional."
- "Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work."
- "Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover."
What is our primary use case?
The primary use is to run regression tests on a call accounting system as a web application, which is running on a Windows operating system. The tests simulate user actions using UI and database verification.
How has it helped my organization?
The solution has saved a lot of human resources by running full regression tests prior to each release. In addition, during the years, many major bugs have been detected by the tool, and it has saved us the big expense of fixing problems after a release. Our confidence with the tool increased as releases were performed successfully, without any rejections from the field.
What is most valuable?
The database checkpoints detect problems which are difficult for a human resource to find. In addition, verification of UI items in all screens is also important task that consumes too
much manual resources.
What needs improvement?
Name Mapping feature should be clearer. Whenever I use it, I do not really know what will work and what will not work.
For how long have I used the solution?
Eleven years.
What do I think about the stability of the solution?
Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.
What do I think about the scalability of the solution?
No issues.
How are customer service and technical support?
Customer service and technical support responsiveness are high. Everyone is very professional.
Which solution did I use previously and why did I switch?
We did not have a previous solution.
How was the initial setup?
The initial setup was straight forward. No issues at all during the setup stage.
What about the implementation team?
The implementation was in-house.
What was our ROI?
Our ROI is about $10,000 a year.
What's my experience with pricing, setup cost, and licensing?
The license price for a physical machine is cheap, and for virtual machine, it is very expensive.
Which other solutions did I evaluate?
We did not evaluate other solutions.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
Test Automation Engineer at a energy/utilities company with 10,001+ employees
Calls different operations through batch files. The product is not stable enough and it crashes often.
Pros and Cons
- "Runs in different remote machines. We have multiple versions of the software being tested."
- "Product is not stable enough and it crashes often."
What is most valuable?
- Tests can be execute and run separately.
- Runs in different remote machines. We have multiple versions of the software being tested.
- Calls different operations through batch files.
- Has the option for combining data and is keyword driven. It helps people with less knowledge in programming to work with it.
How has it helped my organization?
We already have the UI smoke test and have integrated to our build system, which runs each day for multiple version of the product. This saves us a lot of time.
What needs improvement?
* Product is not stable enough and it crashes often
The application under test is a complex scientific application developed in C++ & C# and use different technologies. So when I try to do Name mapping, it sometimes hangs and have to restart Test complete
* Checking from TestComplete to TFS has issues.
I mostly try to checkin the changes with Visual studio as TestComplete hangs while you try to check in with many changes directly to TFS from Testcomplete.
* Possibility to run a part of keyword tests through TestExecute
Consider you have a keyword test with 10 individual tests. By using test execute, you can only run the main one, not the individual ones.
So I like to have the possibility of running from the 3rd test or just running the 5th one.The option is not present in TestExecute (you can do it in Test complete).
What do I think about the stability of the solution?
It would help if it were more stable as it sometimes hangs and crashes.
What do I think about the scalability of the solution?
We have different version of the product and it framework/project was easily scalable and used by other projects.
How are customer service and technical support?
We had multiple technical training sessions which were helpful and almost all the answers are in the community.
Which solution did I use previously and why did I switch?
When I started at this company, they were using TestComplete.
How was the initial setup?
Getting used to product did take some time.
What's my experience with pricing, setup cost, and licensing?
The price is less, compared to other products, such as QTP.
Which other solutions did I evaluate?
We had a choice with Coded UI as we developed it using C#. However, TestComplete is the preferred choice one over coded UI, as it needed to grow more as a test tool.
What other advice do I have?
Get training and decide on a framework that suited for your application. It always depends on what you want to do with the tool.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
QA Manager at a computer software company with 201-500 employees
I like the cross browser compatibility. The way objects are added and used when utilizing descriptive programming could be improved.
Pros and Cons
- "I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
- "The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
What is most valuable?
I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers.
How has it helped my organization?
We are consultants. So we simply provide an automated solution to a client, then move on. We don’t use the product in our day to day work.
What needs improvement?
The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT.
In UFT, using descriptive programming for a web page you can use.
Browser(description).WebList(description).Select anything.
Regardless of how many panes, frames, panels etc are in the hierarchy before the Weblist object.
But in Smartbear you have to store every frame, panel etc.
So that if you didn’t use the ‘Alias’ functionality you would have an object description miles long.
But even having to use the Alias, you still have to add each and every frame, panel, etc. whereas in UFT you can just use page.object and it will find the object on the page (as long as you’re using unique descriptions!!) without worrying about frames, panes, etc.
For how long have I used the solution?
We have used this solution for about two years.
What do I think about the stability of the solution?
I did not encounter any issues with stability.
What do I think about the scalability of the solution?
I did not encounter any issues with scalability.
How are customer service and technical support?
I didn’t require any technical support.
Which solution did I use previously and why did I switch?
I routinely use SmartBear, UFT, and SilkTest. I fit the application used to whatever my client requires.
How was the initial setup?
The initial setup was very straightforward. Even the mobile testing side was easy to setup
What's my experience with pricing, setup cost, and licensing?
My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it. It makes it an excellent cost saving alternative.
Which other solutions did I evaluate?
I use several tools.
What other advice do I have?
As with all tools, verify that it will do what you need for a reasonable price.
Disclosure: My company has a business relationship with this vendor other than being a customer: We are in the process of setting up a partner arrangement with SmartBear.
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros
sharing their opinions.
Updated: February 2024
Popular Comparisons
Tricentis Tosca
Automation Anywhere (AA)
Apache JMeter
OpenText UFT One
Katalon Studio
BrowserStack
Selenium HQ
OpenText ALM / Quality Center
Sauce Labs
Tricentis NeoLoad
BlazeMeter
Eggplant Test
Buyer's Guide
Download our free SmartBear TestComplete Report and get advice and tips from experienced pros
sharing their opinions.
Quick Links
Learn More: Questions:
- SAP GUI Testing Tool
- Which product do you prefer: Micro Focus UFT One or SmartBear TestComplete?
- Which is the best RPA solution for performance testing automation?
- What are your recommended Accessibility Testing tools (both open-source and licensed ones)?
- What is the best Automated Functional Testing Tool for Testing Pega Applications?
- What is the Robotic Process Automation (RPA) life cycle?
- What is End-to-End (E2E) test automation?
- Why is Test Automation Tools important for companies?
- What performance testing tool do you recommend for web applications?
- What is the best test automation tool for SAP?
Yes you are right. Our automation scripts are extensively deep and code coverage has been taken care of. BUT still, we don't blindly rely on the automation. The scripts only verify that build is fit for release but the scripts don't deliver the build. A human cycle for regression gets carried out in cases where needed.