Bitbar vs Perfecto comparison

Cancel
You must select at least 2 products to compare!
SmartBear Logo
1,561 views|1,147 comparisons
50% willing to recommend
Perforce Logo
5,678 views|3,900 comparisons
88% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Bitbar and Perfecto based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
To learn more, read our detailed Functional Testing Tools Report (Updated: April 2024).
767,847 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"Ability to use different frameworks.""Game testing and the API for apps are good."

More Bitbar Pros →

"The automation piece is the most valuable feature. Every time we had a new version of either OS or an application, we found that being able to automate the testing across different devices is very valuable.""We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost.""In terms of Perfecto's ability to perform cross-platform testing, I would rate it a ten out of ten.""Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot.""We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us.""One of the good things about Perfecto is the scalability that it provides.""The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests.""We are continuously doing testing on different environments, devices, and platforms. It executes seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices."

More Perfecto Pros →

Cons
"Lacking capability options that can be directly integrated.""Their pricing structure is complicated and can be improved."

More Bitbar Cons →

"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools.""The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well.""We don't use Perforce's BlazeMeter with Perfecto. From my perspective, it's not really relevant.""There could be some improvements done on the interface. At times, there has been a bit of a struggle when finding things on the interface. A UI revamp would be a better option in future. That UI hasn't changed much in a long time, so I think they could just make it a bit better so that people could find stuff easily and intuitively.""We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required.""Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making.""When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good.""If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."

More Perfecto Cons →

Pricing and Cost Advice
  • "The pricing is complicated. It's in the middle."
  • More Bitbar Pricing and Cost Advice →

  • "This is an expensive solution compared to others, by 30% to 40%."
  • "I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
  • "Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
  • "Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
  • "Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
  • "Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
  • "It's definitely on the higher end of prices for this type of service."
  • "Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
  • More Perfecto Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
    767,847 professionals have used our research since 2012.
    Questions from the Community
    Ask a question

    Earn 20 points

    Top Answer:Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every… more »
    Top Answer:Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts… more »
    Top Answer:It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working… more »
    Ranking
    26th
    Views
    1,561
    Comparisons
    1,147
    Reviews
    0
    Average Words per Review
    0
    Rating
    N/A
    3rd
    Views
    5,678
    Comparisons
    3,900
    Reviews
    18
    Average Words per Review
    1,397
    Rating
    8.6
    Comparisons
    BrowserStack logo
    Compared 33% of the time.
    SmartBear TestComplete logo
    Compared 16% of the time.
    CrossBrowserTesting logo
    Compared 14% of the time.
    Sauce Labs logo
    Compared 14% of the time.
    BrowserStack logo
    Compared 35% of the time.
    Sauce Labs logo
    Compared 25% of the time.
    Appium logo
    Compared 10% of the time.
    AWS Device Farm logo
    Compared 6% of the time.
    Katalon Studio logo
    Compared 3% of the time.
    Also Known As
    Testdroid
    Perfecto Mobile, Perfecto Web
    Learn More
    Overview
    Testdroid is a set of mobile software development and testing products by Bitbar Technologies Limited. Testdroid comprises three different products: Testdroid Cloud, Testdroid Recorder and Testdroid Enterprise. Testdroid provides an application programming interface through open source software available on GitHub. Testdroid can use testing frameworks, such as Robotium, Appium and uiautomator for native and Selenium for web applications, targeted for mobile application and game developers. Testdroid Cloud contains real Android and iOS powered devices, some of which are available for users. Testdroid Cloud lets users run tests simultaneously on cloud-based service. Testdroid Recorder is a tool for developers and testers for recording user-actions and producing JUnit based test cases on mobile application and games. Testdroid Recorder is available at the Eclipse marketplace. Testdroid Enterprise is a server software for managing automated testing on multiple real Android and iOS powered devices, supporting Gradle build system and Jenkins Continuous Integration.

    Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

    Perfecto Features

    Perfecto has many valuable key features. Some of the most useful ones include:

    • Live Stream analysis
    • Reporting/analytics
    • Activity dashboard
    • Action-word testing
    • Bug tracking
    • Debugging
    • BDD & codeless automation
    • Model-based testing
    • Real-time monitoring
    • Role-based permissions
    • User management
    • Test failure analysis
    • Real user simulation

    Perfecto Benefits

    There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

    • Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.
    • Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.
    • Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.
    • AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.
    • Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

    Reviews from Real Users

    Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

    Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

    Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

    A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

    Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

    Sample Customers
    Rovio, Paf, Supercell, NITRO Games, Seriously, AVG, Google, Bosch, Yahoo, Microsoft, Yandex, Mozilla, eBay, PayPal, TESCO, Cisco WebEx, Facebook, LinkedIn, skype, Subway
    Virgin Media, Paychex, Rabobank, R+V, Discover
    Top Industries
    VISITORS READING REVIEWS
    Computer Software Company18%
    Government10%
    Financial Services Firm9%
    Healthcare Company8%
    REVIEWERS
    Financial Services Firm44%
    Insurance Company11%
    Comms Service Provider11%
    Computer Software Company11%
    VISITORS READING REVIEWS
    Financial Services Firm19%
    Computer Software Company17%
    Manufacturing Company8%
    Recreational Facilities/Services Company7%
    Company Size
    VISITORS READING REVIEWS
    Small Business25%
    Midsize Enterprise13%
    Large Enterprise62%
    REVIEWERS
    Small Business4%
    Midsize Enterprise4%
    Large Enterprise92%
    VISITORS READING REVIEWS
    Small Business21%
    Midsize Enterprise11%
    Large Enterprise68%
    Buyer's Guide
    Functional Testing Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools. Updated: April 2024.
    767,847 professionals have used our research since 2012.

    Bitbar is ranked 26th in Functional Testing Tools while Perfecto is ranked 3rd in Functional Testing Tools with 23 reviews. Bitbar is rated 7.0, while Perfecto is rated 8.4. The top reviewer of Bitbar writes "It's helped me when I've been short of devices and want to test whether the application will work on a specific device or not". On the other hand, the top reviewer of Perfecto writes "Its reporting allows us to have a clear view regarding what tests have been executed". Bitbar is most compared with BrowserStack, SmartBear TestComplete, CrossBrowserTesting and Sauce Labs, whereas Perfecto is most compared with BrowserStack, Sauce Labs, Appium, AWS Device Farm and Katalon Studio.

    See our list of best Functional Testing Tools vendors.

    We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.