Sauce Labs Reviews

Testing subscription videos for on-demand software, making them better quality and bug free for our customers.

It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers.

• Cloud testing
• Performance testing
• Continuous integration testing
• Easy to integrate with the other platform for tracking purposes.

Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers.

No issues.

No issues.

I have not contacted customer service or technical support so far.

Sauce Labs is the first service that I am using.

It was built by my team before I joined the company.

In-house.

Compared with other services, Sauce Labs is a bit expensive.

We evaluated different services, e.g., LambdaTest.

I am now an expert in Sauce Labs and can build more test scripts.

As we began architecting a CI/CD pipeline in our SDLC, a need quickly arose for left-shifted, continuous testing of our web applications in real browsers. Specifically, a service that could integrate seamlessly with our Jenkins CI servers and executing tests continuously against our Dockerized applications and firewalled environments. Furthermore, our company does not have the resources to implement and maintain a proprietary Selenium Grid for test distribution. Sauce Labs addresses all of these concerns, and furthermore offers a platform for manually debugging applications in any combination of platforms, browsers, and devices needed, either from an automated test script or from a manual test session. The largest selling point for our needs is its relatively seamless integration with our Jenkins CI servers, including detailed playback and test reports per build job, as well as easy configuration of the proxy tunnel used to access our firewalled environments and desired browsers-under-test, right from the Jenkins UI via their Sauce OnDemand Jenkins Plugin.

Prior to moving to a continuous delivery model, we were on a classic two week regression testing cycle, mostly conducted via manual testing and manually-executed automated tests scripts in a large integrated testing environment. Upon shifting our SDLC to be more continuous, and rearchitecting our delivery pipeline, we were able to very quickly shift that long testing cycle to be integrated into the delivery pipeline itself by left-shifting these deep functional/regression tests to be executed during build time on our CI servers, and the implementation of these automated tests scripts being integrated into the development effort itself. Sauce Labs allowed all of this to happen by supplying the service needed to execute automated browser tests in from a CI server without having to implement or maintain our own proprietary grid of virtual machines.

Of all the services explored, Sauce Labs offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline, and integrates best with Jenkins. The Jenkins UI plugin offers a way to easily configure browser settings for tests being executed continuously. The Sauce Connect Proxy is a necessary technology for companies who have firewalled testing environments, as well as localhost testing. Test reports (that also integrate seamlessly with Jenkins jobs) are also detailed and incredibly useful. Browser support is quick to be updated as new versions of browsers are released. The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing.

The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports. Currently, in order to tap into these capabilities, a programmatic solution is required from the test code rather than being able to configure them via the Jenkins Plugin UI, e.g., desktop resolution, browser automation binary versions, remote Selenium version, and browser console logs. These are all things it would be nice to be able to customize straight from the Jenkins Plugin UI. 

In our experience, we have also had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt. 

User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure. Test job queuing is a first-come-first-serve, meaning there is no inbuilt way to queue batches of jobs from different Jenkins servers/accounts.

Occasionally there are issues with the stability of the Sauce Connect Proxy during Jenkins builds, which can cause builds to fail seemingly inexplicably, since determining the root cause is oftentimes difficult.

The only issue is cost. Each new unit of concurrency you add to your enterprise license represents a relatively linear increase in cost.

When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk".

BrowserStack was also explored, but did not integrate with out intended CI/CD model as extensively or seamlessly as Sauce Labs was able to.

Real time VM access for functional testing and manual usage.

• Sauce Connect
• VM access

Reliable access to VMs with built-in recording and log tools have improved release reliability and confidence.

Implementing user requests at a faster rate.

Two years.

No major issues. Just adapting to meet our needs and existing infrastructure.

No problems other than the occasional service disruption.

Scaling options are available for purchase, but scaling by improving and streamlining our processes has been the best approach.

Excellent, responsive, and goes above and beyond.

No.

Unknown, as I was not part of the initial work to perform the setup.

The implementation was done in-house.

High confidence in our automated testing, along with auditability.  

Select a plan that offers scaling, but investigate the ability to improve existing processes.

Yes, Stackdriver.

Running the automation test in the cloud with different sets of devices for both iOS and Android mobile apps.

Automation running is very easy and fast now with the help of Sauce Labs.

Some of the new features could be improved, for example, the playback on simulators.

Two years.

No.

No.

No.

Their customer service is good.

Their technical support is great.

No.

The initial setup was straightforward.

Good.

The setup was very easy and straightforward. The cost is also affordable.

No.

I like using Sauce Labs.

• Cross multiple browser testing
• Emulators and simulators are very helpful during automation testing.

Automation test runs are faster now with Sauce Labs.

The connectivity needs improvement.

Two years.

No issues.

No issues.

No issues.

Their customer service is good.

Their technical support is good.

No.

The initial setup is straightforward.

The implementation was done in-house.

It is good.

The price is affordable.

No.

It is a great tool to use.

• Parallel run
• Real device testing

Fast automation.

Playback needs improvement.

For two years.

No issues.

No issues.

No issues.

Their customer service is excellent.

Their technical support is excellent.

No.

The initial setup is straightforward.

The implementation was done in-house.

It is good.

No.

What I like the most is the cloud running the automation test with the help of a number of devices. I like that we can use both Android and iOS devices for testing.

Manual testing is also so much easier with Sauce Labs. Running cross browser testing is the most useful functionality for me.

With Sauce Labs testing, manual plus automation is very easy. It reduces running test times.

Connectivity needs to increase.

Two years.

No issues.

No issues.

No issues.

Good.

Good.

No.

It was straightforward.

In-house.

Good.

It is a good purchase. The cost is also good.

No.

Use it, and enjoy testing with Sauce Labs.

All its features are very good. I like the following the most:

• CI integration
• Cross browser testing
• Multiple test runs at one time
• Language support

We now have faster and more furious testing with a better quality of testing.

Speed and connectivity need improvement.

I have used this solution for two years.

No issues.

Yes, it disconnects sometimes while the automation is running.

No issues.

Good.

Good.

No. I did not previously use a different solution.

The initial setup was straightforward.

It was implemented in-house.

Our ROI is good.

The pricing is okay. It is worth purchasing.

No.

It is a good tool with variety of functionality.