PeerSpot user
Test Lead at a pharma/biotech company with 5,001-10,000 employees
Real User
It is easy with the CI integration to have tests going in after a few hours
Pros and Cons
  • "Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours."
  • "There have been various times throughout the last month or so where the service has gone down during business hours."

What is our primary use case?

Using Jenkins to call Selenium tests running from Serenity BDD with Gradle. It is very easy to get tests going in this manner.

How has it helped my organization?

It makes my life much easier. 

What is most valuable?

Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours.

What needs improvement?

There have been various times throughout the last month or so where the service has gone down during business hours. This has impacted a release or two, so it is definitely less than ideal. Increasing uptime would be a good focus.

Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,065 professionals have used our research since 2012.

For how long have I used the solution?

One to three years.

What do I think about the stability of the solution?

Over the last month or so, there have been times the service was unavailable at less than ideal times.

What's my experience with pricing, setup cost, and licensing?

Now that we have an enterprise license, we no longer have to worry about minutes each month!

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
IT Software Testing Analyst II at a manufacturing company with 5,001-10,000 employees
Vendor
It's enabled several employees to schedule tests and shift left with CI, but getting accurate pass/fail results when running parallel TestNG scripts is a challenge, though we figured it out.

Valuable Features:

Ability to quickly spin up VMs to test combinations of browsers and operating systems is a must.  

This service allowed me to get tests running within an hour of signing up!

Improvements to My Organization:

This service has enabled several employees here to schedule tests and shift left with CI, which offers reliability and minimizes variability.

Room for Improvement:

Getting accurate pass/fail results when running TestNG scripts in parallel by class is a challenge but after some work we figured out a solution.  I have also heard some complaints about lag when spinning up VMs but it is so much faster than the alternative that I don't mind.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,065 professionals have used our research since 2012.
it_user208599 - PeerSpot reviewer
Software Development Engineer at a computer software company with 501-1,000 employees
Vendor
The combination of OS platforms, platform versions, browsers and browser versions support on VMs are valuable.

What is most valuable?

The combination of OS platforms, platform versions, browsers and browser versions support on VMs.

How has it helped my organization?

Cross browser and cross platform testing on our test case scenarios.

What needs improvement?

A little clarity on documentation when integrating with third party APIs will help the users. Take for example, when a high-level language like Gherkin comes into the picture- how should users handle it?

For how long have I used the solution?

I've used it for four months.

What was my experience with deployment of the solution?

No issues with deployment.

What do I think about the stability of the solution?

No issues with stability.

What do I think about the scalability of the solution?

Yes, the parallelization is not possible now when cucumber and junit are used together.

How are customer service and technical support?

Customer Service:

Haven't had the need to interact with them.

Technical Support:

Haven't had the need to call them.

Which solution did I use previously and why did I switch?

We weren't previously using a different solution.

How was the initial setup?

Straightforward since the cloud based examples were clear.

What about the implementation team?

Implemented in-house.

What was our ROI?

Working on open sourcing an API based on Sauce Labs support that can benefit both the parties and the community in general.

What's my experience with pricing, setup cost, and licensing?

Our monthly cost as of now is $149/month for a small team.

Which other solutions did I evaluate?

No, we used local machines by installing different versions of browsers and platforms. I am now trying to promote this idea of using Sauce Lab across my company moving forward.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user783597 - PeerSpot reviewer
Software Engineer at a marketing services firm with 51-200 employees
User
Testing across multiple devices and environments is now possible to do quickly and effectively
Pros and Cons
  • "Testing across multiple devices and environments is now possible to do quickly and effectively."
  • "Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."

What is our primary use case?

Testing a browser-based application. We have a hotel booking site which is used across a wide variety of platforms. Starting out, we are mainly used for manual checks. However, we are in the process of getting automation.

How has it helped my organization?

Testing across multiple devices and environments is now possible to do quickly and effectively.

What is most valuable?

Being able to test on real devices is a big deal. 

What needs improvement?

Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit.

For how long have I used the solution?

Still implementing.

Which solution did I use previously and why did I switch?

Previously, we only had four test devices, and it usually took awhile to even track them down. We often were not able to duplicate reported issues with the tools we had.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Software Tester at a transportation company with 10,001+ employees
Vendor
Their technical support and customer service are excellent

What is most valuable?

  • Parallel run
  • Real device testing

How has it helped my organization?

Fast automation.

What needs improvement?

Playback needs improvement.

For how long have I used the solution?

For two years.

What was my experience with deployment of the solution?

No issues.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues.

How are customer service and technical support?

Customer Service:

Their customer service is excellent.

Technical Support:

Their technical support is excellent.

Which solution did I use previously and why did I switch?

No.

How was the initial setup?

The initial setup is straightforward.

What about the implementation team?

The implementation was done in-house.

What's my experience with pricing, setup cost, and licensing?

It is good.

Which other solutions did I evaluate?

No.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Senior QA Analyst, Test Automation at a tech company with 10,001+ employees
Real User
Cross browser/OS testing and mobile testing.

Valuable Features:

Cross browser/OS testing and mobile testing.

Improvements to My Organization:

We work on a complex SaaS web application which has lot of regression testing. If we were to run all our tests on different browsers/different OS combinations, we would need lot of new infrastructure and VM's. But with Sauce labs, we were able to use Remote WebDriver and connect to their VM's which have all the combinations we are looking for.

Room for Improvement:

We still see simulators for a few mobiles in their VM's, we want to test on real devices. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Consultant with 1,001-5,000 employees
Vendor
With it, we have a clean, lean, and bug-free site that displays well on mobile, though the cost could be improved.

Valuable Features:

Sauce has all of the wanted features, from just about any major OS, any major browser, and different resolutions. I can't imagine how complicated it is to support such a vast array but they seem to have done it. A client has an issue on FF on 1920x1080? No problem. I can spin up a VM instance and instantly confirm the issue. This helps us bring a new responsive web experience to users and quickly fix strange issues that would literally require a server farm to have each version of every OS!

Improvements to My Organization:

A more clean, lean, and bug-free site! We know our site works on mobile. We know our site looks good on Safari 8 1280x1024. We know android phones display the website perfectly. It makes sure that the user doesn't get a bad experience which is crucial these days.

Room for Improvement:

I don't really know of any, I wish everything life was a bit cheaper, so maybe that? I honestly have no complaints. They did all of the hard work so our lives are easier and the users get a better experience every time.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Software Developer Trainee at a tech services company with 10,001+ employees
Consultant
We can fire thousands of events to devices and run all our tests in the cloud, but the 7-days scheme should be removed.

What is most valuable?

The temporary storage they are giving is just awesome. You can run all your tests in the cloud on one powerful platform.

How has it helped my organization?

I was just surfing to know about monkey runner and selenium tools, I encountered this cool tool and boom. Thousands of events can be fired easily to your device. Purchasing it would be worth it.

What needs improvement?

None as of now. Soon I will be purchasing ( if my Director approves :P) then i can honestly tell you. The 7-days scheme should be removed.

For how long have I used the solution?

2 weeks

What was my experience with deployment of the solution?

No. The configuration of server explained properly.

What do I think about the stability of the solution?

No.

What do I think about the scalability of the solution?

No. The most famous selenium integration is enough to show off your scalability.

How are customer service and technical support?

Customer Service:

4.8 out of 5

Technical Support:

4.5 out of 5

Which solution did I use previously and why did I switch?

No.

How was the initial setup?

Somewhat complex in terms of configuring server.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2024
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.