PeerSpot user
Sr. Performance Test Engineer at a tech services company with 201-500 employees
Consultant
Allows us to off-load our local environments using the SauceCloud.
Pros and Cons
  • "The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
  • "Running tests in the SauceCloud can take longer than running in a local environment."

What is most valuable?

The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud.

How has it helped my organization?

We're able to utilize the local server space more efficiently now that we utilize the SauceCloud for regression runs that have typically been resource-intensive.

What needs improvement?

Running tests in the SauceCloud can take longer than running in a local environment.

For how long have I used the solution?

I have been using it for six months or so.

Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,065 professionals have used our research since 2012.

What was my experience with deployment of the solution?

We have not encountered any deployment issues.

What do I think about the stability of the solution?

We have not encountered any stability issues. SauceCloud is great.

What do I think about the scalability of the solution?

We have not encountered any scalability issues. SauceCloud handles all of this for us!

How are customer service and support?

Customer Service:

I have not directly communicated with customer service.

Technical Support:

I haven't had to use technical support; documentation is great. I can usually find an answer online if needed.

Which solution did I use previously and why did I switch?

We previously used a locally scaled Selenium stack.

How was the initial setup?

There were some issues with our firewall and the tunnel for the SauceCloud. But we were able to overcome the hurdles fairly quickly.

What about the implementation team?

An in-house team implemented it.

What was our ROI?

Currently, the biggest return has been in the ability to re-purpose local environments, previously dedicated to regression testing. Also, freeing up the engineers to work on other tasks while Sauce handles the regression across multiple browsers.

What's my experience with pricing, setup cost, and licensing?

We have an enterprise account; it has worked great for our needs.

Which other solutions did I evaluate?

We didn't find anything that directly compared to Sauce Labs.

What other advice do I have?

It's a great tool!

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Engineer at a tech services company with 10,001+ employees
Consultant
Excellent solution for running functional and unit tests in browsers

Valuable Features:

  • Video recording / screencasts
  • Very fast response from customer service
  • Mobile Web, and Native Mobile Support
  • Can handle massive amounts of parallel tests
  • Manual testing sessions
  • In-browser unit tests 

Improvements to My Organization:

  • No longer have to manage VMs for testing. No more browser upgrading and dismissing dialogs and windows that stack up.

Use of Solution:

2 years

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Sauce Labs
March 2024
Learn what your peers think about Sauce Labs. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
769,065 professionals have used our research since 2012.
PeerSpot user
Test Engineer II at a tech services company with 201-500 employees
Consultant
The multitude of browser and OS versions are helpful for broadening testing scope.
Pros and Cons
  • "I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
  • "We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."

What is most valuable?

I find that the multitude of browser and OS versions are very helpful for broadening testing scope.

How has it helped my organization?

Helps us free up local environment space and has freed up time for more exploratory testing with QA engineers.

What needs improvement?

I don't feel there are any real areas for improvement. As long as you follow best practices for programming automated tests and running them via Sauce Labs, then things tend to go smoothly.

For how long have I used the solution?

I have used it for one year.

What was my experience with deployment of the solution?

There were no real issues with deployment that weren't easily solved by reviewing documentation or having another pair of fresh eyes on the issues.

What do I think about the stability of the solution?

We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements. Following best practices in our automated code also helps minimize stability issues.

What do I think about the scalability of the solution?

We haven't had any scalability issues so far. We have built a fairly scalable automated framework to handle expansion.

How are customer service and technical support?

Customer Service:

Customer service is 10/10. Sauce Labs is quick to help and easy to reach out to for information or troubleshooting. They even make an effort to keep in touch and reach out preemptively.

Technical Support:

Technical support is 10/10; plenty of resources to research before reaching out to tech support. As I've stated, Sauce Labs is very approachable and makes the effort to check in on you.

I’m satisfied with the services that SauceLabs provides. For me personally, as someone just learning all about implementation and exploring the tool, I have no valid complaints about the service itself. Any blockers I come across are easily solved by reviewing documentation, contacting a representative, or sitting down with someone locally who is more familiar with SauceLabs to solve any issues.

Which solution did I use previously and why did I switch?

We did not previously use another solution

How was the initial setup?

Setup was straightforward because we had help from employees that had previous experience. Additionally, documentation was helpful and it is easy to reach out to a Sauce Labs representative for hands-on help.

What about the implementation team?

We implemented through an in-house team.

What was our ROI?

Sauce Labs helps us free up local environments, free up time for more exploratory testing, and assists in getting releases certified and pushed to production.

What's my experience with pricing, setup cost, and licensing?

Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s). They are definitely worth looking into and will most likely be the way to go.

Which other solutions did I evaluate?

Sauce Labs was implemented as a solution before I joined the company so I'm unaware of what other tools, if any, were evaluated.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Web Producer at a tech company with 10,001+ employees
Real User
Valuable for the multitude of devices and browser/OS combinations they provide for real device testing.

What is most valuable?

Sauce Labs is valuable to my job for the multitude of devices and browser/OS combinations they provide for real device testing. I am able to eliminate the part where I have to find a human with that device or browser and have them test (potentially not even do that correct), and do the testing quickly at my desk. It also allows Selenium script testing which eliminates more human error.

How has it helped my organization?

It has improved our organization by testing our website on more devices and browsers that what our company currently owned. We were able to test on the newest browsers without installing them on our computer, or testing the newest OS without having to update our mobile devices.

What needs improvement?

It would be nice if they could ask for the URL and what browser/OS I want to test in, but not just one combination, I want the ability to start up 10 concurrently at a time. I would also like to put in a username and password before the launch of the test so it will auto put those in all on 10 instead of going into 10 tabs and having to put the same information over and over again.

For how long have I used the solution?

Our company has been using SL for almost 2 years now in my department, and several more years in other departments.

What do I think about the stability of the solution?

Initially there was some stability issues with IE9 combos but have since been resolved. They have excellent customer service.

How are customer service and technical support?

Customer service is top notch. When you report a bug or inquire about something they get back to you with a plan of action, not just "ok we will let our team know". It's refreshing having a company that wants to work better for its customers.

Which solution did I use previously and why did I switch?

Previously we used BrowserStack, but since they couldn't comply to our legal terms we were able to find Sauce Labs and are better for it.

How was the initial setup?

Sauce Labs was very easy to use for it's basic needs, but using Sauce Connect was very confusing. I am a technical person, but the documentation needs to be a little more "dummy" friendly for nonprogrammers. This sites documentation is really more geared for the software engineer rather than the Qa Engineer in my opinion.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Quality Assurance at a educational organization with 51-200 employees
Vendor
The most important and valuable feature is the ability to select multiple browsers and environments to test and configure how your site runs and works, but the main interface can be slow to load.

Valuable Features:

Sauce Labs is an amazing product for the work that I do, and there are many different solutions for testing out there. Sauce Labs in particular, I have used on many occasions within different roles and I found it to be a good alternative to options such as Browserstack. 

The most important and valuable feature is the ability to select multiple browsers and environments to test and configure how your site runs and works. This process eliminates the need for any virtual machines taking up disk space on servers, and now Sauce Labs streamlines the testing process by being able to have these virtual instances of OS and Browsers right on-demand. 

I particularly found the tabbed view of Sauce Labs useful, allowing me to have multiple browser sessions open (one for, say, each operating system as well as different browser brands) along with its clean and minimal interface. These are features which aren't found in other testing suites and are definite bonus! 

As a newbie to automation testing and having experience in using a wide range of on-demand tools, my main aspect of Sauce Labs involves using the 'Manual Testing' option, which is brilliant. You simply selected the URL and choose the browser and environment, and within minutes you'll simply have a virtual environment to play with, and it is really that simple.

Another useful aspect of Sauce Labs' product is that you can allow it to take screenshots, videos and logs, which are really, really handy. Having dealt with many issues that end users see whilst a website is being developed on, often is the case that issues are hard to replicate. Knowing Sauce Labs is there to record this (in case I can't replicate it), makes this a tool which you can share the experience with other users. 

The configuration and options within Sauce Labs are endless, which makes it an excellent product. A well-designed and minimal interface has also helped me to stay productive and keep focused on the main tasks which I use it for (manual on-demand testing and using different environments to see expected behavior for our platform).

Over time, I aim to expand into the automation area which looks great from the outset and be able to automate some tedious tests which could reduce the amount of time that I spend testing, and ensure I can continue to capture bugs and issues more effectively.

Improvements to My Organization:

This hasn't necessarily changed the way in which the organization functions, but has added to my skill set. Currently, Sauce Labs fits very well within the other services (Ghost Inspector, Browserstack) which I currently use and it's a tool that is there for me to be able to have the flexibility to test on demand and use whichever configuration is right for me. For example, our user base will mainly be clients using Internet Explorer 10, 11 and Edge on Windows 10 or IE and, therefore, having these environments at my disposal is really handy. 

As a QA person, it is ultimately my responsibility to ensure that our product is tested on as wide a range of devices as possible and Sauce Labs helps to achieve this through the multiple environments that it offers and being able to multitask is an added benefit. 

For me, it has improved the way I function as I don't require the use of virtual machines and the headache of setting them up, and running tests on local computers meaning adding to the myriad of devices already on my desk! Streamlined, easy access to testing when I need to - that's already the benefit to me of Sauce Labs.

Room for Improvement:

The main interface, although clean, is sometimes very slow to load on slower connections and selecting a machine and waiting for it to boot up the environment takes a lot longer than other products I have used. This sluggishness also increases when the user tries to navigate the environment and interact with it. Selecting Microsoft Edge on Windows 10 gave me a really slow response time and took a while to boot up. All virtual environments are expected to be slow, however the interaction between the user and keyboard presses / mouse clicks wasn't very synchronized, and often the lag that is caused distracts away from the full experience. 

Manual testing also opens up in a separate browser tab, which I'm not sure why, but should ideally load over the main dashboard. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Software Testing Architect at a healthcare company with 501-1,000 employees
Vendor
Since using Sauce, our team is able to focus on automating more processes, expanding, and new industry standards.

Setting up and maintaining internal VMs was difficult and was wasting hours of developer time. Our full stack regression process involved manual testing that took up to a week to complete. Traffic continued to increase, so the team set out to automate the processes. We knew our testing tool needed to scale with us, work cross-platform and on any OS, be easy to use, and provide detailed post-test reporting to enable us to diagnose failures. When our testing responsibilities expanded to include mobile apps on iOS and Android, we knew Sauce was a natural fit.

Sauce Labs’ videos, screenshots, and in-session debugging tools have enabled employees to work together in different cities. It’s a big part of what allows me to work remotely and to continue to easily communicate with my team. We can troubleshoot together using video, so the process is almost instantaneous. Since using Sauce, our team is able to focus on automating more processes and expanding best practices and new industry standards such as mobile CI.

Recently we’ve started to use Appium, a cross-platform mobile automation framework, and are in the process of pulling their mobile apps into Jenkins. Currently, Github commits kick off their mobile regression tests that run on Sauce and they’re working on integrating those test results into their feedback loop. For mobile in particular, Sauce is great. We’d face a lot of problems if we had to maintain a functional mobile lab on our own. Lastly, having access to every version of every browser has an added benefit of making onboarding easy. There isn’t a long set up process for new team members’ VMs any more. There’s no need to debug unique issues on each new laptop. We just use Sauce Labs, and it’s smooth sailing. Sauce enables us to do our mobile app testing as easily as we do our web testing.

Disclosure: PeerSpot has made contact with the reviewer to validate that the person is a real user. The information in the posting is based upon a vendor-supplied case study, but the reviewer has confirmed the content's accuracy.
PeerSpot user
PeerSpot user
Senior Software Test Automation Engineer at a tech vendor with 10,001+ employees
Vendor
Easy scaling to multiple web platforms. They still have platform-specific issues, especially on Mobile platforms.

What is our primary use case?

We use SauceLabs for Mobile, Browser and Backend testing.

Our QA requirement is to test our apps against all major browser platforms including Safari, Firefox, Chrome and Internet Explorer.

Apart  of visual and functional testing of the application components, we also collect network traffic produced by the apps for further analysis. With latest update, accessing har files got supported natively by the SauceLabs.

For mobile testing we leverage Sauce Connect tunnels as we need to connect the application under test to the corporate network and collect the produced traffic as well.

How has it helped my organization?

1. Achieved better cross platform test coverage for both Browser and Mobile testing

2. Frontend and Backend testing are now more connected

3. With Sauce Analytics we now use resources in more optimal way and too extensive cloud resources usage is no longer a concern

4. We no longer need to support a huge farm of mobile devices - SauceLabs Real Device Cloud works pretty well for us.

5. In some cases, like peak real device usage, SauceLabs Real Device Cloud doesn't work as well due to the delay required to release devices after testing sessions end

What is most valuable?

1. Easy scaling to multiple web platforms -> SauceLabs was the cheapest option for us

2. Support of tunneling traffic from the cloud to the enterprise network -> that is just essential for our testing

3. Video recording of tests execution process -> shortened root cause analysis time for use by 30%

4. User groups management and cloud resources consumption control -> now each group of users under our organization has dedicated pool of devices/emulators and concurrent resources access is no longer an issue

What needs improvement?

1. They still have very slow support and ask many excessive questions before starting to fix the issue.

When we submit tickets in their reporting system, we expect them to start tracking down the problem as soon as possible. Instead, it looks like they ask standard questions just to delay work to a few days. E.g. 
1st day: "Could you confirm you use the latest version" - "Yes, we do"

2nd day: "Ok. Can you then try to run that with extra flag Y and grab the log for us" - "Yes, please, take the log"

<2 days of silence>

5th day: ... - "Guys, is there any progress on that?"

and so on...

Sometimes questions are really unrelated and take time like "Have you read the Getting Started guide?"

2. They still have platform-specific issues, especially on Mobile platforms. They wouldn't affect trivial tests though.

E.g. they have issues related to SauceConnect traffic routing specific to iOS 9 and Android 4.

This affect tests that want to sniff the traffic only though. Please, let me know if you want more technical details.

3. Sometimes they change configuration options (e.g. rename...

E.g. recently they changed desired capability for iPhone Simulator in a way like "iPhone 6 simulator" > "iPhone 6"

That affected multiple tests suddenly. They haven't made any notification about that though.

For how long have I used the solution?

I believe, for more than 7 years already

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
DevOps Market Analyst / Enterprise Architect at a tech services company with 51-200 employees
Consultant
Being a cloud based testing grid is really the key feature.

Valuable Features:

Being a cloud based testing grid is really the key feature. But inside the product the killer features for us was the new CI dashboard of test results, and the recording of bugs into JIRA.

Improvements to My Organization:

We are small. Most small dev teams do not consider testing as much. But this is exactly why we needed sauce. Quality was priority from day one. And with only developers the only solution was automated testing, and a test grid we did not have to manage ourselves. We choose Sauce because of it's popularity, but also because they have a good relationship with the market and show their interest in helping the market get better with test automation.

Room for Improvement:

I would like to see it work directly with Azure Web Apps so that we do not have to have a separate step to run tests, or setup complex flows in Jenkins.  

Because our application front-end runs one Azure Websites which is a PaaS solution, we do not have server access and this makes it challenging for use to work with some external tools. I would like to see sauce labs have a direct integration with Azure Web App slots. This way we would not have to make the test runs a manual step. Currently we initiate tests manually and if they pass we do a manual promotion from an Azure Web Slot. We could integrate Jenkins or other release automation tool, but this would be additional overhead on top of what Azure provides out of the box. Another way to do this, instead of a direct integration with Azure. Is if their was a way to run tests in Sauce upon ever commit of a specific branch in GitHub. This way we could have a branch just for automation, and would not need to involve Azure Web App slots at all.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2024
Buyer's Guide
Download our free Sauce Labs Report and get advice and tips from experienced pros sharing their opinions.