Postman vs Runscope comparison

"The solution is open-source and does the work required for day-to-day API testing activities."

"Postman is open-source and free to use."

"It is simple, easy to use and a good tool."

"The solution is stable."

"The variables part is good. We can easily define the variables and we don't have to manually do a change every time, it gets automatically updated."

"With Postman you can do automation. Automation has increased efficiency by more than 30% or 40%. Because the speed has increased, it's also possible for us to do in-sprint automation testing."

"The solution has helped us very well in testing endpoint URLs."

"Postman helps to write pre-request scripts and make a collection out of each request. You don’t have to spend time writing or copying the requests. The solution lets you integrate multiple environments and their features. Either the tool’s pro or premium version lets you do the merge and pull request for the Git directly."

"Environment initial variables allow our team to run tests against multiple environments on the fly."

"As we have the APIs scheduled, we use the notifications. We know the exact moment it is breaking something that might impact the customer system, that might result in a feature not working. We know "in advance" and we can fix it before the customer notices. It helps us to be more proactive."

"The feature of automatically executing tests at a predefined time interval is great as we can be continuously testing our end-points before and after builds are deployed."

"This solution has improved our responsiveness to issues in both production and non-production environments. Through integration with Slack, our development and DevOps teams are quickly aware of issues related to new changes deployed to non-production environments, which tightens our feedback loop during testing. Through integration with PagerDuty, our DevOps resources are able to reduce the adverse impact of a given production issue."

"Valuable features include: Being able to add tests as sub-tests in a parent test for regression testing; notifications for tests that pass/fail; being able to customize expected results with assertions; being able to set tests to run daily."

"It is a relatively reliable tool for running big amounts of API tests, which you can schedule to run periodically, as the product is very good."

"It is a cloud-based environment for building and executing tests, which allows me to focus on building, running, and reviewing test results."

"You can run it off the cloud and against different data centers. That's one of the plus points for most people for this product, as opposed to some other solutions."

"It would be beneficial to expand functionality with additional testing options."

"I would like to see more integrations with other platforms."

"Initially, the setup is a little bit complex"

"Could be more user friendly."

"One thing which Postman needs to improve is the documentation. The documentation of Postman is not that great when compared to other tools."

"I was not even aware that it was possible to automate tasks in Postman...Some features related to the automation of tasks need to be added to the solution."

"I don't think there is any need for comments on improvements."

"The solution can be improved by providing detailed error logs including the line the error took place to make it easier to correct."

"the built-in editor for the scripts can be improved a lot. Instead of making such a basic editor, maybe include a little more so it is easier to look at things and debug."

"Currently, we can only schedule to the nearest five minutes, one hour, two hours, etc. If we could set up the exact time that we want it to run, that would be good because sometimes we have one service that crosses another service."

"We would like to have an improved ability to share a set of tests across different environments (e.g., dev, stage, and prod)."

"We would like to be able to select the actual time a test will run automatically. It appears that you can set up the automatic schedule, but the test runs based on the last time it ran and not a time you select. Since we want these tests to run in the middle of the night, it would be nice to be able to select that."

"We would like the ability to configure Runscope behavior when a given test has its schedule modified. That is, in a non-production environment, we often need to pause a test (either by removing it from the schedule or adjusting its frequency) and this results in the automatic kick-off of this test in all other environments. We would like the ability to simply pause a test for a specific shared environment without causing additional tests to be started."

"We definitely make use of historical test results, especially when tracking more difficult issues such as timeouts. Per our test frequency (15 minutes) we often need to go back further than the last 100 test runs. We are aware that results further back in time are available through the Runscope API, however, it would be great if the dashboard allowed easy access to a larger amount of historical data."

"It would be nice to be able to generate API documentation."

"The user interface requires a lot of clicking around."

"I use the tool's free version."

"The solution's price is reasonable."

"We do not pay any money for Postman."

"Postman is a free service."

"I am using the free option."

"Unlike APIs, the solution does not require a license."

"I rate the product's price a nine or ten on a scale of one to ten, where one is cheap, and ten is very expensive. Postman is an expensive tool for Turkey."

"We are using the free version that is available."

"Runscope pricing is unbeatable"

"Having the different plans organized by team size, buckets, and requests per billing period works for our needs. Larger companies may need to take a close look at these elements."

"The price for the product is very reasonable for a team of more than four to five members."

"Pricing is fair."