User at a transportation company with 51-200 employees
Specflow vs Selenium
What are the pros and cons of Specflow vs Selenium?
I'm evaluating Specflow vs Selenium. Our project involves development/test efforts leading to a Web application (.net) that interacts with a windows application (Windows Service) to ultimately communicate with a field-deployed device (such as a handheld vending machine, traffic camera and similar transportation/fleet devices).
We would like to have a suite of nUnit test code bases, most preferably integrated with a UI-enabled test tool.
Performance issues and website crashes can cause constant disruptions or major disasters for your organization. In order to prevent them, you need a performance testing tool.
Performance testing is necessary to check the behavior of an application across various situations. A system can work effectively with a particular number of concurrent users, but might become dysfunctional during peak traffic. However, if you are using a performance testing tool, this helps establish speed, scalability, and stability.
Because performance testing tools create better website speed, it helps keep customers more engaged. If your website or application tends to be slow and lousy, it's unlikely that you will draw a good audience and more likely that customers will turn to your competitor instead. More important than keeping customers engaged, good website performance leads to increased revenue. Essentially, by implementing a good performance testing tool, you are setting your organization up for success.
Performance testing tools are particularly important in helping to resolve glitches and eliminate bottlenecks. By using a performance testing tool, areas that cause bugs or other problems can be identified and remedied by notifying the dev team promptly.
In addition, for obvious reasons, you want your application to work at all times. However, there are times when your organization will experience downtime, and it can be extremely costly. With a performance testing tool, though, stress tests are performed to help ensure stability.
Enterprises across different industries often require their websites, web apps & mobile apps to perform seamlessly. In order to do so, performance testing tools should be implemented.
Another good thing about performance testing tools is that you can find both commercial options as well as open-source ones. Most of them have features for extensive test automation to save time. Additionally, performance testing tools are generally very easy to download and set up.
Furthermore, performance testing tools offer a host of useful features. Some of these include report generation, multithreading, log debugging, and sampling. Most solutions also support Web UI and API services and can read test data from Excel files. Whatmore is the solutions usually don’t require a lot of resources. For example, tests can be run with a normal PC. Some are even very customizable, allowing you to use your own Java code, while others can run from a console without any user interface. And for when it’s necessary, most performance testing tools offer documentation available online.
Employing performance testing tools is a must — whether it is for a mobile app or a desktop application. Aside from offering scalability and speed, performance testing tools are reliable and robust, and have impeccable detection capabilities. If you are undecided and not sure if you need to use a performance testing tool because you think you can get off easy by doing things manually, you may want to think again. Either way, investing in a performance testing tool is certainly a good choice.
I'm afraid the question is rather too generic, but I'll try and provide some pointers.
First we need to understand what you mean by "performance testing". To a network manager, they are interested in how quickly, efficiently and securely a packet of data travels from point A to point B on a network. To an application manager, they are interested in how quickly, efficiently and securely a person can complete a unit of work using a given application. To a DBA, it's how quickly, efficiently and securely data can be accessed and stored. To a server manager they're interested in how quickly, efficiently and securely data can be processed.
Possibly more relevant in this instance is the needs of the application developer / application tester. To a developer, they are interested in understanding how their application will perform under various loads. An application is likely to perform differently under different loads. For instance, a web application with 2 users is going to behave differently than if it has 2 million users. In fact, I'd go as far as to say that understanding your potential user base should influence server, network, database design in the first place.
Effectively, they all want to optimise speed, efficiency and security - and also COST in order to deliver the best outcome for the business they are supporting.
From this common set of requirements their needs diverge rapidly into a massive variety of metrics that need to be collected.
As you can see it's a VAST area for discussion. With such a variety of requirements it's probably impossible to name a single product that can meet ALL requirements of ALL interested parties.
This very site has a good report https://www.peerspot.com/landi... that outlines application performance testing solutions. These range from free, open source solutions all the way through to enterprise class solutions.
As an ex-Micro Focus employee, I can only comment on LoadRunner. It's probably one of, if not the leading enterprise solutions out there. It supports a variety of application protocols and can simulate many many simultaneous users. I also understand that some of the simulation scripts in LoadRunner can be used by other MicroFocus tools to monitor application performance when live.
However, my main point remains. You need to understand performance at all levels of service delivery not just the application code. This may mean instrumenting code, network probes, database analytics, server performance monitoring and so forth to get a complete picture.
This is where cost comes to bear.
Instrumenting every layer of service delivery is a complex process resulting in massive amounts of data collection and processing. The overhead of managing this data collection can be prohibitive. And this is where I learned a lesson from an old boss who told me.....
"We can instrument the application, we can put network probes everywhere, we can setup monitoring tools. It'll take us a year, cost us hundreds of thousands of pounds to find out where the problem really is. We've got an application we've written with 120 users that runs like a sloth on sleeping tablets. I've ordered a new server with faster CPU's, SSD disks and more and faster memory. It's arriving in 2 weeks and costing me £15k".
I replied that he's simply sweeping the problem under the carpet and not fixing the root cause of the issue.
His reply to me was simply "I know. I'm simply making an inefficient system be inefficient faster. And by doing that, I'm saving £200k and improving things inside a month."
My point here: his priority was to get 120 people doing their given units of work faster and as quickly as possible which was different to the "techie" need to define efficiency in terms of maximm throughput for least usage of resources.
Performance testing in time of development is very important, performance monitoring in live operation is critical. The solutions to problems though don't always need to be more testing.
Just my 50p worth.
SmartBear LoadNinja is a great all-in-one test automation tool. Here are some reasons why users like it:
Speed. It is fast on almost any machine.
Accuracy of tests with fantastic results.
Great AI features with good cloud scaling.
The automation is very good.
An application can be tested across many programs with ease. For example, ...
PeerSpot’s crowdsourced user review platform helps technology decision-makers around the world to better connect with peers and other independent experts who provide advice without vendor bias.
Our users have ranked these solutions according to their valuable features, and discuss which features they like most and why.
You can read user reviews for the Top 5 Performance Testing Tools to help ...