Selenium HQ Room for Improvement
We have a lot of inheritance going here. I've been doing it for so long, so it is pretty straightforward for me, but you have to know Java to be able to work in our framework. I know some people use Python, but you have to know Java. That's kind of the hardest thing when you're doing interviews. People just don't know Java. This is where probably Worksoft has an advantage because it is codeless. So basically, you are just pointing, clicking, and providing things like Excel spreadsheets for your test data. In that sense, if you are using Worksoft, it is a lot easier to train or onboard somebody.
One drawback to Selenium is that there is nothing like an object repository, such as that found in QTP, especially considering continuous integration practices that have become common nowadays. In future, if they can provide an object repository or some kind of repository for data, then that I would greatly appreciate it. For example, once you have the app credentials and all the other security data and you don't want to show them to other people who are not authorized, a repository for this kind of data would be very useful. You could then simply grant access to only those people who need it.
Another improvement I can think of is in the area of documentation and support. With Selenium, we're using freeware software, and because of this there is no support or anything from the vendor. In this case, you have to rely solely on your own coding experience and exposure to the tool, and you often have to search through many pages of code when you want to change something in your implementation. It also makes you rely on your problem-solving skills to a large degree, because some problems are not that easy to solve by yourself.
If I can compare Selenium with another solution such as SoapUI Pro, there's a big difference when it comes to coding your own solutions. With SoapUI Pro, if you want to fetch some data, you don't need to write any code or anything, and for someone with no coding experience, this makes it much easier to be able to use effectively. So, ultimately, more support for non-technical people would make for a great improvement in Selenium.
Senior Project Engineer at a tech services company with 10,001+ employees
Beyond the many advantages that Selenium HQ brings, there are also several disadvantages. For example, there are some complex scripts which can make Selenium unreliable in some cases.
For email-based applications, we can't automate as we would like to, making it necessary to bring in a third-party product to do so. Eggplant, for example, offers email-based processing, like with the OCR engine, and for automation testing and reporting I would like to see a similar feature in Selenium.
Director Technology at Simplify 3x
Selenium is good when the team is really technical because Selenium does less built-in methods. If it came with more built-in and pre-built methods it would be even easier for less technical people to work with it. That's where I think the improvement can be.
I would also like to see a good method for image based automation. That's what I believe is a very upcoming thing and is something that Selenium really lacks. The imagery is kind of an automation. It's more of an object decipher, so that's something I really want to see because most of the tools are moving in that direction.View full review »
Software engineer at a financial services firm with 10,001+ employees
Selenium should implement more islands for a desktop feature. My laptop and desktop have a calibrator or some other desktop applications. We can automate those things through Selenium, so they should be adding them in the subsequent versions. For now, I guess Selenium could add some other features like object communications for easy expansion.
There are some network issues, as the line is not very clear.
There are some areas that need improvement. I continuously see failures in threads when it is running in parallel.
I find that it fails, especially when I use APM automation on the mobile side. I have experienced these issues, and since the APM is also based on the Selenium pack.
It is a challenge to locate them, or knowing the location of the unique elements on the APM application. I don't see many issues with the Web applications but there are several with the APM.
As an open-source solution, there is no dedicated support.
Extending functions on the codes would be very helpful.View full review »
Sometimes it's difficult to understand the solution. It's a good solution, however, it has many specific things you need to know, or you need to learn about. For people that don't know about technology, maybe it's difficult to use. You have to know how to program. You need to be a developer.
The tool has two steps: first, when you record, and second when you play back. However, in the middle, you need to look at a file. You need to save a file and after that look at them. It would be ideal if the solution allowed for the process to be one step and more automatic.
The initial setup is quite complex.View full review »
There are a few things we have to actually design and plan when we are building the automation. There are new tools which handle it by themselves, but that is a give and take when you actually use or choose a tool.
Shadow DOM could be improved and the handling of single page applications. Right now, it's a bit complicated and there are a lot of additional scripts required if you want to handle a single page application in a neat way.
With this technology, if you enter something, it will go back to the server, get some value, and then it will enable the button. At some point of time, your project's delayed, and there is a callback happening in the background. It will not try to understand that, and it may just timeout.View full review »
Software quality engineer at a healthcare company with 10,001+ employees
In terms of what could be improved, there are some glitches with it, but whenever you report it, the open source community works on it and fixes it. There is no support here. If I say in the user community that it's not working, I have to go and check Openstack and extract questions and answers from the community. There is not any company that is supporting it that could help me. There is no particular documentation about it that can help me in a technical way. I would have to see people's user experience and see what they have done in such and such scenarios.
Sometimes we face challenges with Selenium HQ. There are third party tools that we use, for example for reading the images. They are not easy to plug in. The third party add-ons are difficult to get good configuration and do not have good support. I would like to see better integration with other products.
In the next release, I would like OCR, image recognition, to be built-in. Sometimes there are no code elements that are detectable so finding x paths is tough. Whenever there are some challenges here, we could use OCR or something similar, with good image recognition.View full review »
A great improvement could be in the user experience which is necessary as it does not have much. The use is too technical; it is not designed for the end-user. The best way to maintain the test scenarios over time should be considered. If the test scenarios are not subdivided correctly, it is very likely that maintenance will become very expensive and re-use is unlikely. This would ultimately mean that it would reflect the possible benefits in the projects and, on the contrary, the use of the solution ends up being more expensive.View full review »
The reporting part can be better. They need some APIs or maybe in-built libraries for reporting. At times, it's difficult to locate elements on certain applications on the web. Locating the elements, like web tables, becomes a little difficult sometimes. They can improve that feature also.
I'm based in Romania, and we have a personal crisis. We do not have enough resources or enough people to employ and hire. So, I'm hiring whoever I find, and they don't always have enough technical knowledge to operate Selenium.View full review »
In the past, we had difficulty with screenshots, but this has been remedied. We feel that all the current solutions are usable and the providers are helpful.
This said, the login could be improved, to obviate the need for relying on another one for integration with Selenium HQ. It would be nice if the solution provided an internal login system, one which would allow us to easily debug it. Until such time as a login system will be added from the vendor application, it will not be possible to identify the exact cause of a potential failure, unless there should be an interaction with, say, the UI element. Selenium HQ currently allows for an exception should an element be stale, not be found, or intractable.View full review »
Associate QA Manager at Xcel Serv Solution
The parallel testing in Selenium is lacking.
The latest versions are often unstable.
There's no UI in Selenium. Beginners who want to start using it must have knowledge of Java, Python, or any programming language. If you are using a Chrome extension, that is a BlazeMeter extension, you can record and make the script, however, that is not very helpful for beginners.
The editor is based on Eclipse. It would be nice if there was some in-built UI for this.
I am leading a 20 person team where I have some junior staff and we have to set up lots of demos and training for them to be comfortable with Selenium.
Occasionally, if someone is downloading the latest version of Java, it might not align with the Selenium version. There needs to be a way for Selenium to alert you if there will be a conflict between versions.View full review »
Systems Analyst at a computer software company with 1,001-5,000 employees
Whenever an object is changed or something is changed in the UI, then we have to refactor the code. This means that we have to spend a lot of time on maintenance.View full review »
Software Engineer at a financial services firm with 10,001+ employees
Selenium HQ doesn't support Windows-based applications, so we need to integrate with the third-party vendor. It would be great if Selenium could include Windows-based automation. You need to integrate it with a third-party tool if you want to upload any files. When we interact with a Windows application, we usually use Tosca.
It also doesn't support dynamic capture, graphical presentation, or cloud functionality. We need to integrate with multiple things.View full review »
Coding skills are required to use Selenium, so it could be made more user-friendly for non-programmers. If you purchase Katalon Studio, then it comes with an interface for Selenium.
If there were other tools or companies that integrated with Selenium then it would be helpful. At the moment, it's just Katalon.
It would be helpful if there was an organization that we could reach out to, in order to get support for the product. As it is now, you have to find help yourself. For example, you may have to use Google search to look for similar issues and discover how they were resolved.View full review »
It would be better if it accommodated non-techy end-users. I think it's still a product for developers. That's why it's not common for end-users, and especially for RPA activities or tasks. It's hard to automate tasks for end-users. If it will be easier, more user-friendly, and so on, perhaps it can be more interesting for this kind of user.
The second thing, when you are working in IT, you know about such tools. But if you are on the business side, you don't have much information at all.
I would like to see easy onboarding with training for end-users. Because there is a lot of stuff for developers, but for end-users, I would say none or approximately none.View full review »
The Selenium stop control has been a challenge. We use auto IT for handling some of the small controls, small scenarios on the desktop, it needs to be improved with a configuration tool where it can handle desktop support as well as Ajax controls. Basically, there needs to be an improvement in handling the Ajax custom controls because the inbuilt method is not very helpful in that respect.
Quality and Testing Services Leader at a tech services company with 11-50 employees
Selenium has problems with some objects. The objects are not in the squares of the screen. The layout can be a bit strange. It makes it hard to find objects.
We'd like to see some more image management in future releases.View full review »
Automation Lead - Robotic Process Automation at a financial services firm with 501-1,000 employees
In terms of improvement, there should be standardized frameworks, which do not exist. Currently, you have to first sit down and look inward. This function is provided by some tools like Katalon.
There should be standardized frameworks to build automation.View full review »
I find Selenium to be slow - its server takes a long time to interact with your browser and sometimes fails. It's also somewhat outdated, for example, it has no capacity to handle things like desktop pop-ups, does not support mobile testing, and has very limited reporting. In future releases, I would like Selenium to focus on headless execution when executing their test cases, using PhantomJS or Chrome Headless.View full review »
Selenium HQ can improve the authorization login using OTP, it is not able to be done in this solution.View full review »
I would like more usability and ease of use.
The graphical interface could be improved. It would be very helpful to be able to write scripts in a GUI, rather than depend so heavily on the command line.View full review »
Project Director at a computer software company with 10,001+ employees
The locating of web elements is a complex process where you require the WebDriver application and create a locator by using By Class. They are not always matching.
It would be better to have a simplified way to locate and identify web elements.
Another negative point is that you cannot delete the application, you can only delete the web application.View full review »
Automation Test Lead at a financial services firm with 501-1,000 employees
Selenium uses a layer-based approach that is somewhat slower than Eggplant when it comes to executing code. The performance is something in need of improvement.
There is no direct option for image validation and this would be a useful addition in the future. In our application, we have a graphical representation that needs to be validated, and it can be done by validating all of the images. However, we can't do that with Selenium so we don't cover these scenarios in our test cases.View full review »
QMS Lead at a pharma/biotech company with 11-50 employees
It would be better if we could use it without having the technical skills to run the scripting test.View full review »
It is not a licensed tool. The problem with that is that it won't be able to support Windows desktop applications. There is no support for Windows desktop applications. They can do something about it.
Its user interface can also be improved, which is not great compared to the other latest tools.
Anybody who has been working on functional testing or manual testing cannot directly work on Selenium HQ without learning programming skills, which is a disadvantage.View full review »
Senior Test Engineer at a tech services company with 51-200 employees
Selenium HQ could have better interaction with SAP products.View full review »
Developer / Team Lead at a computer software company with 11-50 employees
I don't have that much experience with it, but I know that Selenium is more used for websites. It is not for testing desktop applications, which is a downside of it. It can support desktop applications more.
Automation Leader at a energy/utilities company with 201-500 employees
I would like for the next release to support parallel testing.View full review »