AWS Security Hub vs Devo comparison

Why PeerSpot?

The compared Amazon Web Services (AWS) and Devo solutions aren't in the same category. Amazon Web Services (AWS) is ranked #17 in CSPM , with an average rating of 7.8, and holds a 2.6% mindshare in the category. Devo is ranked #17 in Log Management , with an average rating of 8.2, and holds a 1.4% mindshare. Additionally, 89% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 92% of Devo users who would recommend it.

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Sep 18, 2024

Devo and AWS Security Hub are prominent players in the security information and event management (SIEM) market. AWS Security Hub seems to have the upper hand because of its robust cloud-native features and scalability.

Features: Devo is valued for its efficient data integration, real-time event correlation, and adaptability to various data sources. AWS Security Hub offers extensive cloud-native features, automated compliance checks, and seamless integration with other AWS services.

Room for Improvement: Devo could improve its user experience, offer more intuitive dashboards, and enhance ease-of-use. AWS Security Hub users desire enhanced customizability, better multi-account management, and more flexibility in configuration.

Ease of Deployment and Customer Service: Devo is highlighted for a straightforward deployment process and commendable customer support. AWS Security Hub has an easy deployment within the AWS ecosystem, but support responsiveness can vary.

Pricing and ROI: Devo is seen as offering good value for money with its transparent pricing model. AWS Security Hub's pricing is higher but justified by its extensive feature set and integration capabilities.

To learn more, read our detailed Cloud Security Posture Management (CSPM) Report (Updated: September 2026).

Buyer's Guide

Cloud Security Posture Management (CSPM)

September 2026

Download the complete report

Helped 914,322 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

Qualys TotalCloud

Mindshare comparison

Cloud Security Posture Management (CSPM) Mindshare Distribution
Product	Mindshare (%)
AWS Security Hub	2.6%
Wiz	10.4%
Prisma Cloud by Palo Alto Networks	7.6%
Other	79.4%

Cloud Security Posture Management (CSPM)

Log Management Mindshare Distribution
Product	Mindshare (%)
Devo	1.4%
Splunk Enterprise Security	6.8%
IBM Security QRadar	4.5%
Other	87.3%

Log Management

Featured Reviews

reviewer2859021

Sr Security Engineer at a tech vendor with 5,001-10,000 employees

Risk-based triage has transformed container security and now prioritizes high-impact threats

The best features Qualys TotalCloud offers currently include managing cloud infrastructure and container security while facing major challenges such as alert fatigue. Traditional vulnerability scanners flag hundreds of CVEs on short-lived Kubernetes containers, some of which have no internet exposure or are gone before we can even triage them. I leverage Qualys TotalCloud to move beyond static CVSS. I use it to implement runtime exposure, correlation risk reprioritization, and shift-left integration. This notifies developers to fix a base image upstream rather than patching live ephemeral instances. In my work with cloud and container security, the biggest operational hurdle was alert fatigue. I use Qualys to shift left from static CVSS severity to context-aware risk prioritization. I correlated raw vulnerability data with real-time risk factors such as public network exposure, active runtime execution, or overly permissive IAM roles. This allows us to immediately drop the priority of isolated containers and escalate lower-severity CVEs that sit on an exposed, high-risk path. We can map these findings directly back to our CI/CD pipelines so developers can patch the root base images upstream. We have drastically cut down the signal-to-noise ratio, saved a lot of manual hours doing triage work, and ensured engineering effort goes directly towards high-impact risk reduction.

Read full review

Karthik Ekambaram

Director at Scybers

Has helped identify misconfigurations and prioritize risks but lacks multi-cloud support and deeper integration features

AWS Security Hub cannot scale up to multiple different cloud environments; it only works for AWS. There are other products in the market for CSPM that can give you multi-cloud environment misconfigurations, even Microsoft for that matter. Regarding the integration of AWS Security Hub with third-party tools, I am not certain whether we can integrate them, but there is no need to do so. However, AWS Security Hub cannot integrate with other cloud providers, so it only supports the AWS environment. The compliance checks within AWS Security Hub are good, but we don't use them much. We utilize compliance frameworks such as CIS compliance frameworks and ISO 27017 framework, which are beneficial, but it can improve in other areas too, such as including NIST and other frameworks beyond just ISO and CIS. Improvements can be applicable for scalability, particularly on integration with multi-cloud environments, and compliance frameworks can be added for more variety as well. The unified dashboard in AWS Security Hub is adequate; I cannot say it is exceptional, but the content available in the dashboards is satisfactory for now.

Read full review

Usama Khan

Team Lead Soc at a tech services company with 51-200 employees

Advanced threat hunting has improved SOC visibility and now supports faster incident response

Devo can improve in how its connectors enhance integration with third-party tools. Devo's architecture works by having you deploy a relay server in the data center of the client side and Devo SIEM is basically on the AWS cloud. There are specific ports which are enabled on the relay server, which are 514 and 13000, 13151, 152. However, when we talk about databases and custom integrations, there are not default ports in the relay server. No default ports are defined. For JDBC drivers, the port number is 1433, but it is not in the relay server. You have to add it manually. For Oracle RDBMS, the port is 1521, and it is also not there by default. I would appreciate more third-party integrations including Fortinet and others. Machine learning models can also be improved. Playbooks in the SOAR can also be improved. Regarding playbooks for automation, we utilize playbooks for automation in SOAR for automated IOC blocking on a firewall, on a web application firewall, on DNS security, etc. The only option for us to run the playbook is to schedule the job for it. However, if I want to manually run the playbook, there is no option for doing so. This needs improvement.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"The scalability is good as well. I would rate it ten out of ten."

"I highly recommend Qualys TotalCloud to other users."

"Qualys TotalCloud has helped us view our risk structure, vulnerabilities, and security posture."

"Qualys TotalCloud has saved our time by giving us better asset visibility and risk-based prioritization, as it has reduced the time spent manually reviewing CVEs and deciding what to address first."

"While automatic inventory detection upon connection is a helpful feature, a truly valuable capability would be assessing an environment's security posture against Azure and CIS best practices."

"One of Qualys' best features is its categorization, which allows us to see the types of assets, their security postures, and the AI-powered version of the tool."

"Qualys TotalCloud helps you not just to identify misconfigurations, but you can actually also fix issues."

"I depend heavily on the reports that I have from this tool."

More Qualys TotalCloud pros

"I like that AWS Security Hub currently has several good features, around four or five. The technical support for AWS Security Hub is also responsive."

"AWS Security Hub's unified dashboard does help streamline my process of identifying vulnerabilities, but we don't use Inspector."

"The platform has valuable features for security."

"Cloudposse is a valuable feature as it guarantees my security."

"I rate Security Hub ten out of ten for stability."

"It's a security posture management tool from AWS. Basically, it identifies misconfigurations, similar to Trusted Advisor but on a larger scale."

"AWS Security Hub has very good integration features. It allows for AWS native services integration, and it helps us to integrate some of the services outside of AWS. They have partners, such as Amazon Preferred Network Partners (APN). If you have different security tools around APN, we can integrate those findings with AWS Security Hub reducing the need to refer to different portals or different UIs. You can have AWS Security Hub act as a single common go-to dashboard."

"The advantage is that it is cloud-native, and we do not need to install agents or sensors to find findings."

More AWS Security Hub pros

"The features I find most valuable in Devo are that it works on unstructured data."

"It's a core tool for us in looking at logs, because logs are the starting point in any investigation, so leveraging Devo from start to finish in any investigation is basically what we do."

"Devo has improved our visibility, log management efficiency, and investigation capabilities positively."

"It centralizes security management within a business, functioning as a core system for a SOC."

"Devo saves us hours in every investigation."

"The alerting is much better than I anticipated. We don't get as many alerts as I thought we would, but that nobody's fault, it's just the way it is."

"In traditional BI solutions, you need to wait a lot of time to have the ability to create visualizations with the data and to do searches. With this kind of platform, you have that information in real-time."

"Those 400 days of hot data mean that people can look for trends and at what happened in the past. And they can not only do so from a security point of view, but even for operational use cases. In the past, our operational norm was to keep live data for only 30 days. Our users were constantly asking us for at least 90 days, and we really couldn't even do that. That's one reason that having 400 days of live data is pretty huge. As our users start to use it and adopt this system, we expect people to be able to do those long-term analytics."

More Devo pros

Cons

"The response part of the Cloud Detection and Response (CDR) module can be improved."

"There is a lack of data segregation according to criticality or inventory."

"Enhancing clarity regarding its compliance capabilities would be beneficial, as the current scope is limited in geographic coverage."

"Their customer support needs improvement."

"Overall, we are satisfied with it. However, the response part of the Cloud Detection and Response (CDR) module can be improved. It is not yet in place according to requirements; it is not completely available even though the module has been released."

"Regarding improvements to Qualys TotalCloud, I suggest that user navigation can be enhanced because initially, many users found it complicated and had trouble understanding the platform due to information being spread across multiple tabs."

"I think Qualys TotalCloud needs to improve its handling of zero-day vulnerabilities and supply chain management because modern ransomware attacks not only target prime critical infrastructures but also the supply chain system."

"The support process is inefficient due to the excessive number of replies required when submitting tickets."

More Qualys TotalCloud cons

"Whenever my team gets some alarms from the central team, my team needs to initiate whether it's a real or false trigger. The central team needs to keep adjusting to the parameters or at least the concerned IPs, whether it's really from the company's pool of IPs, so the trigger process can be improved. In the next release of AWS Security Hub, I'd like a better dashboard that could result in better alert visibility."

"There is room for improvement in implementing AI capabilities."

"Although AWS Security Hub does a periodic scan of your overall infrastructure, it doesn't do it in real time."

"Right now, there are some difficulties we're facing with AWS Security Hub, and we need our central team to mitigate the issues."

"Feature-wise, we are not able to do multi-cloud. We are doing individual cloud monitoring, and we see other tools are better than AWS Security Hub."

"The solution is not wholly self-sufficient."

"It is not flexible for multi-cloud environments."

"However, the sheer number of services can be overwhelming when implementing something new."

More AWS Security Hub cons

"The biggest area with room for improvement in Devo is the Security Operations module that just isn't there yet."

"Technical support needs to be more direct. For example, when we submit a ticket, the support team will delegate a task to the operations team, for example, or various other teams."

"I would like to have the ability to create more complex dashboards."

"The biggest area with room for improvement in Devo is the Security Operations module that just isn't there yet. That goes back to building out how they're going to do content and larger correlation and aggregation of data across multiple things, as well as natively ingesting CTI to create rule sets."

"One improvement area for Devo could be simplifying some configuration and improving the onboarding for new analysts because it is quite complex for fresher or new analysts who are handling Devo."

"My opinion on the solution's technical support is not as great as it could be because of the issues I have faced regarding the service management element."

"There is room for improvement in the ability to parse different log types. I would go as far as to say the product is deficient in its ability to parse multiple, different log types, including logs from major vendors that are supported by competitors. Additionally, the time that it takes to turn around a supported parser for customers and common log source types, which are generally accepted standards in the industry, is not acceptable. This has impacted customer onboarding and customer relationships for us on multiple fronts."

"They can improve their AI capabilities"

More Devo cons

Pricing and Cost Advice

"Its price seems higher compared to other tools, but it is worth it. If they could adjust the pricing and make it comparable with other tools, that would be great."

"Qualys TotalCloud offers good pricing that is affordable and competitive with the market. Our partnership also provides us with additional benefits."

"Although Qualys TotalCloud is relatively expensive due to its unique automation features, its cost-effectiveness is rated an eight out of ten, with ten being the most costly."

"Qualys TotalCloud is expensive."

"While Qualys TotalCloud's pricing is currently acceptable, it is becoming increasingly expensive and may soon be considered overpriced."

"Qualys TotalCloud is cost-efficient and was selected for its value compared to other products."

"Qualys TotalCloud offers cost-effective licensing flexibility."

"It isn't cheap, but it's reasonable. It helps us to manage things with very few resources."

More Qualys TotalCloud pricing and cost advice

"The pricing is fine. It is not an expensive tool."

"There are multiple subscription models, like yearly, monthly, and packaged."

"Security Hub is not an expensive solution."

"The price of the solution is not very competitive but it is reasonable."

"The cost is based on the number of compliances, core checks, and services required, and for more than 10,000 recommendations, the charge is just one dollar."

"AWS Security Hub's pricing is pretty reasonable."

"AWS Security Hub is not an expensive tool. I would consider it to be a cheap solution. AWS Security Hub follows the PAYG pricing model, meaning you will have to pay for whatever you use."

"The price of AWS Security Hub is average compared to other solutions."

"Devo is definitely cheaper than Splunk. There's no doubt about that. The value from Devo is good. It's definitely more valuable to me than QRadar or LogRhythm or any of the old, traditional SIEMs."

"It's a per gigabyte cost for ingestion of data. For every gigabyte that you ingest, it's whatever you negotiated your price for. Compared to other contracts that we've had for cloud providers, it's significantly less."

"Devo is a hosted or subscription-based solution, whereas before, we purchased QRadar, so we owned it and just had to pay a maintenance fee. We've encountered this with some other products, too, where we went over to subscription-based. Our thought process is that with subscription based, the provider hosts and maintains the tool, and it's offsite. That comes with some additional fees, but we were able to convince our upper management it was worth the price. We used to pay under 10k a year for maintenance, and now we're paying ten times that. It was a relatively tough sell to our management, but I wonder if we have a choice anymore; this is where the market is."

"Our licensing fees are billed annually and per terabyte."

"Devo was very cost-competitive... Devo did come with that 400 days of hot data, and that was not the case with other products."

"Pricing is based on the number of gigabytes of ingestion by volume, and it's on a 30-day average. If you go over one day, that's not a big deal as long as the average is what you expected it to be."

"It's very competitive. That was also a primary draw for us. Some of the licensing models with solutions like Splunk and Sentinel were attractive upfront, but there were so many micro-charges and services we would've had to add on to make them what we wanted. We had to include things like SOAR and extended capabilities, whereas all those capabilities are completely included with the Devo platform. I haven't seen any additional fee."

"Be cautious of metadata inclusion for log types in pricing, as there are some "gotchas" with that."

More Devo pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Cloud Security Posture Management (CSPM) solutions are best for your needs.

See recommendations

914,322 professionals have used our research since 2012.

Comparison Review

it_user186927

Director of Operations at a comms service provider with 10,001+ employees

Feb 16, 2015

Cybereason vs. Interset vs. SQRRL

Capture DB - they all use NoSQL db and hence solve the ad hoc query and 'go back in time' problem with current best of breed SIEM and DLP solutions that rely on real time analysis of incoming logs (and don't store them). This means deeper and quicker iterative threat analysis and assessment…

Read full review

Top Industries

By visitors reading reviews

Comms Service Provider

16%

Outsourcing Company

12%

Manufacturing Company

11%

Financial Services Firm

10%

Financial Services Firm

12%

Manufacturing Company

10%

Computer Software Company

Comms Service Provider

Financial Services Firm

13%

Outsourcing Company

11%

Construction Company

10%

Manufacturing Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

By reviewers
Company Size	Count
Small Business	14
Midsize Enterprise	6
Large Enterprise	34

By reviewers
Company Size	Count
Small Business	9
Midsize Enterprise	5
Large Enterprise	14

By reviewers
Company Size	Count
Small Business	10
Midsize Enterprise	6
Large Enterprise	12

Questions from the Community

What is your experience regarding pricing and costs for Qualys TotalCloud?

The price is very expensive, actually.

See all answers

What needs improvement with Qualys TotalCloud?

In terms of improvement, remediation still belongs to the cloud team, which is one of the issues we faced with Qualys...

See all answers

What is your primary use case for Qualys TotalCloud?

My main use case for Qualys TotalCloud is regarding the cloud visibility that we were not having previously. Previous...

See all answers

Which is better - Azure Sentinel or AWS Security Hub?

We like that Azure Sentinel does not require as much maintenance as legacy SIEMs that are on-premises. Azure Sentinel...

See all answers

What needs improvement with AWS Security Hub?

I do not see any areas for improvement in AWS Security Hub itself, but the cost factor is something that is the main ...

See all answers

What is your primary use case for AWS Security Hub?

AWS Security Hub is something I have used daily as it is a part of my job for cloud security purposes. If you are dea...

See all answers

What is your experience regarding pricing and costs for Devo?

The price is considered okay.

See all answers

What needs improvement with Devo?

Perhaps Devo could add some features in the future on the network part. Specifically, I think they could improve netw...

See all answers

What is your primary use case for Devo?

I have been using Devo as a partner and system integrator for three years. For log monitoring, the clients' use cases...

See all answers

Comparisons

Wiz vs Qualys TotalCloud

Compared 11% of the time

Microsoft Defender for Cloud vs Qualys TotalCloud

Compared 7% of the time

JupiterOne vs Qualys TotalCloud

Compared 6% of the time

Orca Security vs Qualys TotalCloud

Compared 6% of the time

Nucleus Security vs Qualys TotalCloud

Compared 4% of the time

More Qualys TotalCloud Competitors

Microsoft Sentinel vs AWS Security Hub

Compared 31% of the time

Prisma Cloud by Palo Alto Networks vs AWS Security Hub

Compared 5% of the time

Microsoft Defender for Cloud vs AWS Security Hub

Compared 4% of the time

Wiz vs AWS Security Hub

Compared 4% of the time

Datadog vs AWS Security Hub

Compared 2% of the time

More AWS Security Hub Competitors

Splunk Enterprise Security vs Devo

Compared 8% of the time

LogRhythm SIEM vs Devo

Compared 6% of the time

New Relic vs Devo

Compared 4% of the time

Datadog vs Devo

Compared 3% of the time

IBM Security QRadar vs Devo

Compared 2% of the time

More Devo Competitors

Product Reports

Buyer's Guide

Qualys TotalCloud

September 2026

Download Qualys TotalCloud product report

Buyer's Guide

AWS Security Hub

September 2026

Download AWS Security Hub product report

Buyer's Guide

Devo

September 2026

Download Devo product report

Also Known As

Qualys TotalCloud with FlexScan

SQRRL

No data available

Overview

Qualys TotalCloud enhances security posture across cloud environments with continuous monitoring, vulnerability management, and risk visualization, ensuring efficient threat assessment and automated remediation for improved cyber risk reduction.

Qualys TotalCloud offers a robust suite of security tools essential for organizations managing multi-cloud infrastructures. By integrating cloud accounts and automating workflows, it supports AWS, Azure, and GCP, offering comprehensive vulnerability management and zero-day detection. The platform's user-friendly design, combined with its extensive risk management and unified threat assessment capabilities, enables organizations to prioritize and remediate vulnerabilities effectively. TruRisk Insights provides clear insights on cyber risks, while the automation options streamline patch management and scanning processes. API integration across IaaS and SaaS environments further enhances resource allocation efficiency and saves time, addressing misconfigurations across cloud environments.

What are the most important features of Qualys TotalCloud?

Accurate Vulnerability Reports: Delivers precise and actionable insights for risk mitigation.
Zero-Day Detection: Identifies and addresses zero-day vulnerabilities proactively.
Unified Threat Assessment: Offers comprehensive evaluation of threats across the environment.
Extensive Risk Management: Manages risks effectively with advanced insights and prioritization.
Continuous Monitoring: Provides non-stop surveillance for vulnerabilities and threats.
Cloud-Native Automation: Streamlines processes and reduces manual efforts using automation.
FlexScan for Internet-Facing VMs: Scans external VMs efficiently to detect vulnerabilities.
Dashboard Risk Visualization: Clear visualization helps prioritize vulnerabilities.

What benefits and ROI should users look for?

Improved Security Posture: Enhances threat detection and response across clouds.
Time Savings: Automation reduces time spent on manual vulnerability management.
Resource Efficiency: Better allocation of resources through streamlined workflows.
Enhanced Risk Prioritization: Focus on critical vulnerabilities for effective mitigation.
Integrated Cloud Accounts: Facilitates seamless cloud management and security.

Qualys TotalCloud is deployed in sectors needing rigorous vulnerability management, such as finance and healthcare. Companies utilize it to secure multi-cloud environments like AWS, Azure, and GCP, focus on compliance, and integrate security into CI/CD pipelines to detect and remedy threats pre-deployment.

Qualys

AWS Security Hub provides multi-account management and compliance checks alongside integrations with AWS services and third-party tools. It centralizes vulnerability tracking and risk prioritization, delivering real-time alerts for proactive security management.

AWS Security Hub enhances cloud security management through a centralized dashboard that monitors infrastructure resources and compliance scores, ensuring adherence to AWS standards. With integrations for vulnerability detection and security posture management, users can streamline security operations. While the platform offers notable benefits, areas for improvement include customization options for findings suppression and integration with multi-cloud environments.

What are the key features of AWS Security Hub?

Multi-Account Management: Seamlessly manage security across numerous accounts.
Compliance Checks: Stay aligned with standards such as PCI through automated reviews.
AWS Integrations: Connect effortlessly with AWS and third-party services to enhance security posture.
Real-Time Alerts: Quickly respond to potential threats with immediate notifications.
Risk Prioritization: Focus on critical vulnerabilities to enhance resource allocation.

What benefits should users expect from using AWS Security Hub?

Proactive Security: Early threat detection enables quicker mitigation strategies.
Cloud-Native Functionality: Utilize tools tailored for cloud environments.
Compliance Insights: Simplified compliance management provides transparency.
Ease of Use: Streamlined interface facilitates efficient security management.

Industries implementing AWS Security Hub leverage its capabilities for comprehensive security across multiple accounts and regions. Health, finance, and retail sectors benefit by automating compliance checks and monitoring security infrastructures. This service aids in identifying misconfigurations, tracking alerts, and ensuring infrastructure integrity during cyber incidents.

Amazon Web Services (AWS)

Devo offers powerful visual analytics, real-time data querying, and log integration capabilities within a cloud-native, multi-tenant architecture, supporting extended data retention ideal for long-term analysis and compliance.

Devo is recognized for its Activeboards, which facilitate visual analytics. High-speed search capabilities and real-time analytics enable efficient data manipulation and querying. Its multi-tenant architecture supports effective data segregation and customization tailored to distinct business needs, enhancing its value for handling complex log integrations. With extended data retention of 400 days and a cloud-native architecture, Devo is a robust platform for long-term analysis and compliance requirements. Though opportunities exist to improve browser stability on large searches, SOAR integrations, and its parser capabilities, Devo remains essential for incident response and security monitoring, offering centralized data storage and analysis.

What are Devo's most important features?

Activeboards: Facilitate visual analytics and data exploration.
High-Speed Search: Enables fast data querying and manipulation.
Real-Time Analytics: Supports instant insights and decision-making.
Multi-Tenant Architecture: Allows effective data segregation and customization.
Extended Data Retention: Offers 400-day log retention for compliance and analysis.
Complex Log Integration: Handles intricate data sources effortlessly.

What benefits and ROI should organizations look for in reviews?

Visual Insights: Enhance understanding through interactive dashboards.
Performance Efficiency: Saves time with high-speed data search and real-time results.
Customization Flexibility: Fits specific business requirements with multi-tenant architecture.
Long-Term Compliance: Ensures alignment with extended data retention needs.
Centralized Monitoring: Enables comprehensive incident response and security monitoring.

Devo is extensively used in industries focused on incident response and digital forensics, centralizing data for security monitoring across hybrid environments. Organizations benefit from its ability to store and analyze aggregated logs, creating alerts and dashboards to enhance visibility for network and endpoint activities in multi-domain settings.

Devo

Sample Customers

Information Not Available

Edmunds, Frame.io, GoDaddy, Realtor.com

United States Air Force, Rubrik, SentinelOne, Critical Start, NHL, Panda Security, Telefonica, CaixaBank, OpenText, IGT, OneMain Financial, SurveyMonkey, FanDuel, H&R Block, Ulta Beauty, Manulife, Moneylion, Chime Bank, Magna International, American Express Global Business Travel

Buyer's Guide

Cloud Security Posture Management (CSPM)

September 2026

Download Free Report

Find out what your peers are saying about Wiz, Palo Alto Networks, SentinelOne and others in Cloud Security Posture Management (CSPM). Updated: September 2026.

DOWNLOAD NOW

914,322 professionals have used our research since 2012.

We monitor all Cloud Security Posture Management (CSPM) reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.