IT Expert at a comms service provider with 1,001-5,000 employees
Real User
Top 20
An inexpensive and flexible suite that helps users integrate varied legacy systems
Pros and Cons
  • "The best thing about this solution is that it is very powerful and very cheap."
  • "The upgrade path should be improved because it is not as easy as it should be."

What is our primary use case?

We primarily use this product to integrate legacy systems.

How has it helped my organization?

It helps us work with older products and more easily create solutions. 

What is most valuable?

The most valuable thing about this program for us is that it is very powerful and very cheap. We're using a lot of the program's modules and features because we're using software and hardware that can be difficult to integrate. For example, we're using supersets and a lot of old products from difficult systems. We love having the various options and features that allow us to work with flexibility.

What needs improvement?

We are using HDTM circuit boards, and I worry about the future of this product and compatibility with future releases. It's a concern because, for now, we do not have a clear path to upgrade. The Hadoop product is in version three and we'd like to upgrade to the third version. But as far as I know, it's not a simple thing.

There are a lot of features in this product that are open-source. If something isn't included with the distribution we are not limited. We can take things from the internet and integrate them. As far as I know, we are using Presto which isn't included in HDP (Hortonworks Data Platform) and it works fine. Not everything has to be included in the release. If something is outside of HDP and it works, that is good enough for me. We have the flexibility to incorporate it ourselves.

Buyer's Guide
Apache Hadoop
April 2024
Learn what your peers think about Apache Hadoop. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,334 professionals have used our research since 2012.

For how long have I used the solution?

We have been using the product for about five years.

What do I think about the stability of the solution?

The product is well tested and very stable. We have no problems with the stability of it at all. Really we just install it and forget about fussing with it. We just use the features it offers to be productive.

What do I think about the scalability of the solution?

This is a scalable solution and we like what it does. It is currently serving about 100 users at our organization and it seems like it can handle more easily.

How are customer service and support?

We actually have not used technical support. Everything we needed a solution for we just use Google and it's enough for us. Sometimes we do have issues, but not often. The issues are mainly to do with the terminals because it's a bit complicated to integrate these other systems. We have managed to solve all the problems up till now.

Which solution did I use previously and why did I switch?

We had a very old version of Hadoop which was already installed by another company and we upgraded it. We didn't really switch we just upgraded what was here.

How was the initial setup?

The initial setup wasn't very easy because of the incredible security, but we have managed to get by that. It's sort of simple, in my opinion, once you get past that part. I think, in all, it took about half of a year. But it wasn't a new deployment, it's an upgrade and the bigger challenge was moving the data. We pretty much just supported the existing product and moved to HDP.

What about the implementation team?

We have everything on-premises and we did the deployment and maintenance. 
It took four people. We want to increase usage of Hadoop and we are thinking about it very heavily. We're actually in the process of doing it. At the same time, we are integrating things from other systems to Hadoop.

What other advice do I have?

I would give this product a rating of eight out of ten. It would not be a ten out of ten because of some problems we are having with the upgrade to the newer version. It would have been better for us if these problems were not holding us back. I think eight is good enough.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Technical Lead at a government with 201-500 employees
Real User
Good distributed processing and performance, but very expensive
Pros and Cons
  • "The performance is pretty good."
  • "The solution is very expensive."

What is most valuable?

The distributed processing is excellent. 

On the solution, Spark is very good. 

The performance is pretty good.

What needs improvement?

For the visualization tools, we use Apache Hadoop and it is very slow.

It lacks some query language. We have to use Apache Linux. Even so, the query language still has limitations with just a bit of documentation and many of the visualization tools do not have direct connectivity. They need something like BigQuery which is very fast. We need those to be available in the cloud and scalable.

The solution needs to be powerful and offer better availability for gathering queries.

The solution is very expensive.

For how long have I used the solution?

I've been using the solution for about five years now.

What do I think about the stability of the solution?

The solution is stable and offers good performance. It doesn't crash or freeze. It's not buggy at all.

What do I think about the scalability of the solution?

You can scale the solution if you need to. We find that it's pretty easy to expand it out.

There were about 13-20 people using it at any given time.

How are customer service and technical support?

The technical support was pretty good. It's my understanding that the company was pretty satisfied with the level of support they received. They were knowledgeable and responsive.

Which solution did I use previously and why did I switch?

I've also worked with MySQL and Postgres. Hadoop is more for analytical processing. While the others claim to have a distributor, Hadoop is far better in that regard. It's excellent compared to other options.

How was the initial setup?

The initial setup was pretty straightforward. It was not overly complex for our team.

What's my experience with pricing, setup cost, and licensing?

The solution isn't cheap. It's quite costly.

What other advice do I have?

The solution is perfect for those dealing with a huge amount of data. Still, you need to check to make sure it meets your company's requirements. You need to understand them before actually choosing the technology you'll ultimately use.

Overall, I would rate the solution at a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache Hadoop
April 2024
Learn what your peers think about Apache Hadoop. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,334 professionals have used our research since 2012.
PeerSpot user
Database/Middleware Consultant (Currently at U.S. Department of Labor) at a tech services company with 51-200 employees
Consultant
​There are no licensing costs involved, hence money is saved on software infrastructure​
Pros and Cons
  • "​​Data ingestion: It has rapid speed, if Apache Accumulo is used."
  • "It needs better user interface (UI) functionalities."

What is our primary use case?

  • Content management solution
  • Unified Data solution
  • Apache Hadoop running on Linux

What is most valuable?

  • Data ingestion: It has rapid speed, if Apache Accumulo is used.
  • Data security
  • Inexpensive

What needs improvement?

It needs better user interface (UI) functionalities.

For how long have I used the solution?

Three to five years.

What's my experience with pricing, setup cost, and licensing?

There are no licensing costs involved, hence money is saved on the software infrastructure.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Founder & CTO at a tech services company with 1-10 employees
Real User
Processes large data sets across clusters of computers
Pros and Cons
  • "Hadoop is designed to be scalable, so I don't think that it has limitations in regards to scalability."
  • "From the Apache perspective or the open-source community, they need to add more capabilities to make life easier from a configuration and deployment perspective."

What is our primary use case?

We mainly use Apache Hadoop for real-time streaming. Real-time streaming and integration using Spark streaming and the ecosystem of Spark technologies inside Hadoop.

What is most valuable?

I actually like most of the capabilities, but I think Spark has added reposit capabilities on top of the Hadoop ecosystem. The Spark area includes the capabilities that I like the most with Hadoop. 

What needs improvement?

I don't have any concerns because each part of Hadoop has its use cases. To date, I haven't implemented a huge product or project using Hadoop, but on the level of POCs, it's fine. 

The community of Hadoop is now a cluster, I think there is room for improvement in the ecosystem.

From the Apache perspective or the open-source community, they need to add more capabilities to make life easier from a configuration and deployment perspective.

For how long have I used the solution?

I have been using this solution for roughly five years.

What do I think about the stability of the solution?

I've never experienced any bugs or glitches.

What do I think about the scalability of the solution?

Hadoop is designed to be scalable, so I don't think that it has limitations in regards to scalability.

How was the initial setup?

It's a well-known fact that Hadoop's configuration is pretty hard. 

What other advice do I have?

Usually, people need to study and prepare for a few use cases and compare multiple ecosystems before choosing one. When people think of using a big data solution, Hadoop comes to mind. For certain use cases, Hadoop is comparable with other technologies. For example, when building a sort of real-time data warehouse — an enterprise data hub —, people don't think about using Hadoop directly. People often use solutions like DROID for building.

At the end of the day, you need to compare technologies — existing technologies against their use cases. You need to study your use case and select the technology inside of Hadoop that will fit your use case. You may find another ecosystem that solves your problem, just keep in mind, Hadoop is not the only solution, there are a lot of solutions. It depends on the use case. 

Overall, on a scale from one to ten, I would give Hadoop a rating of eight.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user1093134 - PeerSpot reviewer
Technical Architect at RBSG Internet Operations
Real User
Good database and highly scalable, with good plug and play analytics tools
Pros and Cons
  • "The most valuable feature is the database."
  • "It would be good to have more advanced analytics tools."

What is our primary use case?

We are primarily dumping all the prior payment transaction data into a loop system and then we use some of the plug and play analytics tools to translate it.

What is most valuable?

The most valuable feature is the database.

What needs improvement?

We're finding vulnerabilities in running it 24/7. We're experiencing some downtime that affects the data.

It would be good to have more advanced analytics tools.

For how long have I used the solution?

I've been using the solution for five years.

What do I think about the scalability of the solution?

The solution is scalable. From a payments perspective, we're using the solution on a large scale.

How are customer service and technical support?

We've never contacted technical support.

Which solution did I use previously and why did I switch?

We didn't previously use a different solution.

How was the initial setup?

The initial setup was complex. There was a lot of data that we had to bring over from various sources and it was quite a long process.

What about the implementation team?

We did have some assistance with the implementation.

What other advice do I have?

We use the on-premises deployment model.

We're more inclined towards an operational data source to fill our customer's needs. Hadoop is good for analytics and some reporting requirements. 

It's a good solution for those needing something for the purposes of management reporting.

I'd rate the solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user693231 - PeerSpot reviewer
Big Data Engineer at a tech vendor with 5,001-10,000 employees
Vendor
HDFS allows you to store large data sets optimally. After switching to big data pipelines our query performances had improved hundred times.

What is most valuable?

HDFS allows you to store large data sets optimally.

How has it helped my organization?

After switching to big data pipelines, our query performance improved a hundred times.

What needs improvement?

Rolling restarts of data nodes need to be done in a way that can be further optimized. Also, I/O operations can be optimized for more performance.

For how long have I used the solution?

I have used Hadoop for over three years.

What do I think about the stability of the solution?

Once we had an issue with stability, due to a complete shutdown of a cluster. Bringing up a cluster took a lot of time because of some order that needed to be followed.

What do I think about the scalability of the solution?

We have not had scalability issues.

How are customer service and technical support?

The community is very supportive and provided prompt replies and suggestions to JIRA tickets.

Which solution did I use previously and why did I switch?

We didn’t have a previous solution. It was a move from RDBMS to big data.

How was the initial setup?

Initial setup of a few nodes was simple, but as we increased the node count it became complex, as we need to maintain rack topology, etc.

What's my experience with pricing, setup cost, and licensing?

It’s free and it is open source.

What other advice do I have?

I would suggest using this product. We were able to use this for petabytes of data.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Abhik Ray - PeerSpot reviewer
Co-Founder at Quantic
Real User
Top 5
Powerful data ingestion and consolidation tools prepare the data for predictive analytics
Pros and Cons
  • "The most valuable features are powerful tools for ingestion, as data is in multiple systems."
  • "It would be helpful to have more information on how to best apply this solution to smaller organizations, with less data, and grow the data lake."

What is our primary use case?

The primary use is as a data lake. 

How has it helped my organization?

Using this solution has allowed us to consolidate the data. It has made it such that data science-based algorithms can be written for predictive analytics.

What is most valuable?

The most valuable features are powerful tools for ingestion, as data is in multiple systems.

What needs improvement?

It would be helpful to have more information on how to best apply this solution to smaller organizations, with less data, and grow the data lake.

For how long have I used the solution?

I have been using Apache Hadoop for two years.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user1208307 - PeerSpot reviewer
Practice Lead (BI/ Data Science) at a tech services company with 11-50 employees
Real User
Good for managing and replication of big data but needs a better user interface
Pros and Cons
  • "It's good for storing historical data and handling analytics on a huge amount of data."
  • "The solution could use a better user interface. It needs a more effective GUI in order to create a better user environment."

What is most valuable?

The solution is perfect for when you have big data. It's good for managing and replication.

It's good for storing historical data and handling analytics on a huge amount of data.

What needs improvement?

It could be because the solution is open source, and therefore not funded like bigger companies, but we find the solution runs slow.

The solution isn't as mature as SQL or Oracle and therefore lacks many features.

The solution could use a better user interface. It needs a more effective GUI in order to create a better user environment.

For how long have I used the solution?

I've been using the solution for seven years.

What do I think about the stability of the solution?

The solution is stable.

What other advice do I have?

I've used the solution under cloud, hybrid and on-premises deployment models.

I'd recommend the solution, but it depends on the company's requirements. If you don't have huge amounts of data, you probably don't need Hadoop. If you need a completely private environment, and you have lots of big data, consider Hadoop. You don't even need to invest in the infrastructure as you can just use a cloud deployment.

I'd rate the solution seven out of ten. I'd rate it higher if it had a better user interface.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Apache Hadoop Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Product Categories
Data Warehouse
Buyer's Guide
Download our free Apache Hadoop Report and get advice and tips from experienced pros sharing their opinions.