2022-05-15T09:42:00Z
Miriam Tover - PeerSpot reviewer
Service Delivery Manager at PeerSpot
  • 0
  • 20

What advice do you have for others considering StreamSets?

If you were talking to someone whose organization is considering StreamSets, what would you say?

How would you rate it and why? Any other tips or advice?

5
PeerSpot user
5 Answers
TH
Senior Network Administrator at a energy/utilities company with 201-500 employees
Real User
Top 20
2022-12-01T21:40:00Z
Dec 1, 2022

The ease of using StreamSet to move data into modern analytics platforms, on a scale of one to 10, is about a five. The solution enables you to build data pipelines without knowing how to code if it's the latest, state-of-the-art cloud connecting stuff. If it's for anything structured for Oracle and SQL Server and other data sources, it's difficult. Without knowing how to write code, some of it's easy and some of it is not. My advice to someone who is considering this software is to be very aware that their integrator and data analysis people will need a very specific skill set.

Search for a product comparison
Prateek Agarwal - PeerSpot reviewer
Technical Program Manager at Indian Institute of Management Visakhapatnam
Real User
Top 5Leaderboard
2022-08-21T07:36:00Z
Aug 21, 2022

Go through your data integration requirements and compare the other solutions with your requirements. But I hope StreamSets works perfectly with your requirements, because it has all the features that you require. Sometimes we use StreamSets’ Transformer for Snowflake functionality when the data is huge and cannot be integrated through other processes. Transformer for Snowflake is quite good, useful, and easy to set up. But it requires some initial setup training. It is used when you have a large volume of data through your API calls or through IoT devices.

Karthik Rajamani - PeerSpot reviewer
Principal Engineer at Tata Consultancy Services
Real User
Top 10
2022-06-14T17:08:00Z
Jun 14, 2022

It is very user-friendly, and I promote it big time in my organization among my peers, my juniors, and across different departments. They're growing rapidly. I can see them having a lot of growth based on the features they are bringing. They could capture a lot more market in coming times. They're providing a lot of new features. I love the way they are constantly upgrading and improving the product. They're working on the product, and they're upgrading it to close the gaps. They have developed a data portal recently, and they have made it free. Anyone who doesn't know StreamSets can just create an account and start using that portal. It is a great initiative. I learned directly on the corporate portal license, but if I were to train somebody in my team who doesn't yet have a license, I would just recommend them to go to the free portal, register, and learn how to use StreamSets. It is available for anyone who wants to learn how to work on the tool. We use StreamSets' ability to move data into modern analytics platforms. We use it for Tableau, and we use it for ThoughtSpot. It is quite easy to move data into these analytics platforms. It is not very complicated. The problems that we had were mostly outside of StreamSets. For example, most of our databases were on-prem, and StreamSets was installed on the cloud, such as AWS Cloud. There were some issues with that. It wasn't a drawback because of StreamSets. It was pretty straightforward to plug and play. I have used StreamSets Transformer, but I haven't yet used it with Snowflake. We are planning to use it. We have a couple of use cases we are trying to migrate to Snowflake. I've seen a couple of demos, and I found it to be very easy to use. I didn't see any complications there. It is a great product with the integration of StreamSets Transformer and Snowflake. When we move data from legacy databases to Snowflake, I anticipate there could be a lot of data drift. There could be some column mismatches or table mismatches, but what I saw in the demo was really fantastic because it was creating tables during runtime. It was creating or taking care of the missing columns at runtime. It is a great feature to have, and it will definitely be helpful because we will be migrating our databases to Snowflake on the cloud. It will definitely help us meet our customer goals at a faster pace. I would rate it a nine out of ten. They're improving it a lot, and they need to improve a lot, but it is a great product to use.

SS
Senior Data Engineer at a energy/utilities company with 1,001-5,000 employees
Real User
Top 20
2022-06-09T15:40:00Z
Jun 9, 2022

Every tool in the market at the moment has some major gaps, especially for large enterprises. It could be the way that the data or pipeline is secured. At present, StreamSets looks like the market leader and is trying to fill that gap. For anyone going through a proof of concept for various tools, StreamSets is almost at the top. I don't think that they need to look any further. We are working only with API, a relational database management system, and our enterprise warehouses at the moment. We are not using any streaming sort of ingestion at the moment. We are not using Snowflake Transformer yet. It just got released. We are using a traditional Snowflake destination stage because our enterprise is huge. We have our own Snowflake architecture. We load the security in the data into our own databases using the destination stage, not Transformer yet. I would rate the solution as 7.5 out of 10.

AbhishekKatara - PeerSpot reviewer
Technical Lead at Sopra Steria
Real User
Top 10
2022-05-15T09:42:00Z
May 15, 2022

For people who are starting out, the simple advice is to first try out the cloud login of StreamSets. It is freely available for everyone these days. StreamSets has released its online practice platform to design and create pipelines. Someone simply needs to go to cloud.login.streamsets.com, which is StreamSets official website. It is there that people who are starting out can log into StreamSets cloud and spin up their StreamSets Data Collector machines. Then, they can choose their execution mode. It is all in a Docker-containerized fashion. You don't need to do anything. You simply need to have your laptop ready and step-by-step instructions are given. You just simply spin up your Data Collector, the execution mode, and then you are ready with the canvas. You can design your pipeline, practice, and test there. So, if you want to evaluate StreamSets in basic mode, you can take a look online. This is the easiest way to evaluate StreamSets. It is a drag-and-drop, UI-based approach with a canvas, where you design the pipeline. It is pretty easy to follow. So, once your team feels confident, then they can purchase the StreamSets add-ons, which will provide them end-to-end solutions and vendor support. The best way is to log into their cloud practice platform and create some pipelines. In my current project, there is a requirement to integrate with Snowflake, but I don't have Snowflake experience. I have not integrated Snowflake with StreamSets yet. I personally love working on StreamSets. It is part of my day-to-day activities. I do a lot of work on StreamSets, so I would rate them pretty well as nine out of 10.

Learn what your peers think about StreamSets. Get advice and tips from experienced pros sharing their opinions. Updated: January 2023.
670,523 professionals have used our research since 2012.
Related Questions
ML
Co-Founder & Chief Analytics Officer at Great Data Minds, LLC
Dec 10, 2021
Hi, So many products in the market these days for building, deploying & monitoring Data Pipelines for Cloud based analytics.  Currently, I'm assessing Matillion ETL and StreamSets, which appear on par (on the surface). I'm curious what 1st hand experiences folks have. Thanks for the help!
See 1 answer
EB
Director of Community at PeerSpot (formerly IT Central Station)
Dec 10, 2021
Hi @reviewer1292532 ​and @reviewer1339230, can you please assist @Mike Lampa with this question?
Miriam Tover - PeerSpot reviewer
Service Delivery Manager at PeerSpot
Dec 1, 2022
Hi, We all know it's really hard to get good pricing and cost information. Please share what you can so you can help your peers.
2 out of 6 answers
MP
Data Engineer at a energy/utilities company with 10,001+ employees
Nov 19, 2020
We are running the community version right now, which can be used free of charge. We were debating whether to move it to the commercial version, but we haven't had the need to, just yet.
AbhishekKatara - PeerSpot reviewer
Technical Lead at Sopra Steria
May 15, 2022
StreamSets Data Collector is open source. One can utilize the StreamSets Data Collector, but the Control Hub is the main repository where all the jobs are present. Everything happens in Control Hub.
Explore this product
Download Free Report
Download our free StreamSets Report and get advice and tips from experienced pros sharing their opinions. Updated: January 2023.
DOWNLOAD NOW
670,523 professionals have used our research since 2012.