What is our primary use case?
My main use case for Redpanda is primarily for streaming, and I am currently focusing on building data lakehouses because I find them really interesting.
Redpanda fits into my data lakehouse setup by normally fetching a source of data and mapping and transforming the data, so there are many ways to do that. I am exploring the possibilities of Redpanda, such as mapping the data with Redpanda Connect, or as an alternative, implementing my own solution. There are several ways to approach this. Additionally, I can sync the transformed data into any other destination, which really helps. Redpanda, through Redpanda Connect for instance, makes that really easy, and I am exploring those possibilities.
I have many areas to add about my use case or how I am experimenting with Redpanda. It is not about the streaming itself. It is about configurations, schemas, schema evolution, schema drift, how to map data in many ways, as well as configuration for governance, deployment, security, and control access. There are many areas that I would like to deep dive into and to control and to learn that I find really interesting in general with Redpanda. I think it is a really good software. As an alternative to Kafka, I think it is an amazing drop-in, and with one binary. That is a real advantage because other alternatives are really heavy. I see Redpanda as really light in that sense, so it is an amazing product.
What is most valuable?
The best features Redpanda offers start with its single binary, which helps a lot. Managing Redpanda through the command-line interface is a really big advantage. Having one binary, a UI, and a dashboard with the configuration helps a lot as well. The command-line interface and the UI are amazing, apart from the configuration regarding streaming, topics, and queues. That is for sure the strongest feature, but for me, it is not about the topics themselves. It is about other areas where I can control, view, and manage.
The command-line interface and the UI have made my work easier by allowing me to deal with topics or with configurations really easily, issuing commands. When I am dealing with CI/CD pipelines, I can issue the commands easily and configure anything. That is really helpful and is one use case, for instance.
What needs improvement?
Redpanda can be improved in several ways, and the more I experiment with the product, the more limitations I find. I understand that this is about business, and the product should grow, and they have to make money. That is certain. However, I would like to have more freedom in terms of having plugins to operate in other fields. For instance, if I am learning Apache Iceberg and I want to have a connector to map data to or to sync data to Apache Iceberg, that is a paid connector. That is a limitation. I could pay for a subscription, but I am under a testing phase to be sure that this is the product I want. There are many paid connectors and operators that it would be great to have as free alternatives. I can understand it is the business model.
I see positive impacts from Redpanda as it makes all the processes that streaming and mapping have easier. In general, I think it is really easy to install, to manage, and to deal with. It is a really great product.
I could not find a way to query the topics in Redpanda, something similar to what Apache Kafka has with ksqlDB or something equivalent. I think Redpanda added that feature recently, but I am not sure if that is paid or free. I would like to test that as well, just to have topics with data and query for visibility and for other purposes. I would like to explore that, but I am not sure if that is a paid feature or a free one.
For how long have I used the solution?
I have been working in my current field for more than 15 years.
What do I think about the stability of the solution?
Redpanda is stable in my experience.
What do I think about the scalability of the solution?
Regarding Redpanda's scalability, I could not test that, so I do not have any opinion on that. I read that it is pretty stable. The performance is amazing. I read about the experiences of other companies using it, and their experiences are great and awesome. However, I could not test that on my own. I hope to do that soon, but so far I could not.
How are customer service and support?
I think Redpanda has really amazing customer support based on my experience and from what I have read. I find the AI guide that Redpanda's website has really awesome. That is really helpful. By asking a question, I can solve many issues, doubts, or any comments that I might have. That is a pretty amazing solution.
Which solution did I use previously and why did I switch?
I previously used Apache Kafka, as everyone is focused on it, and recently, all the changes that Apache Kafka had regarding Zookeeper and Kraft are amazing. It is always a good option to learn alternatives, to broaden my experience with other solutions, and to experiment with other solutions, just to confirm and state my feelings about the product and to discover new features. There is always an edge to using other products. My motivation was to check an alternative and to learn from this alternative because I had my vision and my experience with Apache Kafka.
What was our ROI?
I have seen a return on investment and personal gains since I started using Redpanda. For instance, for local projects and to experiment, I find the investment is really amazing because it is really quick to install and operate with. I can experiment in a minute. There are tons of examples.
What's my experience with pricing, setup cost, and licensing?
Regarding my experience with pricing, setup cost, and licensing for Redpanda, I am exploring the product. If I am convinced about the product and the capabilities, and I am sure I will be because I find the product really amazing, for sure I will acquire a license to operate on other paid features if I like them. That is something that I strongly consider for the future, even for a personal project, not for a professional enterprise project. So far, I cannot state any opinion on pricing or setup cost.
Which other solutions did I evaluate?
I evaluated other options before choosing Redpanda, but mostly queues and not publish-subscriber options such as RabbitMQ or Azure Queues, but not as publish-subscriber. For publish-subscriber, I only know Apache Kafka and Redpanda.
What other advice do I have?
The first advice I would give to others looking into using Redpanda is that it is a binary, so it is just installing, and it is ready to use. That is amazing to start with. Redpanda's page contains amazing information. The AI question-answer solution is amazing as well. I can have a solution with one click to whatever concern I have. That is amazing as well. There is plenty of documentation with examples. I think it is really quick to operate on Redpanda in minutes.
I have additional thoughts about Redpanda. I want to say continue this work. Redpanda is amazing. I love it. Please continue with new features and improvements. I think Redpanda will dominate the market in the future, and it will be a really strong contender regarding streaming and AI. I hope so. You are really doing a great job. Continue with this, please. I would rate my overall experience with Redpanda as a nine out of ten.
Which deployment model are you using for this solution?
Private Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?