IT Central Station is now PeerSpot: Here's why

Apache Kafka Room for Improvement

RH
freelance at a tech services company with 11-50 employees

The model where you create the integration or the integration scenario needs improvement. It contains fewer developer words or maintaining words where someone prepared the topics, the connectors, or the streaming platforms. You would first need to have a control center from a third party for managing. 

If you would like to prepare something that is a more sophisticated integration scenario, where you use one microservice to provide the event or a second to several that consumed these microservices, then this needs to be modeled elsewhere. 

Also, when comparing to the traditional ESD for data mixing, you can create a scenario that could be deployed with inputs and some outputs.

Most business like the topics, but for me, I think that it is a problem that messaging platforms have, there is no design tool with IDE for creating.

It would be helpful to create a more complex solution for several types of styles, and not just for one provider or for one customer. That would be easier, but if you have more than one consumer then it could be a more complex scenario. It would be like events that go to several microservers to create orders, validate orders, and creating words. This would be helpful.

In the next release, adding some IDE or developing tools, for creating better integration scenarios, even though it already a developer-oriented solution, would be helpful. It would also be helpful for the auto-deployment.

Having a governance style would also be helpful to understand. 

It would be beneficial to have a repository of all of the topics, data types that exist, or data structures.

View full review »
KS
Solution Architect at a manufacturing company with 10,001+ employees

They need to have a proper portal to do everything because, at this moment, Kafka is lagging in this regard. It could be used to do the preprocessing or the configurations, instead of directly doing it on the queues or the topics. If you look at Solace, for example, they have come up with a portal where you don't need to touch these activities. You don't need to access the platform beyond the portal.

View full review »
DS
Principal Technology Architect at a computer software company with 5,001-10,000 employees

We are still on the production aspect, with our service provider or hyper-scalers providing the solutions. I would like to see some improvement on the HA and DR solutions, where everything is happening in real-time. 

Kafka's interface could also use some work. Some of our products are in C, and we don't have any libraries to use with C. From an interface perspective, we had a library from the readies. And we are streaming some of the products we built to readies. That is one of the requirements. It would be good to have those libraries available in a future release for our C++ clients or public libraries, so we can include them in our product and build on that.

View full review »
Buyer's Guide
Apache Kafka
August 2022
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: August 2022.
621,327 professionals have used our research since 2012.
DP
Sr Technical Consultant at a tech services company with 1,001-5,000 employees

I would like to see real-time event-based consumption of messages rather than the traditional way through a loop. The traditional messaging system works by listing and looping with a small wait to check to see what the messages are. A push system is where you have something that is ready to receive a message and when the message comes in and hits the partition, it goes straight to the consumer versus the consumer having to pull. I believe this consumer approach is something they are working on and may come in an upcoming release. However, that is message consumption versus message listening.

Confluent created the KSQL language, but they gave it to the open-source community. I would like to see KSQL be able to be used on raw data versus structured and semi-structured data.

View full review »
Mario Estrada - PeerSpot reviewer
CTO at Estrada & Consultores

Kafka can allow for duplicates, which isn't as helpful in some of our scenarios. They need to work on their duplicate management capabilities but for now developers should ensure idempotent operations for such scenarios.

While the solution scales well and easily, you need to understand your future needs and prep for the peaks. 

View full review »
SP
CEO at a comms service provider with 11-50 employees

The price for the enterprise version is quite high. It would be better to have a lower price.

View full review »
Salvatore Campana - PeerSpot reviewer
CEO & Founder at XAUTOMATA TECHNOLOGY GmbH

To store a large set of analytical data we are using SQL repository. This type of repository works very well but we need specific and high maintenance. The user experience is friendly.

We are looking for alternative solutions, we tried with noSQL solutions and Confluent specific features but the results were not satisfactory both in terms of performance and usability.

We are working on automated SQL repository management and maintenance tools in order to increase the democratization of our platform.

View full review »
YL
Vice President at a consultancy with 51-200 employees

More Windows support, I believe, is one area where it can improve. We need to wrap it as a service, but there isn't one built into Windows. So that's something they could improve.

I believe Windows Server is primarily aimed at the Windows shop or those who use Windows.

View full review »
SK
Barista Brewing Espresso at Linkedln

When compared to other commercial competitors, Kafka doesn't have the ability to scale down, the elasticity is lacking in the product. The other issue for us is the delayed queue, which was available to us in the commercial software but not in Kafka. It's something we use in most of our applications for deferred processing and I know it's available in other solutions. I'd like to see some tooling support and language support in the open source version. 

View full review »
TM
Assistant Student at a retailer with 5,001-10,000 employees

Something that could be improved is having an interface to monitor the consuming rate. We use something, but I'm not sure if it's from Apache Kafka, or if it's a borrowed third-party solution. So, the interface for monitoring the processes is an additional feature that could be added.

View full review »
Reza Sadeghi - PeerSpot reviewer
Senior Developer at a non-profit with 10,001+ employees

The user interface is one weakness. Sometimes, our data isn't as accessible as we'd like. It takes a lot of work to retrieve the data and the index.

View full review »
Ravi-Patel - PeerSpot reviewer
Assistant Professor at CHAROTAR UNIVERSITY OF SCIENCE AND TECHNOLOGY

The solution can improve by having automation for developers. We have done many manual calculations and it has been difficult but if it was automated it would be much better.

View full review »
Reza Gholami - PeerSpot reviewer
Senior Technology Architect at a tech services company with 10,001+ employees

Some vendors don't offer extra features for monitoring. Some come with Linux for default monitoring. Monitoring is very important. If something is not working properly, then our subscribers won't receive a notification. You then have to trace it back to Kafka and find the glitch or the messaging sequence that hasn't been racked up correctly.

It should support Avro — which handles different data formats — as a default data format. It would be much more flexible if it did.

View full review »
RH
freelance at a tech services company with 11-50 employees

Kafka has a lot of monitors, but sometimes it's most important to just have a simple monitor. Improvements to Kafka's management would be nice, but it's not so necessary for me. There are a lot of consoles that offer a better view than Kafka. Some are free, and some are paid, but I'm thinking about streaming. For example, if you connect more streams to a component in the same queue, how will it integrate to recognize the flow and the message?

View full review »
WG
Solutions Architect at a tech services company with 201-500 employees

The initial setup and deployment could be less complex.

Integration is one of the main concerns that we have.

View full review »
AC
Program Manager at a tech services company with 51-200 employees

The management tool could be improved.

View full review »
NC
Chief Technology Officer at a tech services company with 1-10 employees

The graphical user environment is currently lacking in Apache. It's not available within the solution and needs to be built from scratch. Some of the open source products of this solution have limitations. 

View full review »
Rémy NOLLET - PeerSpot reviewer
Data Exchange Architect MQSeries at Decathlon International

I would like to see an improvement in authentication management.

View full review »
ShoaibKhan - PeerSpot reviewer
Technical Specialist at APIZone

The management overhead is more compared to the messaging system. There are challenges here and there. Like for long usage, it requires restarts and nodes from time to time.

View full review »
TD
Head of Technology - Money Movement Platform at a financial services firm with 10,001+ employees

Prioritization of messages in Apache Kafka could improve.

View full review »
Moussa Chikhi - PeerSpot reviewer
Architecte Technique Senior at a computer software company with 10,001+ employees

An area for improvement would be growth.

View full review »
Buyer's Guide
Apache Kafka
August 2022
Learn what your peers think about Apache Kafka. Get advice and tips from experienced pros sharing their opinions. Updated: August 2022.
621,327 professionals have used our research since 2012.