Lets speak more about this appears to be numerous individuals confronting this issue in meeting.
Kafka will be used to bridge the architectural gaps between
Flume and Storm we found 3 as of now
a)
The Flume sink uses a push mechanism for sending
events, while Storm spout uses the pull mechanism for the events.
b)
Flume sink uses a push mechanism; hence it must know
in advance where events need to be pushed to particular node to run the
topology in different stages.
c)
Kafka is based on the publish-subscribe programming paradigm
here producers (flume) push mechanism and consumers (storm) have pull mechanism
in our architecture.
No comments:
Post a Comment