This chapter emphasizes on getting the readers acquainted to Kafka and its basics. We also integrated Kafka and Storm. We explored the other data sources for Storm such as file and socket. Then, we walked our readers through the concept of reliability acking and anchoring. We also understood Storm joins and batching. Then, at the end, we moved to understand and implement persistence in Storm by integrating it with a database. This chapter touched upon couple of do-it-yourself exercises that the readers are recommended to try and implement.

In the next chapter, we will introduce the Trident abstraction that is built as an extension to Storm, for providing transactional and microbatching capabilities. We will also look into internals of Lmax, 0MQ, and Netty, and learn about Storm optimizations.