wisemonkeys logo
FeedNotificationProfileManage Forms
FeedNotificationSearchSign in
wisemonkeys logo

Blogs

APACHE KAFKA

profile
Rinki Sokhi
Oct 08, 2023
1 Like
0 Discussions
103 Reads

WHAT IS KAFKA?

Apache Kafka is an open-source platform for stream processing, designed for real-time data storage. It serves as an intermediary between senders and receivers, managing trillions of data events daily. Kafka is used for the production analytics pipeline & real time monitoring infrastructure. It is a distributed streaming platform that operates on the publish-subscribe messaging model, facilitating data exchange.

Apache Kafka was originally developed by LinkedIn, and later it was donated to the Apache Software Foundation.

CORE API s : Producer API , Consumer API , Streams API , Connector API

Key Features of Kafka

  1. Scalability: Apache Kafka exhibits scalability across all four dimensions: event producers, event processors, event consumers, and event connectors. In essence, Kafka can effortlessly scale without any downtime.
  2. High Volume: Kafka excels at processing vast volumes of data streams with ease.
  3. Data Transformations: Kafka provides the capability to generate new data streams by leveraging data streams from producers.
  4. Fault Tolerance: The Kafka cluster is resilient and capable of handling failures, including those involving masters and databases.
  5. Reliability: Given Kafka's distributed, partitioned, replicated, and fault-tolerant nature, it offers exceptional reliability.

Real-Time Applications of Kafka

1)Twitter: Registered users can read and post tweets, while unregistered users can only read them. Twitter incorporates Storm-Kafka into its stream processing infrastructure.

2)LinkedIn: Apache Kafka plays a crucial role at LinkedIn, handling activity stream data and operational metrics. The Kafka messaging system supports various products, including LinkedIn Newsfeed and LinkedIn Today for online message consumption, as well as offline analytics systems like Hadoop.

3)Netflix: Netflix, a multinational provider of on-demand Internet streaming media, relies on Kafka for real-time monitoring and event processing.

4)Box: At Box, Kafka powers the production analytics pipeline and real-time monitoring infrastructure.


Comments ()


Sign in

Read Next

Elements and Principles of Photography

Blog banner

Music

Blog banner

GIS Mapping

Blog banner

Data Science in Healthcare: Predicting Diseases

Blog banner

Title: Modern Operating Systems: Powering the Digital Era

Blog banner

Product Discount Calculator

Blog banner

Modern operating system

Blog banner

Dr. Venkadavarahan

Blog banner

Visualization in Data Science

Blog banner

Threads

Blog banner

How To Implement Search Engine Marketing (Sem) Strategy Effectively

Blog banner

ahh wait a min

Blog banner

A Happier Workplace Starts with Healthy Lunches by Meal Maharaj

Blog banner

What Your Music Taste Reveals About Your Personality

Blog banner

DATA VAULT

Blog banner

What Makes Traditional God Keri Aachar So Special?

Blog banner

Hello World

Blog banner

Mutual exclusion

Blog banner

Article on IT development trends

Blog banner

How College Events Build Real-world Skills You Can’t Learn From Textbooks

Blog banner

Importance of education

Blog banner

Decoding the Weave — How to Identify Original Patola Art on a Fabric

Blog banner

Operating system

Blog banner

"Games and the future"

Blog banner

ARTICAL ON MANAGEMENT SYSTEM

Blog banner

KAHAWA TEA

Blog banner

From Websites To Super Apps For Digital User Experience

Blog banner

Modern operating system

Blog banner

Memory Management

Blog banner

Why am I never satisfied with my Life?

Blog banner

India Digital Personal Data Protection Act, 2023

Blog banner

Cache memory

Blog banner

What Function Does SEO Serve in Digital Marketing?

Blog banner

Social Engineering Attacks

Blog banner

SPEM

Blog banner

My First Dream Bike

Blog banner

objectives and function of operating system

Blog banner

Why is it hard to design an Operating Systems ?

Blog banner

Process Description

Blog banner

Disk scheduling

Blog banner

Measuring IT Risk

Blog banner

differentiate thinking humanly and rationally

Blog banner