Rapid event notification system at Netflix
Posted on May 3, 2022, Level intermediate Resource Length medium
Netflix has more than 220 million active members who perform a variety of actions throughout each session, ranging from renaming a profile to watching a title. Reacting to these actions in near real-time to keep the experience consistent across devices is critical for ensuring an optimal member experience. By Ankush Gulati, David Gevorkyan.
How to develop Event-Driven architectures
Posted on March 30, 2022, Level beginner Resource Length medium
Author is going to look at how we can use Open source Chronicle Queue and Chronicle Wire to structure applications to use Event-Driven Architecture (EDA). EDA is a design pattern in which decoupled components (often microservices) can asynchronously publish and subscribe to events. By Rob Austin.
An introduction to event-driven architecture
Posted on March 28, 2022, Level beginner Resource Length short
What is an Event-driven Architecture?. This concept of event-driven architecture (EDA) refers to the new message processing method, which interacts through generation and consumption events, and is generally implemented through a publish-subscribe model? By JIN.
Apache Kafka and MQTT - Overview and Comparison
Posted on March 23, 2022, Level beginner Resource Length medium
Apache Kafka and MQTT are a perfect combination for many IoT use cases. This blog series covers various use cases across industries including connected vehicles, manufacturing, mobility services, and smart city. This is part 1: Overview + Comparison. By Kai Waehner.
Building Real-Time ETL Pipelines with Apache Kafka
Posted on February 17, 2022, Level beginner Resource Length short
Whether you're a data engineer, a data scientist, a software developer, or someone else working in the field of software and data - it's very likely that you have implemented an ETL pipeline before. By Stefan Sprenger.
OPC UA, MQTT, and Apache Kafka - The Trinity of data streaming in IoT
Posted on February 13, 2022, Level beginner Resource Length long
In the IoT world, MQTT and OPC UA have established themselves as open and platform-independent standards for data exchange in Industrial IoT and Industry 4.0 use cases. Data Streaming with Apache Kafka is the data hub for integrating and processing massive volumes of data at any scale in real-time. By Kai Waehner.
Streaming analytics with Apache Pulsar and Spark structured streaming
Posted on February 12, 2022, Level beginner Resource Length long
Apache Pulsar, a promising new toolkit for distributed messaging and streaming. In this piece we combine two of our favorite pieces of tech: Apache Pulsar and Apache Spark. By Daniel Ciocîrlan.
Processing time-series data with Redis and Apache Kafka
Posted on June 22, 2021, Level beginner Resource Length medium
Learn how to analyze time-series data through RedisTimeSeries with Apache Kafka in this practical walkthrough. RedisTimeSeries is a Redis module that brings native time-series data structure to Redis. By Abhishek Gupta.
Streaming microservices with ZIO and Kafka
Posted on May 21, 2021, Level intermediate Resource Length medium
The design and implementation of distributed and highly concurrent applications is something we do every day at Scalac. The adoption of distributed systems is a trend that is currently growing, and it's not going to stop. Apart from Kubernetes, Apache Kafka is surely the main reason for this. By Aleksandar Skrbic.
Integrating Apache Kafka into your CI/CD with Jenkins & Lenses
Posted on March 2, 2021, Level intermediate Resource Length medium
This tutorial will illustrate how you can integrate Lenses into your Jenkins CI/CD using the lenses-cli. The Lenses CLI allows you to manage your Apache Kafka environment using a single unified and secure API across all Kafka components (Kafka Brokers, Zookeepers, Kafka Connect, Schema Registry etc.). By Mihalis Tsoukalos.
How to make Kafka Consumer compatible with Gevent in Python
Posted on February 17, 2021, Level intermediate Resource Length long
Asynchronous task management using Gevent improves scalability and resource efficiency for distributed systems. However, using this tool with Kafka can be challenging. By Jessica Zhao and Boyang Wei.
Handling webhooks with EventBridge, SAM and SAR
Posted on December 17, 2020, Level intermediate Resource Length medium
Applications author worked on in the last decade were rarely isolated from the rest of the world. Most of the time, they had many interactions with other applications out there. From time to time, some of these integrations are using WebSockets, which makes our integration realtime. By Slobodan Stojanović.