Tag: Messaging
-
CQRS facts and myths explained
Posted on May 30, 2023, Level intermediate Resource Length long
Older but still relevant article dealing with question of technical patterns and how they are filled with myths and mishaps. Quite often, this happens to CQS and CQRS. By Oskar Dudycz.
Tags event-driven oop app-development messaging programming software-architecture
-
Comparing Avro vs Protobuf for data serialization
Posted on April 18, 2023, Level beginner Resource Length short
Data serialization is a crucial aspect of modern distributed systems because it enables the efficient communication and storage of structured data. In this article, we will discuss two popular serialization formats: Avro and Protocol Buffers, Protobuf for short, and compare their strengths and weaknesses to help you make an informed decision about which one to use in your projects. By Daniel Selans.
Tags json queues messaging app-development streaming apache
-
Using Vulcan codecs with Kafka Java APIs
Posted on April 17, 2023, Level intermediate Resource Length medium
For those that aren't familiar, Vulcan is a functional Avro encoding library that uses the official Apache Avro library under the hood. The difference between this and the official Avro build plugins approach is that the types are defined in plain Scala. Then the Avro schema is generated from those instead of defining the Avro schema and getting code generated at compile time that adheres to that schema. By César Enrique.
Tags apache java messaging app-development streaming scala
-
How Pub/Sub eliminates boring meetings and makes your systems scale
Posted on November 21, 2022, Level intermediate Resource Length medium
So, you've said goodbye to the monolithic application and refactored it into services. You are shipping faster and the code is cleaner. But the complexity of communication between the services is causing performance issues. And every time a new team needs to integrate, it's a whole lot of meetings. By Priyanka Vergadia, Kir Titievsky.
Tags devops software-architecture code-refactoring messaging queues
-
Message routing and topics, thought shift
Posted on November 3, 2022, Level beginner Resource Length long
A lot has changed - Memory, Storage, and CPU are cheaper and available on demand. Cloud technologies have also disrupted this domain; we now have Infrastructure as a Service (IaaS) - Scaling, Load Balancing, and DR responsibilities have been delegated to the Cloud service providers. By Giri Venkatesan.
Tags cio app-development messaging devops event-driven
-
Why traditional logging and observability waste developer time
Posted on October 31, 2022, Level intermediate Resource Length long
The ability to jump directly to a specific line of code that caused an error, without restarting, redeploying or adding more code, is where the magic happens in shift-left observability. By Shahar Fogel.
Tags programming app-development messaging devops
-
What is MQTT 5.0, and how does it work in IoT?
Posted on October 30, 2022, Level intermediate Resource Length long
MQTT serves as a tool to connect many types of IoT devices in deployments of all magnitudes. It originally started in 1999 for oil and gas pipelines to communicate over remote satellites. By MobiDev.
Tags iot event-driven web-development app-development messaging
-
Postgres: Better message queue than Kafka?
Posted on October 13, 2022, Level intermediate Resource Length long
Today author is going to talk about why they made the unconventional decision to build thier logging system on top of Postgres, what worked well, what didn't work well, and how they did it. By Pete Hunt.
Tags apache sql app-development database messaging
-
Uber freight carrier metrics with near-real-time analytics
Posted on September 7, 2022, Level beginner Resource Length long
Uber Freight has been around since 2016 and is dedicated to provide a platform to seamlessly connect shippers with carriers. We're simplifying the lives of trucking companies by providing a platform for carriers to browse through all available shipment opportunities with upfront pricing and book with the tap of a button, and making the fulfillment process more scalable and efficient. By Ujwala Tulshigiri, Yeqing Lu, Ting Chen, Branden Colen.
Tags data-science apache event-driven messaging distributed devops
-
How to visualize your Apache Kafka data the easy way with stream lineage
Posted on July 24, 2022, Level intermediate Resource Length long
Understanding how data flows and is transformed across the different layers of an organization's application and data stack is one of the most challenging governance problems companies are facing today. Who is producing data? By David Araujo and Julia Peng.
Tags app-development messaging apis apache streaming
-
Securing Kafka infrastructure at Uber
Posted on June 27, 2022, Level intermediate Resource Length medium
Uber has one of the largest deployments of Apache Kafka® in the world. It empowers a large number of real-time workflows at Uber, including pub-sub message buses for passing event data from the rider and driver apps, as well as financial transaction events between the backend services. By Prateek Agarwal, Ryan Turner, and KK Sriramadhesikan.
Tags software-architecture infosec devops performance queues messaging streaming distributed
-
Rapid event notification system at Netflix
Posted on May 3, 2022, Level intermediate Resource Length medium
Netflix has more than 220 million active members who perform a variety of actions throughout each session, ranging from renaming a profile to watching a title. Reacting to these actions in near real-time to keep the experience consistent across devices is critical for ensuring an optimal member experience. By Ankush Gulati, David Gevorkyan.
Tags streaming messaging kubernetes containers devops infosec