Tag: Apache
-
Integrating Apache Kafka into your CI/CD with Jenkins & Lenses
Posted on March 2, 2021, Level intermediate Resource Length medium
This tutorial will illustrate how you can integrate Lenses into your Jenkins CI/CD using the lenses-cli. The Lenses CLI allows you to manage your Apache Kafka environment using a single unified and secure API across all Kafka components (Kafka Brokers, Zookeepers, Kafka Connect, Schema Registry etc.). By Mihalis Tsoukalos.
Tags apache event-driven messaging streaming open-source app-development
-
Pulsar advantages over Kafka
Posted on November 19, 2020, Level intermediate Resource Length medium
Recently, author has been looking at Pulsar and how it compares to Kafka. A quick search will show you that there is a current war between the two most famous open source messaging systems. By Javier Ramos.
Tags apache devops queues event-driven messaging app-development
-
Apache Cassandra: An essentials guide
Posted on August 25, 2020, Level intermediate Resource Length long
Need to get up to speed on Cassandra and learn how it can benefit your software development practices? These are the essentials that cover the basics. By Rebecca Mills, Developer Relations @ DataStax.
Tags apache database nosql cloud big-data
-
Change data capture with Debezium: A simple how-to
Posted on May 19, 2020, Level intermediate Resource Length long
Eric Deandrea wrote this piece about one question that always comes up as organizations moving towards being cloud-native, twelve-factor, and stateless: How do you get an organization's data to these new applications?
Tags software-architecture streaming apache data-science queues
-
Building an adaptive, multi-tenant stream bus with Kafka and Golang
Posted on February 20, 2020, Level intermediate Resource Length medium
Back in the 2000s, SOAP/WSDL with ESB (Enterprise Service Bus) was the dominant server-side architecture for many companies. Since the 2010s, microservices and service mesh technologies have grown wildly and thus became the de-facto industry standards. By Xinyu Liu.
Tags software-architecture apache streaming apis devops web-development programming
-
Exploring an Apache Kafka to Pub/Sub migration: Major considerations
Posted on January 28, 2020, Level intermediate Resource Length medium
In many cases, Google's Pub/Sub messaging and event distribution service can successfully replace Apache Kafka, with lower maintenance and operational costs, and better integration with other Google Cloud services. By Leonid Yankulin.
Tags software-architecture apache streaming big-data machine-learning google
-
Using Tableau with Kafka: How to build a real-time SQL dashboard on streaming data
Posted on November 9, 2019, Level intermediate Resource Length medium
Scott Morris, Software Engineer at Rockset wrote this piece about building a real-time dashboard for operational monitoring and analytics on streaming event data from Kafka, which often requires complex SQL, including filtering, aggregations, and joins with other data sets.
Tags big-data data-science software-architecture apache
-
Why I recommend my clients NOT use KSQL and Kafka Streams
Posted on October 24, 2019, Level beginner Resource Length medium
An article by Jesse Anderson. He recommends his clients not use Kafka Streams because it lacks checkpointing. Kafka Streams also lacks and only approximates a shuffle sort. KSQL sits on top of Kafka Streams and so it inherits all of these problems and then some more.
Tags streaming software-architecture apache distributed
-
Full text search with Node.js and ElasticSearch on Docker
Posted on September 18, 2019, Level intermediate Resource Length long
An article by Michele Riva about building the search engine for simple REST API using Node.js and ElasticSearch. ElasticSearch is a search engine server built on top of Lucene with an amazing distributed-architecture support.
Tags search servers apache web-development
-
Using graph processing for Kafka Stream visualizations
Posted on September 9, 2019, Level intermediate Resource Length long
Article by David Allen. Focused on Graph processing for Kafka Stream visualizations. Apache Kafka® is great when one needs to dealing with streams, allowing you to conveniently look at streams as tables. Stream processing engines like KSQL furthermore give you the ability to manipulate all of this fluently.
Tags analytics apache streaming queues
-
Distributed tracing with Apache Kafka and Jaeger
Posted on June 29, 2019, Level advanced Resource Length long
An article by Aaron Burk about distributed systems. Kafka decouples consumers and producers (meaning applications do not directly communicate with each other) it can be a challenge to illustrate exactly how data flows through your system. Author demonstrates how Jaeger is up to the challenge while navigating the pitfalls of an example project.
Tags programming monitoring servers devops apache
-
How we use Apache Kafka and the Confluent Platform
Posted on June 4, 2019, Level intermediate Resource Length short
Jendrik Poloczek from confluent.io published this article about their experience building the core infrastructure to integrate, clean, and analyze blockchain data.
Tags blockchain apache apis data-science scala