Tag: Data and analytics
-
How to orchestrate an ETL Data Pipeline with Apache Airflow
Posted on March 10, 2023, Level intermediate Resource Length medium
Data Orchestration involves using different tools and technologies together to extract, transform, and load (ETL) data from multiple sources into a central repository. By Aviator Ifeanyichukwu.
Tags data-and-analytics backend-development
-
Write reusable code for AppSync JavaScript resolvers
Posted on March 6, 2023, Level beginner Resource Length short
Learn how to share code between AppSync JS resolvers. AWS AppSync is a fully managed service that allows developers to build scalable and performant GraphQL APIs. It is also serverless, meaning that you will only pay for what you use. By Benoît Bouré.
Tags backend-development frontend-and-mobile cloud-and-infrastructure architecture-and-apis data-and-analytics
-
How to transform time series for deep learning
Posted on February 26, 2023, Level intermediate Resource Length long
Forecasting with deep neural networks. A time series is a sequence of values ordered in time. So, it needs to be transformed for supervised learning. By Vitor Cerqueira.
Tags ai-and-machine-learning product-and-design data-and-analytics how-to business-and-emerging-tech
-
Build your own command-line replica with GTID aware mariadb binlog
Posted on February 24, 2023, Level advanced Resource Length medium
This blog post begins a three part series to create and customize your own asynchronous MariaDB replication client. With the release of MariaDB Community Server 10.8.1, the mariadb-binlog command line utility now supports both 1) filtering events by GTID ranges, and 2) validating a binary log's ordering of Global Transaction IDentifiers (GTIDs). By Brandon Nesterenko.
Tags product-and-design backend-development data-and-analytics software-engineering
-
Temporal graph neural networks with Pytorch - How to create a simple recommendation engine on an Amazon dataset
Posted on February 11, 2023, Level beginner Resource Length long
Over the course of the last few months, we at Memgraph have been working on something that we believe could be helpful with classical graph prediction tasks. With our latest newborn query module, you will have the option of performing both label classification and link prediction. By Antonio Filipovic.
Tags cloud-and-infrastructure data-and-analytics devops-and-ci-cd backend-development
-
Storing OpenAI embeddings in Postgres with pgvector
Posted on February 8, 2023, Level beginner Resource Length medium
A new PostgreSQL extension is now available in Supabase: pgvector, an open-source vector similarity search. By Greg Richardson.
Tags cloud-and-infrastructure ai-and-machine-learning devops-and-ci-cd data-and-analytics
-
Data integration vs. data ingestion: What are the differences?
Posted on February 5, 2023, Level intermediate Resource Length medium
Data integration and data ingestion are two IT disciplines that are often confused with one another. Here's how they differ and the challenges you may encounter. By Aminu Abdullahi.
Tags data-and-analytics leadership-and-career ai-and-machine-learning
-
2023 state of databases for serverless & edge
Posted on February 2, 2023, Level intermediate Resource Length medium
There's been massive innovation in the database and backend space for developers building applications with serverless and edge compute. There are new tools, companies, and even programming models that simplify how developers store data. By Lee Robinson.
Tags architecture-and-apis leadership-and-career cloud-and-infrastructure data-and-analytics business-and-emerging-tech devops-and-ci-cd
-
Using Apache Kafka to process 1 trillion inter-service messages
Posted on January 27, 2023, Level intermediate Resource Length long
Cloudflare has been using Kafka in production since 2014. We have come a long way since then, and currently run 14 distinct Kafka clusters, across multiple data centers, with roughly 330 nodes. Between them, over a trillion messages have been processed over the last eight years. By Matt Boyle.
Tags architecture-and-apis data-and-analytics product-and-design
-
Data structures 101: How to use stacks and queues in Java
Posted on January 17, 2023, Level intermediate Resource Length long
Mastering data structures is a non-negotiable skill for success as a developer. Efficient data structures help execute effective programs. Today, many programming roles require great knowledge of data structures. They are also a fundamental part of coding interviews. By The Educative Team.
Tags backend-development product-and-design software-engineering data-and-analytics
-
Kubernetes events: In-depth guide and examples
Posted on January 4, 2023, Level intermediate Resource Length long
Kubernetes events help you understand how Kubernetes resource decisions are made and they can be helpful for debugging. Learn more about k8s events in this in-depth guide. By Tyler Charboneau.
Tags architecture-and-apis devops-and-ci-cd product-and-design cloud-and-infrastructure data-and-analytics
-
Spatial search functionality with Neo4j
Posted on January 3, 2023, Level intermediate Resource Length long
In this post we explore some techniques for working with geospatial data in Neo4j. We will cover some basic spatial Cypher functions, spatial search, routing algorithms, and different methods of importing geospatial data into Neo4j. By William Lyon.
Tags architecture-and-apis how-to devops-and-ci-cd frontend-and-mobile cloud-and-infrastructure data-and-analytics miscellaneous