Tag: Data and analytics
-
Hidden gems of Google BigQuery
Posted on August 9, 2022, Level intermediate Resource Length medium
BigQuery is amazing. It is one of my favorite tools within Google Cloud. Luckily, it looks like Google feels the same and, to the joy of BigQuery fans, keeps adding new features there. By Artem Nikulchenko.
Tags backend-development product-and-design data-and-analytics miscellaneous cloud-and-infrastructure
-
How to visualize your Apache Kafka data the easy way with stream lineage
Posted on July 24, 2022, Level intermediate Resource Length long
Understanding how data flows and is transformed across the different layers of an organization's application and data stack is one of the most challenging governance problems companies are facing today. Who is producing data? By David Araujo and Julia Peng.
Tags product-and-design data-and-analytics architecture-and-apis
-
How I use stories to share data at meetings
Posted on July 13, 2022, Level beginner Resource Length long
Want to keep people awake at data presentations? Try sharing your findings backwards. You've worked it. Now put your chart down, flip it and reverse it. By Ryan Estrellado.
Tags miscellaneous leadership-and-career data-and-analytics
-
Scaling up and load balancing your PostgreSQL Cluster using Pgpool-II
Posted on July 12, 2022, Level intermediate Resource Length medium
PostgreSQL's speed, robustness and security makes it suitable for 99% of the new-age applications. Today, let's deep dive into how you can enable scalability and load balancing of your PostgreSQL cluster using Pgpool-II. By Azman Agung Nugraha.
Tags data-and-analytics software-engineering architecture-and-apis backend-development
-
Lessons from writing a compiler
Posted on July 8, 2022, Level advanced Resource Length long
The standard academic literature is most useful for the extreme frontend (parsing) and the extreme backend (SSA, instruction selection and code generation), but the middle-end is ignored. This is fine if you want to learn how to build, e.g., the next LLVM: a fat backend with a very thin frontend. By Fernando Borretti.
Tags miscellaneous software-engineering product-and-design data-and-analytics
-
Working with a JSONB array of objects in PostgreSQL
Posted on July 7, 2022, Level intermediate Resource Length medium
Get, add and remove JSON objects from an array. By Rob Tomlin.
Tags backend-development data-and-analytics product-and-design
-
Guide to Reinforcement Learning with Python and TensorFlow
Posted on July 3, 2022, Level intermediate Resource Length long
In reinforcement learning, self-learning agent learns how to interact with the environment and solve a problem within it. In this article, we present complete guide to reinforcemen learning and one type of it Q-Learning (which with the help of deep learning become Deep Q-Learning). We learn about the inspiration behind this type of learning and implement it with Python, TensorFlow and TensorFlow Agents. By Nikola M. Zivkovic.
Tags leadership-and-career data-and-analytics backend-development
-
The importance of model versioning in machine learning
Posted on June 30, 2022, Level beginner Resource Length medium
Version control is an essential concept in software development. Version control tools, such as Git, are used to manage and track source codes. Developers and organizations alike value source code because it is the backbone of their product(s), from which they earn revenue. By Oghenefejiro Esosuota.
Tags ai-and-machine-learning data-and-analytics leadership-and-career
-
Securing Kafka infrastructure at Uber
Posted on June 27, 2022, Level intermediate Resource Length medium
Uber has one of the largest deployments of Apache Kafka® in the world. It empowers a large number of real-time workflows at Uber, including pub-sub message buses for passing event data from the rider and driver apps, as well as financial transaction events between the backend services. By Prateek Agarwal, Ryan Turner, and KK Sriramadhesikan.
Tags architecture-and-apis security-and-privacy devops-and-ci-cd software-engineering data-and-analytics
-
Lessons learned from combining SQS and Lambda in a data project
Posted on June 26, 2022, Level intermediate Resource Length medium
The built-in functionality of SQS and Lambda provided us serverless, scalable and fault-tolerant basis, but while running the solution we also learned some important lessons. In this blog post I will discuss the issue of valid messages ending up in dead-letter queues (DLQ) and correctly configuring your DLQ to catch only erroneous messages from your source SQS queue. By Miia Niemelä.
Tags architecture-and-apis ai-and-machine-learning software-engineering data-and-analytics
-
Automated farming robots: Five awesome use cases
Posted on June 24, 2022, Level beginner Resource Length medium
Automation has found its way into almost all industries. Many industries have adopted automation to reduce human efforts and boost productivity to meet customer demands. Recently, automated farming robots are being used for various agricultural practices. They minimize the intensive hard work required for farming and save a lot of time. By Amna Faryad.
Tags business-and-emerging-tech ai-and-machine-learning data-and-analytics
-
A technique to teach bimanual robots stir-fry cooking
Posted on June 23, 2022, Level beginner Resource Length short
As robots make their way into a variety of real-world environments, roboticists are trying to ensure that they can efficiently complete a growing number of tasks. For robots that are designed to assist humans in their homes, this includes household chores, such as cleaning, tidying up and cooking. By Ingrid Fadelli , Tech Xplore.
Tags business-and-emerging-tech miscellaneous cloud-and-infrastructure ai-and-machine-learning data-and-analytics