Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Dynamic table partitioning in Postgres

Categories

Tags database sql software performance

We helped a customer recently who was storing 500 million chat messages in a single Postgres table. As the table was growing, their queries were slowing down. By Michel Pelletier.

The simple solution we offered was table partitioning. The difficulty was creating the partitions and migrating the data without blocking queries and downtime. This post explores the method we used to solve this - Dynamic Table Partitioning.

Further in this article:

  • Why Partition Data? The large table problem
  • Starting small but getting big
  • Dynamic partitioning with pl/pgSQL
  • Creating parent tables
  • Creating dynamic child tables
  • Progressively copying data from the large tables
  • Setting up a daily cron job to create partitions

While there is some complexity, I hope this example has given you some ideas on how you too can partition your data for optimal query performance. Nice one!

[Read More]

Top open-source IoT platforms in 2023: Complete pros and cons

Categories

Tags iot software-architecture software robotics

Open-source technology has become so important that entire systems like WordPress are built on it. Recently, OpenAI has been making a big impact with its generative AI technology. They trained and created it using data that was freely available to everyone. By Team Bytebeam.

Nowadays, millions of IoT products collect data, analyze it, and make decisions. This data provides valuable information for planning, managing, and making decisions.

The main parts of the article:

  • Understanding open-source IoT platforms
  • Importance of open-source IoT architecture in IoT platforms
  • When should you look for an open-source architecture for your IoT products?
  • Challenges with open source IoT architecture
  • Top open source iot platforms in 2023

In summary, open source offers a great chance for businesses to become more efficient and promote innovation by using shared technology. It’s similar to how standards help in this regard. Therefore, it’s important to select the right IoT platform for your company. Good read!

[Read More]

Nginx security. Control resources and limits.

Categories

Tags servers web-development infosec performance

Nginx is one of the best popular webservers today. Its popularity is due to the fact that it is very fast and easy to set up. Other side of this popularity - nginx is often being a target of malicious attacks. So, if your nginx is not limited by available resources, your server may totally “fall” when nginx spent all system resources. That’s why you should control and limit resources Nginx consumed. By Vyacheslav Breus.

All limits are sets in nginx configuration file. The article gives a good advice on:

  • Global settings
  • Disk operations
  • Compression and caching
  • Security settings

In this article author described how to optimize your nginx works and gave some advices about base security improvements. Nice one!

[Read More]

Raspberry Pi Zero headless quick start

Categories

Tags cio software-architecture devops infosec

This guide shows how to bring up a Raspberry Pi Zero, Zero W, or Zero 2 W without needing to attach a keyboard/mouse/monitor. For older Pi OS releases, basic settings can be configured by editing text files directly on the SD card using an editor on your main PC prior to first boot. For newer Pi OS releases, the rpi-imager tool can be used to both burn the OS image and configure settings. By Carter Nelson.

In this super detailed guide you will find:

  • How to run a sanity check to verify if the Pi Zero is OK
  • Install OS on to SD Card
  • Text file editing
  • Using rpi-imager
  • Suggested initial setup

… and more. Plenty of screenshots and every step is well explained. Nice one!

[Read More]

Comprehensive guide to Internet of Things data streaming from Raspberry Pi to Azure

Categories

Tags cloud azure iot infosec robotics

What comes to mind when you hear “Raspberry Pi in the cloud”? A freshly baked pie floating away, forever out of reach? this blog post aims to paint a simpler picture, showing how easy it is to build your own IoT in the Cloud setup. As mentioned in the preface, this post is part of our ongoing IoT series, where we’ll elevate our Raspberry Pi devices by streaming data into the Microsoft Azure Cloud. By Stepan GaponiukDr and Heiko Kromer.

Further in the guide:

  • Extend the circuit with an LED and a resistor (optional)
  • Create and configure Microsoft Azure IoT Hub
  • Configure Raspberry Pi to send data into Azure IoT Hub
  • Create and configure Microsoft Azure Stream Analytics job
  • Create a Real-time dashboard in Power BI Premium to visualize Reed switch signals sent from Raspberry Pi

Azure IoT Hub is a fully managed service that enables secure and reliable communication between your IoT devices and cloud applications. It acts as a central messaging hub, allowing you to send and receive data, manage devices, and implement security features such as per-device authentication. Link to the repository with the code is also included. Good read!

[Read More]

Best Kubernetes certifications for 2023 [ranked]

Categories

Tags kubernetes containers learning how-to cio devops

Looking for the best Kubernetes certification? In this guide, I explained the best Kubernetes certification along with other free choices, so you can choose the best one for you. Kubernetes is growing in popularity day by day. A survey conducted by Cloud Native Computing Foundation (CNCF) reported that 96% of the respondents are either using or evaluating Kubernetes. By Bibin Wilson.

Engineers getting certified on Kubernetes are also growing at a rapid pace. A report by Kube Careers shows that Kubernetes Certifications stand in second place in the list of popular certifications.

Let’s take a look at each Kubernetes certification and see which one is right for you:

  • Certified Kubernetes Administrator (CKA)
  • Certified Kubernetes Application Developer (CKAD)
  • Certified Kubernetes Security Specialist (CKS)
  • Kubernetes and Cloud Native Associate (KCNA)
  • Certification cost
  • How to register for Kubernetes certification?
  • Which is the popular Kubernetes certification?
  • Kubernetes certified engineers salary stats

As per the latest kube.careers Kubernetes job trends report data, the salary range is between $129,802 & 179,520. And the highest salary reported is between $275,000-319,000. LinkedIn search returned 124,565 results for Kubernetes jobs in the USA. In that for salaries more than $10000, it’s returned 28000 results. And for salaries above $200000, it returned 302 results.

The Linux Foundation CKA is a sought-after Kubernetes certification. CKA is a widely accepted certification that showcases a candidate’s Kubernetes administration and management skills. You will also gain a competitive advantage over peers without the certification as recruiters and organizations are looking for certified professionals. Good read!

[Read More]

Security on the web

Categories

Tags servers web-development infosec app-development browsers

Websites contain several different types of information. Some of it is non-sensitive, for example the copy shown on the public pages. Some of it is sensitive, for example customer usernames, passwords, and banking information, or internal algorithms and private product information. By @mozilla.

Security and privacy are distinct topics, but they are also closely-related. It is worth knowing the difference between the two and how they relate. In this guide you will find info on:

  • Relationship between security and privacy
  • Security services provided by browsers
  • Security considerations for client-side developers
  • Store client-side data responsibly
  • Protect user identity and manage logins
  • Don’t include sensitive data in URL query strings
  • Enforce usage policies
  • Maintain data integrity
  • Sanitize form input
  • Protect against clickjacking

… and more. Handling data responsibly is largely concerned with cutting down on cookie usage and being careful about the data you store in them. You should prepare for the removal of cross-site cookies by limiting the amount of tracking activities you rely on and/or by implementing desired information persistence in other ways. Excellent read!

[Read More]

How IKEA Retail standardizes docker images for efficient machine learning model deployment

Categories

Tags docker software web-development containers app-development

What do Docker and IKEA Retail have in common? Both companies have changed how products are built, stored, and shipped. In IKEA Retail’s case, they created the market of flat-packed furniture items, which made everything from shipping, warehousing, and delivering their furniture to the end location much easier and more cost effective. This parallels what Docker has done for developers. Docker has changed the way that software is built, shipped, and stored, with Docker Images taking up much less space “shelf” space. By Karan Honavar, Fernando Dorado Rueda.

The article then does a good job to explain:

  • Standardization deployment process via Docker
  • Model training and simple evaluation
  • Model class creation
  • Testing model locally
  • Encapsulating the model into a Docker image
  • What is Docker’s role in MLOps?
  • Dockerfile creation
  • Building and pushing Docker image
  • Deploy ML model using Docker: Unleash it into the world

… and more. Plenty of screenshots and each step explained. At IKEA Retail, Docker has become an indispensable element in our daily MLOps activities, serving as a catalyst that accelerates the development and deployment of models, especially when transitioning to production. The transformative impact of Docker unfolds through a spectrum of benefits that not only streamlines our workflow but also fortifies it via standardization, compatibility, isolation, security. Nice one!

[Read More]

What are docker image layers and how do they work?

Categories

Tags docker software learning containers app-development

Docker is a widely used containerization platform that enables developers to run and manage applications inside containers. One of the key components of Docker is the Docker image, which acts as a blueprint for creating containers. By Hemanta Sundaray.

This guide then explains:

  • Prerequisites
  • Building a Docker Image
    • Analyzing Docker Image Build Steps
  • Viewing Docker Image Layers
    • Using the docker history command
    • Using the docker inspect command
  • Understanding Docker Image Layer Cache

In this blog post, you learned about Docker image layers, docker image layer cache, and how Docker leverages caching to speed up the build time. Armed with this understanding, you’re now well-equipped to use Docker more efficiently. There are screengrabs and commands explained so you can follow the tutorial easily. Good read!

[Read More]

A beginner's guide to behavior-driven development (BDD)

Categories

Tags tdd software learning infosec

BDD is the next step in the evolution of Test-Driven Development (TDD). It shifts the focus from thinking in tests to thinking in behavior. Imagine transitioning from assembling puzzle pieces to crafting a compelling story. BDD integrates various aspects of software development into a coherent narrative, fostering better communication and collaboration. By Rustam Sabirov.

In this article you will find:

  • Introduction: What is behavior-driven development?
  • How does behavior-driven development work?
  • Writing test scenarios in Gherkin syntax
  • The “Given When Then” approach
  • Examples
  • Advantages of behavior-driven development
  • Disadvantages of behavior-driven development
  • Behavior-driven development requires a strategic approach

… and more. Behavior-Driven Development introduces a profound paradigm shift in software development, fostering enhanced collaboration and a shared understanding among stakeholders. Its “Given When Then” approach, analogous to a structured recipe, delineates the software’s behavior in a comprehensible manner. Nice one!

[Read More]