Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Why managed container services help startups and tech companies build smarter

Categories

Tags business-and-emerging-tech product-and-design cloud-and-infrastructure leadership-and-career

Learning how to install and manage Kubernetes clusters can be a big obstacle between your organization and all the potential magic of a container orchestration platform. You have to consider tasks like provisioning machines, choosing OS and runtime, and setting up networking and security. By Fer De Oliveira @google.

When adopting containers, you should always ask yourself: Does my startup or tech company have the skills, resources, and time to maintain, upgrade, and secure my platform?

The main sections of the article:

  • The benefits of embracing managed services
  • Always be building towards an open future

Containers and managed services based on open standards are a powerful combination that allow you to take advantage of best-of-breed capabilities on any platform, while simultaneously standardizing skills and processes. As a leader at a startup or tech company, you’re always looking for ways to move faster, work more efficiently, and make the most of the technical talent you have. You want to spend more time on roadmap priorities and spend the minimum amount of resources on maintaining your infrastructure. Good read!

[Read More]

Automating AWS IAM remediation in Python

Categories

Tags backend-development product-and-design security-and-privacy software-engineering leadership-and-career

Since automating IAM remediation requires recurring parsing of JSON documents, modulating your parsing function(s) will save you time as you work on each control. If you have controls that pertain to trust policies, you will need a separate function to parse those out since the format differs from that of permission policies. By Cody Bench.

Automating IAM policy remediation is no walk in the park. A development team must:

  • Identify the controls to be remediate
  • Build a program that pulls down and parses out the roles and policie
  • Validate the permission and trust policies against the necessary control
  • Perform the required remediation - which may include checking action history
  • Rebuild the JSON document
  • Deploy the remediated artifacts per your company’s or client’s workflow

Having any way to access the historical data for the roles and/or policies you are remediating is a huge win when implementing least privilege. A stakeholder will need to decide the cutoff for the last time an action was used or a resource was accessed, whether that be a few months or a year prior to remediation. Excellent read!

[Read More]

Introduction to Linear Programming in Python

Categories

Tags backend-development product-and-design software-engineering cloud-and-infrastructure

A guide to mathematical optimization with Google OR-Tools. Linear programming is a technique to optimize any problem with multiple variables and constraints. It’s a simple but powerful tool every data scientist should master. By Maxime Labonne.

Fortunately for us, there is a method that can solve our problem in an optimal way: linear programming (or linear optimization), which is part of the field of operations research (OR). In this article, we’ll use it to find the best numbers of swordsmen, bowmen, and horsemen to build the army with the highest power possible.

You can run the code from this tutorial with the following Google Colab notebook.

The article then describes:

  • Solvers
  • Variables
  • Constraints
  • Objective
  • Optimize!

In Python, there are different libraries for linear programming such as the multi-purposed SciPy, the beginner-friendly PuLP, the exhaustive Pyomo, and many others. Excellent read!

[Read More]

Three myths of open source software risk and the one nobody is discussing

Categories

Tags frontend-and-mobile product-and-design miscellaneous cloud-and-infrastructure

Open source software is being vilified once again and, in some circles, even considered a national security threat. Open source software risk has been a recurring theme: First it was classified as dangerous because anyone could work on it and then it was called insecure because nobody was in charge. By Josh Bressers.

Let’s consider where open source stands today. It’s running at minimum 80% of the world. Probably more. Some of the most mission-critical applications and services on the planet (and on Mars) are open source. The reality is, open source software isn’t inherently more risky than anything else. It’s simply misunderstood, so it’s easy to pick on.

The article then discusses:

  • Myth 1: Open source software is a risk because it isn’t secure
  • Myth 2: Open source software is a risk because it isn’t high quality
  • Myth 3: Open source software is a risk because you can’t trust the people writing it
  • The true risk of open source software

In an era where the use of open source software is only increasing, the true risk in using open source — or any software for that matter – is failing to understand how it works. In the early days of open source, we could only understand our software by creating it. There wasn’t a difference between being an open source user and an open source contributor. Nice one!

[Read More]

New superconductors could make faster Quantum computers

Categories

Tags software-engineering leadership-and-career product-and-design miscellaneous architecture-and-apis

Practical quantum computers could soon arrive with profound implications for everything from drug discovery to code-breaking. By Sascha Brodsky.

One of the biggest challenges in quantum computing today relates to how we can make superconductors perform even better.One of the biggest challenges in quantum computing today relates to how we can make superconductors perform even better.

Making practical quantum computers could hinge on finding better ways to use superconducting materials which have no electrical resistance. In a step toward building better quantum machines, researchers at Oak Ridge National Laboratory recently measured the electrical current between an atomically sharp metallic tip and a superconductor. This new method can find linked electrons with extreme precision in a move that could help detect new kinds of superconductors, which have no electrical resistance.

Better superconductors may be key to making practical quantum computers. Michael Biercuk, the CEO of quantum computing company Q-CTRL, said in an email interview that most current quantum computing systems use niobium alloys and aluminum, in which superconductivity was discovered in the 1950s and 1960s.

While we see small advances in each of the indicated technological directions, combining them into a good working device is still elusive. The ‘Holy Grail’ of quantum computing is a device with hundreds of qubits and low error rates. Scientists can’t agree on how they will achieve this goal, but one possible answer is using superconductors. Interesting read!

[Read More]

Don't mix refactorings with behavior changes

Categories

Tags software-engineering product-and-design devops-and-ci-cd

Probably the biggest reason not to mix refactorings with behavior changes is that it makes it too easy to make a mistake. By Jason Swett.

When you look at the diff between the before and after versions of a piece of code, it’s not always obvious what the implications of that change are going to be. The less obvious the implications are, the more opportunity there is for a bug to slip through.

When you mix refactoring with behavior changes, it’s hard or impossible for a reviewer to tell which is which. It makes a discussion about a code change harder because now the conversation is about two things, not just one thing. This makes for a potentially slow and painful PR review process.

How to approach refactorings instead:

  • Set aside my current feature branch
  • Create a new branch off of master on which to perform my refactoring
  • Merge my refactoring branch to master (and preferably deploy master to production as well)
  • Merge or rebase master into my feature branch
  • Resume work on my feature branch

If developer deploys a behavior change that was mixed with a refactoring, and then discovers that the deployment introduced a bug, she/he won’t know whether it was the refactoring or the behavior change that was responsible because the two were mixed together. Good read!

[Read More]

Ten best practices for refactoring code

Categories

Tags frontend-and-mobile product-and-design software-engineering

As software developers, we are constantly faced with the need to improve and optimize our code. Whether it’s for performance, readability, or maintainability, refactoring code is an essential skill. By Tomek Skupiński.

There are a number of different techniques that can be used when refactoring code. In this article, we will explore some of the best practices for refactoring code. The blog post then focuses on:

  • Identify the problem areas
  • Make a plan
  • Keep your changes small
  • Write tests
  • Refactor incrementally
  • Use a refactoring tool
  • Document your changes
  • Use a source control system
  • Perform regression testing
  • Be prepared to undo changes

Refactoring code is an essential skill for every software developer. By following the best practices outlined in this article, you can make sure that you won’t get lost in the process. Nice one!

[Read More]

How to monitor Docker with Telegraf and InfluxDB

Categories

Tags devops-and-ci-cd product-and-design

Docker is an increasingly popular choice for businesses dealing with containerized applications. However, as with any new technology, Docker introduces complexities that need to be managed. Some of these complexities relate to infrastructure and application monitoring. Due to the abstraction offered by containers, traditional monitoring solutions might not be suitable for Docker-based workloads. By Cameron Pavey

The article provides information on the following:

  • Why monitor Docker
  • Prerequisites
  • Monitoring Docker with InfluxDB and Telegraf

As a time series database, InfluxDB is perfectly positioned to store and visualize the kind of metrics that application monitoring often deals with, as there are usually lots of data points at regular intervals. With large volumes of data like this, you must have a mechanism to visualize, search, and understand the data to derive insights. InfluxDB fits the bill in this regard thanks to its easy-to-configure visualizations and the powerful Flux data scripting language that allows you to query and analyze your data. Good read!

[Read More]

A beginner's guide to benchmarking with NoSQLBench

Categories

Tags devops-and-ci-cd testing-and-quality data-and-analytics product-and-design

There are several benchmarking tools in the market but most of them require esoteric coding knowledge. NoSQLBench is simple to use while providing sophisticated benchmarking for Cassandra and other NoSQL databases. It provides results within minutes. By Jones-Gilardi.

In this post, you’ll get hands-on experience with benchmarking and stress testing Cassandra using NoSQLBench. Rather than going in-depth, our tutorial will scratch the surface and cover:

  • Understanding parameters and key metrics for benchmarking
  • How cycles, bindings and statements work together
  • Experimenting with stdout
  • Scaling up a test and customizing your own scenarios
  • Packaging a performance test with named scenarios

NoSQLBench is an open-source, pluggable testing tool for the NoSQL ecosystem. It’s primarily designed to test Cassandra, but you can also use it for other NoSQL technology like Apache Kafka, MongoDB, and DataStax Astra DB. Good read!

[Read More]

A deep dive into OpenTelemetry metrics

Categories

Tags devops-and-ci-cd cloud-and-infrastructure leadership-and-career product-and-design

OpenTelemetry is an open-source observability framework for infrastructure instrumentation hosted by the Cloud Native Computing Foundation (CNCF). The project gained a lot of momentum with contributions from all major cloud providers (AWS, Google, Microsoft) as well as observability vendors (including Timescale) to the point it became the second-highest ranked CNCF project by activity and contributors, only coming second to Kubernetes itself. By James Blackwood-Sewell.

Diagram illustrating the elements of the MeterProvider in OpenTelemetry

Source: https://www.cncf.io/blog/2022/06/08/a-deep-dive-into-opentelemetry-metrics/ OpenTelemetry aims to define a single standard across all types of observability data (which it refers to as signals), including metrics, logs, and traces. Through a collection of tools, libraries, APIs, SDKs, and exporters, OpenTelemetry radically simplifies the process of collecting signals from your services and sending them to the backend of your choice, opening the doors of observability to a wider range of users and vendors.

  • OpenTelemetry metrics
  • Measurements to metrics
  • Instruments and emitting measurements
  • Views and aggregations

A View in OpenTelemetry defines an aggregation, which takes a series of measurements and expresses them as a single metric value at that point in time. As more measurements are created, the metric is continuously updated. If there is no View created for an Instrument, then a default aggregation is selected based on the Instrument type. Custom views can be targeted by Meter name, Instrument name, Instrument type, or with a wildcard. Nice one!

[Read More]