Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

How to improve your cloud cost forecasting

Categories

Tags programming app-development cloud software-architecture learning cio

Since technology usage is often an organization’s highest expenditure after personnel costs, effectively forecasting cloud spend is vital to planning, negotiating, and achieving sustainable economies of scale as you grow and mature your business on the cloud. So, what can you can do to more accurately predict future cloud costs? In particular, how can you forecast your AWS spend for the next month, quarter, or year? By John Klacynski.

The first blog in the series focuses on the best practices you can implement to improve financial predictability:

  • Increase cross-functional collaboration
  • Perform driver-based forecasting
  • Establish governance and accountability

Product teams are now empowered to create annual, quarterly, monthly, or even daily budgets depending on business needs. These reports give product teams the ability to spot anomalies early and take timely action to prevent cost or usage overage, or inefficient utilization or resource coverage of your Reserved Instances and Savings Plans. Thanks to tools like AWS Budgets, which lets you set custom budgets, alerts, and triggered actions related to exceeding or falling below desired thresholds, you can build a decentralized cloud spend forecast. Good read!

[Read More]

Why traditional logging and observability waste developer time

Categories

Tags programming app-development messaging devops

The ability to jump directly to a specific line of code that caused an error, without restarting, redeploying or adding more code, is where the magic happens in shift-left observability. By Shahar Fogel.

Because the truth is that while traditional APM and monitoring are critical, they are providing data that is often more interesting to Ops than to developers.

The last few years have seen their share of changes in DevOps. Those trends are highlighted by containers and microservices, security responsibility spreading to more teams and trying to automate as much as possible.

You could argue that the common denominator is making everything cloud native — containers epitomize emphasis on architects, more things are offered “as a service,” and scale is seemingly automated by moving everything to off-premises (on-demand) servers. But the big “philosophical” shift is to “shift left.” This means giving devs necessary access to real-time production data. That makes your entire operation more mobile and dynamic. Your dev teams gain the independence to move thromoja kancelariaugh production-level code without having to wait for Ops to grant them that access on a case-by-case basis. That’s why we elevate live debugging at Rookout to the same level of importance as remote debugging or the three pillars of observability.

The article further deals with:

  • Advancing on the leftward front
  • Example of developer-first observability in action
  • Cost-effective with money and time

Whatever production debugging solution you choose should integrate directly with monitoring and APM platforms. This will dramatically increase enterprise agility and velocity when it comes to diagnosing and pinpointing the root cause of performance issues. The ability to jump directly from a Datadog alert or anomaly to a specific line of code that caused an error, without restarting, redeploying, or adding more code, is where the magic happens in shift-left observability. Good read!

[Read More]

What is MQTT 5.0, and how does it work in IoT?

Categories

Tags iot event-driven web-development app-development messaging

MQTT serves as a tool to connect many types of IoT devices in deployments of all magnitudes. It originally started in 1999 for oil and gas pipelines to communicate over remote satellites. By MobiDev.

What you will learn:

  • Why Is MQTT used in IoT development?
  • An example of an MQTT 5.0 small system deployment
  • Which clients support MQTT 5.0 and Python?
  • Pros and cons of an MQTT v5.0 local network
  • Major practical differences between MQTT v3.1.1 and v5.0
  • MQTT 5 challenges

MQTT v5.0 is a suitable option for local IoT device communication if you have a central device that can host a message broker for communication between devices and/or the host. Despite its drawbacks (most of which were eliminated in MQTT v5.0), this protocol can be used for communication between small-to-medium sized networks of IoT devices. Interesting!

[Read More]

Block ads on every device in your house with a Raspberry Pi and Pi-hole

Categories

Tags infosec linux robotics iot web-development app-development

Advertising on the internet is a nuisance — getting in the way of your browsing, using your bandwidth, and lumbering you with trackers that send your data to people you might not want to have it. Installing ad blockers on each of your devices is time-consuming; and some of your devices, like smart TVs or other smart devices, won’t have a local ad-blocking option available. By raspberrypi.com.

Pi-hole is what’s known as a DNS sinkhole. DNS (Domain Name System) is like an address book for the internet. Pi-hole gets into the middle of this process and filters the lookups so that if your device tries to show you an advert it can block it. Everything else is displayed as normal, but the ads will be missing.

Further in the article:

  • How does Pi-hole work?
  • What you’ll need
  • Choosing the right Raspberry Pi and accessories
  • Installing Raspberry Pi OS Lite
  • Starting and updating your Raspberry Pi
  • Creating a static IP address for your Raspberry Pi
  • Installing Pi-hole
  • Changing your router’s default DNS server to Pi-hole
  • Accessing and administering Pi-hole
  • Using Pi-hole as a DHCP server

…and more. This is depth tutorial with screen shots and detaield explanation of each step. Pi-hole can make a big difference to your overall internet experience, reducing the number of banners, pop-ups, videos, and other types of advertising you are compelled to see. How effective it is depends on the websites you visit and the blacklist you use. There are a number of sites dedicated to testing the effectiveness of ad-blockers: Adblock Tester, for example, scored 57 out of 100 with Pi-hole running, and only 27 out of 100 without it (MacOS and Safari browser). Superb!

[Read More]

Cybersecurity teams are reaching their breaking point. We should all be worried

Categories

Tags infosec linux teams cio web-development app-development

Stress and burnout are having a massive impact on cybersecurity teams, leaving people and businesses more vulnerable than ever. Cybersecurity professionals are “reaching their breaking point” as ransomware attacks increase and create new risks for people and businesses. By Owen Hughes.

A global study of 1,100 cybersecurity professionals by Mimecast found that one-third are considering leaving their role in the next two years due to stress and burnout.

Nearly two-thirds (64%) of cybersecurity leaders surveyed by Mimecast said they had experienced at least one ransomware attack in the past year, while 77% said the number of cyberattacks against their company had either increased or stayed the same since 2021… These attacks have “personal consequences” for the wellbeing of cybersecurity professionals, Mimecast found: more than half (54%) of respondents agreed that ransomware attacks had a negative impact on their mental health, while 56% reported that their role gets more stressful each year.

One-third of teams reported an increased number of burnout-related absences following an attack. In addition, 34% of cybersecurity leaders reported difficulties in recruiting IT staff once an attack has taken place, making it even more difficult for organizations to prevent incidents in the future. Follow the link to the full article for more details!

[Read More]

How desktop and GPU virtualisation power up automotive innovation

Categories

Tags robotics linux miscellaneous software how-to teams

With the race towards autonomy becoming fiercer, the costs to use these new enabling technologies are rising exponentially. Moreover, the need for talent and experts across the world is forcing companies to shift to remote work. You’ve probably heard of virtual desktop infrastructures (VDI) and vGPUs (virtual GPUs), but why would you need one and how could they help your company? By Bertrand Boisseau.

In order to validate autonomous driving (AD) and ADAS systems, algorithms have to go through intense simulations. These simulations require building virtual scenes that replicate very realistic environments where driving scenarios can be tested.

In tihs article you will get info on:

  • Setting the stage for autonomous vehicle validation
  • Early work on simulations kicks off
  • GPUs add much-needed power but scalability issues arise
  • Enter VDIs
  • vGPUs save the day

Use of NVIDIA virtual GPUs enables the teams now provision virtual GPU devices on-demand, without buying additional hardware. This allows them to allocate GPU resources on the fly to VMs. By doing so, not only do they increase efficiency by improving resource consumption, they also accelerate the way their developers work. Nice one!

[Read More]

Rings of an ancient tree contain a record of Earth's magnetic field reversal

Categories

Tags miscellaneous big-data data-science learning

An ancient Agathis australis tree with rings that document the near-reversal of Earth’s magnetic field has been discovered on New Zealand’s north island. The tree, which measures 8 feet in diameter and 65 feet in length, was found buried under 26 feet of soil. Carbon dating shows that the tree was alive for 1,500 years and lived between 41,000 and 42,500 years ago. By @ilovetheuniverse.com.

The tree’s rings show a complete record of the near-reversal of Earth’s magnetic field. This is the first time that a tree documenting the full event has ever been found. Reversals in our planet’s magnetic field have been linked to extinction events. Scientists studying the tree say that it provides insight into what we might expect the next time we experience a reversal of Earth’s magnetic field.

NASA warned earlier this year that the magnetic “north pole” is speeding toward Russia at 30 miles per year, indicating the start of a total pole reversal. While it can take thousands of years for the poles to completely flip, their journey to the other side can cause chaos in the meantime, as the magnetic field lines cross and become jumbled, weakening their ability to protect us from solar radiation.

Scientists are scrambling to develop models to determine how that will look in practice. This tree will assist them in doing so. Super interesting!

[Read More]

Concurrency in Go-2(Go Channels)

Categories

Tags app-development programming golang performance

The channel acts as a pipe by which we send typed values from one Goroutine to another. It guarantees synchronization since only one Goroutine has access to a data item at any given time. The ownership of the data is passed between different Goroutine. By Neeraj Kumar.

Concurrency in Go-2(Go Channels

Source: https://dev.to/neeraj1997dev/concurrency-in-go-2go-channels-24lk

In this guide you will learn:

  • Why use channels in golang?
  • Creating a Go channel
  • Steps to create a channel in Go
  • Directional channel in Go
  • Go channel use cases
  • Use of range in Go channels
  • Select statement in Go channels
  • Fan in and fan out in golang channel

… and much more. Code examples thoroughly explain the concept. In Go, channels are essential for communication between goroutines. Channels support bidirectional communication i.e sending and receiving values on the same channel. This mechanism enables goroutines to synchronize without experiencing any deadlock. Nice one!

[Read More]

How to balance virtual machine traffic with Kubernetes services

Categories

Tags devops microservices app-development kubernetes

Kubernetes service constructs create highly available services in mixed container and VM environments without any external components. By Fatih Nar (Navigator, Red Hat), Rimma Iontel (Red Hat).

OpenShift supports the best of both virtualization worlds: virtual machines (VMs) and containers. In the containers and Kubernetes world, the “services” model permits external access to and consumption of applications that are deployed as containers within the pods.

In the article you will find:

  • How OpenShift creates VMs
  • Implement load balancing with multiple VMs
  • Test VM traffic
  • Create highly available services

You can leverage Kubernetes service constructs to create highly available services in a mixed container and VM environment, and you can do it without the need for any external components. This approach can be very handy in small-footprint and edge deployments where container and VM workloads coexist. Good read!

[Read More]

Asynchronous tasks with Flask and Celery

Categories

Tags python web-development app-development

If a long-running process is part of your application’s workflow, rather than blocking the response, you should handle it in the background, outside the normal request/response flow. By Michael Herman.

By the end of this tutorial, you will be able to:

  • Integrate Celery into a Flask app and create tasks.
  • Containerize Flask, Celery, and Redis with Docker.
  • Run processes in the background with a separate worker process.
  • Save Celery logs to a file.
  • Set up Flower to monitor and administer Celery jobs and workers.
  • Test a Celery task with both unit and integration tests.

Perhaps your web application requires users to submit a thumbnail (which will probably need to be re-sized) and confirm their email when they register. If your application processed the image and sent a confirmation email directly in the request handler, then the end user would have to wait unnecessarily for them both to finish processing before the page loads or updates. Instead, you’ll want to pass these processes off to a task queue and let a separate worker process deal with it, so you can immediately send a response back to the client. Nice one!

[Read More]