Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Convolutional neural network implementation for car classification

Categories

Tags big-data data-science azure learning

Convolutional Neural Networks (CNN) are state-of-the-art Neural Network architectures that are primarily used for computer vision tasks. CNN can be applied to a number of different tasks, such as image recognition, object localization, and change detection. By Dr. Evan Eames and Henning Kropp.

This article captures interesting challenge: Develop a Computer Vision application which could identify the car model in a given image. Considering that different car models can appear quite similar and any car can look very different depending on their surroundings and the angle at which they are photographed, such a task was, until quite recently, simply impossible.

The article is split into:

  • Setting up an Artificial Neural Network to Classify Images
  • Image Augmentation with Koalas
  • Coding a ResNet in Keras
  • Tracking Results with MLflow and Azure Machine Learning
  • Getting Started with CNN Image Classification

This article and notebooks demonstrate the main techniques used in setting up an end-to-end workflow training and deploying a Neural Network in production on Azure. The exercises of the linked notebook will walk you through the required steps of creating this inside your own Azure Databricks environment using tools like Keras, Databricks Koalas, MLflow, and Azure ML. Superb!

[Read More]

Under the hood of the Angular Compatability Compiler(ngcc)

Categories

Tags frontend web-development angular nodejs javascript

In this artice, we will explore how angular makes non Ivy libraries compatible with Ivy libraries using its compatability compiler ngcc. By Ajit Singh.

Angular compiles the code in the latest version(v9) but, not all code is compiled at the same time. There are libraries, npm modules, dependencies are precompiled and these may not work well with the way ngtsc compiles Angular code. This may cause failures at runtime, compile-time, etc. Fortunately, the Angular has already solved these problems for us using the Angular compatibility compiler ngcc.

One of the first problems that we face while transpiling non-Ivy code into Ivy compiled code is that we now have no decorator info in our files. To solve it ngcc uses the .metadata.json files in the Angular Package Format. These files contain information that was present in the Typescript source but was removed during transpilation to Javascript, and this information is sufficient to generate a patched JavaScript files which add the Ivy static properties to decorated classes.

The article is split into these detailed sections:

  • What is ngcc?
  • How ngcc works?
    • Metadata files from Angular Package Format
    • Overall ngcc architecture

Follow the link to original article to get the full overview. Well done!

[Read More]

Heal for SAP

Categories

Tags management cio miscellaneous software fintech

Shaivya Easwaren published this 4th article in the series about self-healing as the solution for ensuring site reliability in modern day enterprises with ultra-dynamic workloads. In the previous blogs of the series, we have seen the various issues that typically plague such environments, how AIOps and self-healing tools help resolve these issues, particularly how Heal helps by monitoring the Four Golden Signals for SRE.

The article then explains:

  • Issues in SAP Monitoring
  • How do AIOps Tools help?
  • Smart Automation for Ops Monitoring Readiness
  • Self-Healing – the “Extra” Element for Ops Readiness and SRE
  • How Heal for SAP Works

The Heal SAP agent collects various metrics from the environment, including:

  • Discovery & Configuration: Landscape discovery information and configuration details for services
  • Workloads: User workload, Datacenter processes, end user transactions, batch jobs (background workload)
  • Component Metrics: Relevant performance metrics from SAP application servers, databases and hosts (using Heal Component Agent)
  • Logs

Although the blog today mentions the Heal SAP agent, you can even try out the Heal Agentless Edition with our ingestion API to stream your existing monitoring data into Heal’s MLE for deriving insights. Good read!

[Read More]

The 3 essentials for properly setting up Google Analytics conversion tracking

Categories

Tags analytics big-data cio data-science

We asked 48 experts to share their most useful tips, tricks, and tools for properly setting up and tracking website conversions via Google Analytics. Written by Belynda Cianci.

To give everyone a starting point for improving their relationship with Google Analytics, we asked 48 experts to give us their number one tip for improving conversion tracking so you can get everything you want out of your reporting. They gave us some pro-level insights into how to be sure you’re looking in the right direction for your goals and Key Performance Indicators (KPIs), and offered advice on where to get help if you’re feeling a little out of your depth.

Using Google Analytics to keep up to date with your website activity can be a valuable data tool when wielded properly. You can use it to track traffic, sales, conversions and more —if you have the proper setup. Tracking conversions is one of its most vital functions for marketers looking to drive growth and identify areas to improve their offering and journey.

The article then dives into:

  • Which types of conversions do you track in Google Analytics
  • Tracking tips – Events, Actions, Goals
  • Form submits & thank you pages
  • Tag Manager
  • Reporting tips & tricks
  • Troubleshooting and support

Google Tag Manager, a companion tool to Google Analytics, can be used to insert javascript tags into your pages, track actions for those tags, and add variables to the data. Many of our experts swear by Tag Manager for its power to help them track conversions.

Getting a clear view into your data, user behavior, revenue, and conversion numbers is the most effective way to make well-informed decisions and create growth for your business.Super insightful for anybody working oon improving the conversion rates!

[Read More]

Test Ansible roles using Molecule and Podman

Categories

Tags ansible devops infosec tdd cicd

I needed to have testing added to Ansible roles. There are various people in the customer organization developing roles, and we want a lightweight, easy to use test process to unify the looks and quality of the roles. By Ilkka Tengvall.

There are some clear benefits of podman for containers and Ansible for tests:

  • Containers are slim and quick
  • Podman requires no root, which makes it easily part of CI/CD
  • Easy testing language

Molecule encourages an approach that results in consistently developed roles that are well-written, easily understood and maintained. Molecule is the official testing framework for Ansible roles. It provides a streamlined way to create a virtualized environment to test the syntax and functionality of a role.

We can use podman as Molecule plugin to spin up tests quickly in containers. And thanks to podman, no root gets hurt during the process. Which means we can put this safely into the CI/CD process, because of everything gets run as a user. Follow the link to full article. You will also get video tutorial and links to example code in a GitHub repository. DevOps rules!

[Read More]

What is Kata and how is it different from Lean?

Categories

Tags agile management cio programming career teams

This article tries to find answer to questions: What is Kata? How do Kata Coaching and the Improvement Kata work? How are they different from other lean concepts? By Rever Team.

The term “Kata” means a structured way of doing things or practice. It has its roots in Japanese martial arts where learners spend much of their time practicing drills to improve specific moves. By repeating a movement on a consistent basis, the correct technique is gradually mastered. It becomes ingrained in muscle memory until it happens by reflex. This kata definition then developed into a mainstream business practice when Toyota adopted it as part of its lean production system.

The term “Toyota Kata” was first used by Mike Rother in his book of the same name. In it, he outlined the core routines that he had observed at the Japanese automotive manufacturer which contributed to its continuous improvement efforts. Rother’s book explained how organizations could implement and benefit from Toyota’s improvement concepts by following structured habits or “Katas”.

In the business world, there are two main Katas or practices: the Coaching Kata and the Improvement Kata. These can both help businesses to develop a culture of improvement and innovation.

The article goes over following topics:

  • What Is Kata?
  • Benefits of Kata
  • Implementation
  • Improvement Kata
  • Coaching Kata
  • How are Kata and Lean different?
  • Principles

… and more. We liked: This improvement policy isn’t just about processes – it’s about people too. This is where the Coaching Kata comes into play. It is what helps employees to develop the skills and capabilities needed to continuously improve. Nice read!

[Read More]

Kotlin: An illustrated guide to conditionals When and If

Categories

Tags kotlin android app-development programming career

In real life, we do different things depending on the circumstances. For example, if it’s raining outside, I’ll probably grab an umbrella. If it’s sunny outside, I’ll grab my sunglasses. I do different things depending on the weather. By Dave Leeds.

In this chapter, you will learn all about conditionals in Kotlin, which will allow us to change the way the code runs depending on circumstances! This is chapter 3 of animated tutorial series helping you to learn Kotlin programming language.

We can write Kotlin code that will tell us which of these three things Goldilocks will say, based on the temperature of the porridge. In programming terms, the three different cases above – that is, the three different rows of the table – are called branches. If it helps, you can visualize the branches like you’d see on a tree …

It is an excellent educational material for young learners or beginners to coding with great illustrations and excellent code explanations teaching the basics of programming. The chapter teaches conditionals around the fairy tale of Goldilocks and the Three Bears with mappings, code examples and visualisations. Recommended!

[Read More]

How to refactor code that has no tests using the Golden Master technique

Categories

Tags code-refactoring software-architecture web-development

The number one rule when refactoring is to always have tests in place before you start refactoring. Without tests, refactoring becomes a risky endeavor. Written by Mak.

Code that doesn’t have tests is often not designed to be testable. In order to make the code testable, you have to refactor it. See how this seems like an impossible task? The Golden Master test paves the way for being able to safely begin refactoring.

The Golden Master is a saved copy of the output a program generates.

The article reads about:

  • What is a Golden Master?
  • The untested code
  • Hardcode the input
  • Capture the output
  • Add the output as a variable in the test class

Plenty of code examples written in C# with good explanation for each example. Sweet!

[Read More]

How to build stateful, cloud-native services with Akka and Kubernetes

Categories

Tags akka programming scala containers

In this white paper by Jonas Bonér, CTO and co-founder of Lightbend, Inc you will learn few tips for running your stateful services as if they are stateless. The next frontier of competitive advantage is the speed with which you can extract value from data.

Speed counts: managing a firehose of never-ending data streams requires Reactive, data-driven services that can operate in near-real-time. This forces us to shift from a traditional stateless approach to data where a database somewhere is constantly being hit with requests each time information is needed to a stateful data-driven approach, where data is owned and accessed locally, with low latency and high-availability.

This long article then deals with:

  • The rise of containers
  • Managing containers at scale
  • Towards a holistic view on system design
  • The unfortunate trend of stateless protocols in cloud-native apps
  • Finding success with data-driven stateful services
  • The challenges of orchestrating stateful services

… and much more. Akka lets you run stateful services on Kubernetes as if they are stateless. No fuzz, no StatefulSets, no Operators, no messing around with remotely mounted disks, just using the infrastructure and guarantees that Kubernetes gives stateless services.

Apart from white paper in PDF form you will also get links to further resources and reading. Very informative article!

[Read More]

Word search Kata in F#

Categories

Tags functional-programming programming how-to

An article by Paweł Zelmański about his journey with a first bigger kata programmed in F#. The term ‘Kata’ means a structured way of doing things or practice. It has its roots in Japanese martial arts where learners spend much of their time practicing drills to improve specific moves.

The whole exercise took author about 20 hours, distributed over about two weeks. Repository with code can be found on the GitHub.

The article then describes the steps of his journey while learning F# language:

  • About Kata
  • Example test cases provided by Kata
  • Overview of the solution – Interpreter, Specification, Tests
  • Types
  • Domain driven design
    • Wrapping simple types into domain types
    • Creating complex types
  • Test driven development
    • Using TDD to incrementally build the application
  • Surprises of F# from C# point of view

… and more. We liked: F# heavily depends on pipe operator |>. This operator passes a value from a previous function or variable into another function. This is in depth article which will be very useful to anybody learning F#. With opr without the previous coding experience. Nice one!

[Read More]