Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Scaling payments for Black Friday 2019

Categories

Tags software-architecture apis web-development agile

A blog post about Black Friday’s production scalability experience in payments provider company named iyzico. By Yalçın Yenigün.

First, they predicted the hourly request count of Black Friday 2019 and the maximum transaction per second (TPS) of their APIs because they needed to optimize throughput by finding and fixing bottlenecks. Thier team made predictions by using Long Short-Term Memory (LSTM) architecture. Unlike standard feedforward neural networks, LSTM has feedback connections. For more detail: https://pathmind.com/wiki/lstm.

After prediction, we knew the maximum request count per second of APIs and the predicted time frames of related peaks. In production, the engineering team simulated the same request counts via load testing by using JMeter (http://jmeter.apache.org/) and found the bottlenecks. The major improvements that we implemented:

  • Feature toggling
  • Health checks
  • Splitting Monoliths: Split some of monolith databases.
  • Cleaned blocking commands
  • Improved existing monitoring tools
  • Circuit breakers
  • Failover tests

… and more. And you will get links to further reading and resources. Good read!

[Read More]

Quantum computing for the very curious

Categories

Tags how-to cloud data-science machine-learning big-data software

If aliens have computers, it’s because computers are the answer to a question that naturally occurs to both human and alien civilizations. By Andy Matuschak and Michael Nielsen.

In 1928, the notion of an algorithm was pretty vague. Up to that point, algorithms were often carried out by human beings using paper and pencil, as in the multiplication algorithm just mentioned, or the long-division algorithm.

The article in great detail describes:

  • Part I: The state of a qubit
  • Part II: Introducing quantum logic gates
  • Part III: Universal quantum computing
  • What are quantum computers good for?
  • Are quantum computers really universal devices?

Quantum computers need to be at least as capable as classical computers. Over the long term, authors believe the most important use of quantum computers will be simulating other quantum systems. Excellent read!

[Read More]

SRE is the most innovative approach to ITSM since ITIL

Categories

Tags devops programming how-to cloud cio

For over a decade, IT Infrastructure Library (ITIL) has been the leading IT service management (ITSM) framework adopted by enterprises across the globe. So, what is driving a rapidly increasing interest in Site Reliability Engineering (SRE) as a service management alternative? By Jayne Groll.

ITIL is a library of volumes describing a framework of best practices for delivering IT services.

In its own words, Google refers to SRE as its approach to service management: “The SRE team is responsible for the availability, latency, performance, efficiency, change management, monitoring, emergency response and capacity planning.”

The article then provides information on:

  • ITIL4 framework compared to SRE
  • SRE is more closely aligned to Agile and DevOps
  • What this means for the “Humans of DevOps” in Operations and ITSM

Services will always need to be managed. However, competing in a digital age requires new ways of working and thinking with speed and quality as key metrics. Agility must be instilled across the value stream spectrum in order to increase flow and deliver an exemplary customer experience. Excellent!

[Read More]

How to prepare for a technical phone/video interview

Categories

Tags miscellaneous programming how-to learning

Kiara Contreras put together this guide in which she shares things that she has done to set herlsef up for success. Having set actions that you complete prior to the interview can ease anxiousness by creating routine.

This post includes information about actions that are meant to be done within the hour before your interview:

  • Take notes before the interview
  • Get dressed
  • Alert others of your interview
  • Find a quiet spot
  • Test camera & audio
  • Check Internet connection
  • Have resume & job description accessible
  • Silence your devices

… and much more. Getting into interview clothes can help your energy and that translates virtually to the interviewer. Try to place the computer/webcam at eye level. Doing this will help with your posture and you can speak directly without turning. Good read!

[Read More]

The rise and fall of the OLAP Cube

Categories

Tags big-data data-science miscellaneous database software-architecture

One of the biggest shifts in data analytics over the past decade is the move away from building “data cubes”, or “OLAP cubes”, to running OLAP workloads directly on columnar databases. By Cedric Chin.

Online Analytical Processing (or OLAP) is a fancy term used to describe a certain class of database applications. The term was invented by database legend Edgar F. Codd, in a 1993 paper titled Providing OLAP to User-Analysts: An IT Mandate.

-The OLAP cube grew out of a simple idea in programming: take data and put it into what is known as a “2-dimensional array” —-that is, a list of lists.

This is a huge change, especially if you’ve built your career in data analytics over the past three decades. What are the tradeoffs? What are the costs? Is this move really as good as all the new vendors say that it is? And of course, there’s that voice at the back of your head, asking: is this just another fad that will go away, like the NoSQL movement before it? Will it even last?

The article main parts are:

  • What the heck is OLAP?
  • The performance challenges of OLAP
  • The rise of the OLAP Cube
  • Wither the OLAP Cube
  • A new paradigm emerges

Tech-savy companies like Amazon, Airbnb, Uber and Google have rejected the data cube paradigm entirely; these events and more tell us that we are going to see both trends spread into the enterprise over the next decade. Excellent read!

[Read More]

Here's what I learned about SaaS during my 5 years at Buildium, after it sold for $580M

Categories

Tags software-architecture startups how-to software

I think it’s clear that the world of technology start-ups is pretty screwed up when it comes to financial valuations. Only in this world is whether or not your company is profitable so often seen as being of secondary importance. I digress. By Geoff Roberts.

In this post author is going to share the most important lessons about growing a SaaS business that he learned at Buildium—collectively, these things had an awful lot to do with the company being valued so highly.

Some highlights from this article:

  • Focus on a market segment until you dominate it
  • You don’t need a huge TAM (Total Addressable Market) to build a big company
  • The early team is everything
  • You can design any sort of equity structure that you want
  • Venture capital is a tool and a commitment, not an outcome
  • Don’t discount the value of “non-recurring” revenue
  • What you do behind closed doors says everything about your character

… and much more. The lesson here is simple: Don’t be distracted by new or adjacent markets until you’re truly winning and dominating in your own. Good read!

[Read More]

Exploring an Apache Kafka to Pub/Sub migration: Major considerations

Categories

Tags software-architecture apache streaming big-data machine-learning google

In many cases, Google’s Pub/Sub messaging and event distribution service can successfully replace Apache Kafka, with lower maintenance and operational costs, and better integration with other Google Cloud services. By Leonid Yankulin.

The fastest way to migrate a business application into Google Cloud is to use the lift and shift strategy—and part of that transition is migrating any OSS, or third-party services that the application uses. But sometimes it can be more efficient and beneficial to leverage Google Cloud services instead.

The article deals with the following (in detail):

  • Pub/Sub key advantages
    • Zero maintenance costs
    • A push mechanism
    • Integrated logging and monitoring, and more …
  • Key differences affecting migration decisions
    • If you use exactly-once message delivery
    • If you consume messages that were published longer than seven days ago
    • If you use log compaction, random message access or message deletion
    • If you use keyed message ordering

Further reading and resources also included. Great job!

[Read More]

TypeScript's secret parallel universe

Categories

Tags javascript web-development nodejs

Florian Reuschel put together this tutorial for new TypeScript users. He focuses on one of the most underreported topics in the TypeScript tutorial world: the type scope.

The author centers this article around how he approached solving problem when he was writing a library with a bunch of classes distributed over various folders. For the library’s public API, I wanted those classes to be exposed as a single nested object (e.g. the Console class from Output/Console.ts being available as API.Output.Console).

TypeScript has a secret scope. TypeScript basically maintains a type scope which is completely independent of the variable scope of JavaScript. This means that you may declare a variable foo and a type foo in the same file. 🤯 They don’t even need to be compatible.

Now classes in TypeScript are a little bit special. What happens if you define a class Foo is that TypeScript not only creates a variable Foo (containing the class object itself) it also declares a type Foo, representing an instance of the Foo class.

Read more, to get the rest of infor from this excellent article!

[Read More]

The building blocks of visual design

Categories

Tags ux web-development miscellaneous

Visual design is about creating and making the general aesthetics of a product consistent. To create the aesthetic style of a website or app, we work with fundamental elements of visual design, arranging them according to principles of design. By Yu Siang Teo.

These elements and principles together form the building blocks of visual design, and a firm understanding of them is crucial in creating a visual design of any product.

While a close examination of each element is usually not necessary in your daily work as a designer, the principles of design — how to place the elements together to build pages and app screens optimally — play a crucial part in your role.

The article then goes over:

  • Elements of Visual Design
    • Line, Shape, Negative space, Volume, Value, Colour, Texture
  • Examples to highlight design elements and principles

Learning how to achieve unity, gestalt, hierarchy, balance, contrast, scale, dominance, and similarity will be extremely useful as you work in visual design. You will also get charts and images help to explain the main points in the article. Nice read!

[Read More]

Successfully porting complex data-driven frontends to React with GraphQL

Categories

Tags react nodejs javascript apis web-development

When porting existing code to React, there is a couple of things to look out for. This article shares my experience while porting a section of a Rails app to React and consuming data through GraphQL. By Neel Barthel.

The main points explained:

  • Build context, assess what you are porting
  • Make a plan, identify the core components that are necessary
  • Make a plan, identify the core components that are necessary
  • Figure out where and how to get the data
  • Decision making and planning, aligning the team

… and much more. Look at performance early, you don’t want any surprises right before or after launching 🚀. And remember: don’t ship without doing a bug hunt before. Well done!

[Read More]