Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

How to prevent Scala 3 compiler regressions with Community Build

Categories

Tags scala programming akka java web-development

We always assume the language compiler’s or interpreter’s impeccability when writing code in any programming language. Just as any other program, it might contain inconsistencies with its specification or subtle bugs. By Wojciech Mazur.

The article then dives into:

  • How does the compiler team test Scala?
  • Increasing the coverage of the Scala 3 Community Build
  • How does Open Community Build work?
  • Infrastructure and general flow
  • How to create a build plan
  • Execute the plan
  • Collecting the results of projects compiled with a new version like Scala 3
  • Impact of the Scala 3 Open Community Build

In author’s biew: We believe the Scala 3 compiler version should be treated as any other external dependency. We should always try to use the latest version whenever possible. The latest versions of Scala should improve performance or fix security vulnerabilities. Basically, bumping up the version shouldn’t be associated with troubleshooting, especially in terms of Scala’s minor versions. Good read!

[Read More]

GitHub CI/CD pipeline design choices for deploying Terraform code to GCP data domain

Categories

Tags devops cicd kubernetes containers

We have built our GCP data platform using Data Mesh principles. Each line-of-business (LoB) roughly translates to a domain on GCP. Each domain will have 3 environments, Dev, Non-Prod and Prod, and each environment will have 3 GCP projects/zones. By Bharath N.

Author has come up with multiple designs for CI/CD deployment pipelines:

  • Design 1: 3 environments, 3 branches and 3 code bases in GitHub
  • Design 2: 3 environments, 1 branch and 1 code base in GitHub
  • Design 3: 3 environments, 2 branches and 2 code bases in GitHub
  • Design 4: 3 environments, 1 branch and 1 code base in GitHub

Each designed solution contains explanation about advantages and downsides. Good read!

[Read More]

Why you absolutely must document your no-code software

Categories

Tags software-architecture big-data bots programming data-science devops

Here’s a conceptual framework to help keep your no-code and low-code effort simple, but comprehensive. By Joe Procopio.

The main points captured in the blog post:

  • Yes, you need to document code you didn’t write
  • Create a single, central document
  • Document before you act
  • Be verbose but direct
  • Document not just what you did, but why
  • Be judicious about what makes a release
  • Don’t rely on the platform’s versioning

Some platforms allow you to create save points and restore to previous versions like I mentioned above, but most don’t do it well, and some don’t do it at all. Make your own backup copies of text, scripts you’ve modified, settings you’ve changed, anything that would require a lot of rethinking to to re-do. Good read!

[Read More]

How to build low-code mixed-reality apps in Power Apps, AI Builder and HoloLens

Categories

Tags software-architecture big-data bots management data-science software

Off-the-shelf tools and components like Power Apps, AI Builder and HoloLens let you deliver your own industrial metaverse at a low cost. Microsoft’s low-code Power Platform is a key piece of its business software suite. By sitting between Microsoft 365’s productivity tools and the Dynamics 365 line-of-business applications, it’s a way to build out custom workflows and add your own user experiences. By Simon Bisson.

There are three ways to build Power Apps applications: using Canvas apps to drag and drop controls onto a design surface, attaching code to them, or using model-driven apps to go straight from data to code.

The article also describes:

  • Power Platform in the metaverse
  • Adding mixed reality to a Power Apps application
  • Bringing Power Apps, device sensors and AI together
  • Building the future of application development with Power Apps

Building complex mixed-reality apps like this used to be hard, requiring a lot of developer resources. By using Power Apps, businesses can take advantage of its ability to quickly connect together different applications, using device cameras and cloud services along with simple workflows. Nice one!

[Read More]

7 best UX case study generators (and how to use them)

Categories

Tags ux web-development management miscellaneous learning

If you’re looking for UX case study ideas, topics or challenges, these UX case study generators can help you create portfolio pieces and improve your UX/UI skills. Here are some of the best ones and the pros and cons of using them. By designerup.co.

The article main sections and generators mentioned:

  • UX Challenge
  • Sharpen
  • Designercize
  • UX Tools Challenges
  • Uplabs Challenges
  • 100Daysofproductdesign
  • DesignerUp
  • UX case study usage
  • Pros and cons of using UX case study generators

Keep in mind that these generated UX case study projects and prompts are not considered ‘real-world or real- work experience’ by employers, but rather self-directed projects. They are a good first step for new UX designers to start practicing their problem solving skills on their own and refining their UX design process, but you’ll have to go the extra mile if you want to use them in your portfolio to impress during interviews. Good read!

[Read More]

Hosting ASP.NET Core web api with AWS Lambda – Truly serverless REST APIs

Categories

Tags bots apis programming learning cloud devops

In this article, we will learn about hosting ASP.NET Core Web API with AWS Lambda in a rather simple-to-follow manner. It is going to be as simple as developing a .NET 6 Web API as you would normally do using Controllers or Minimal APIs, and running some CLI commands which will deploy your API as Lambda Function to AWS Lambda super fast! By Mukesh Murugan.

The article provides a deep dive into serverless with dotnet:

  • Pros & cons of hosting ASP.NET Core Web API with AWS Lambda
  • When to Host ASP.NET Core Web API with AWS Lambda?
  • Prerequisites
  • Hosting ASP.NET Core Web API with AWS Lambda
    • Creating the .NET 6 Web API project
    • Installing the required Lambda package & service registration
    • Deploying the AWS Lambda with CLI
    • Lambda function URLs
    • Testing
    • Adding environment variables to the AWS Lambda
    • AWS Lambda CLI functions
    • Storing Lambda configurations in aws-lambda-tools-defaults.json
  • DevOps Enhancement for CI/CD

Being serverless, it costs nothing when there are no incoming requests, and also it costs close to nothing even when there are requests coming in, thanks to the generous Free Tier of AWS! Good read!

[Read More]

Delta Lake and MinIO for multi-cloud data lakes

Categories

Tags cio big-data cloud database data-science

Delta Lake is an open-source storage framework that is used to build data lakes on top of object storage in a Lakehouse architecture. Delta Lake supports ACID transactions, scalable metadata handling and unified streaming and batch data processing. By Matt Sarrel.

Delta Lake was designed to combine the transactional reliability of databases with the horizontal scalability of data lakes. Delta Lake was built to support OLAP-style workloads with an ACID table storage layer over cloud native object stores such as MinIO.

The main focus of this article is on:

  • Delta Lake files
  • ACID Transactions with Delta Lake
  • Delta Lake and MinIO tutorial
  • Create a test Delta Lake table on MinIO
  • MinIO and Delta Lake for high-performance ACID transactions on data lakes

The combination of MinIO and Delta Lake enables enterprises to have a multi-cloud data lake that serves as a consolidated single source of truth. The ability to query and update Delta Lake tables provides enterprises with rich insights into their businesses and customers. Various groups access Delta Lake tables for their own analytics or machine learning initiatives, knowing that their work is secure and the data timely. Good read!

[Read More]

Seven ways to reduce MySQL costs in the cloud

Categories

Tags sql cio devops cloud database

With the economy slowing down and inflation raging in many parts of the world, your organization will love you if you find ways to reduce the costs of running their MySQL databases. This is especially true if you run MySQL in the cloud, as it often allows you to see the immediate effect of those savings, which is what this article will focus on. By Peter Zaitsev.

With so many companies announcing layoffs or hiring freezes, optimizing your costs may free enough budget to keep a few team members on or hire folks your team needs so much:

  • Optimize your schema and queries
  • Tune your MySQL configuration
  • Implement caching
  • Rightsize your resources
  • Ditch DBaaS for Kubernetes
  • Consider lower-cost alternatives
  • Let experts manage your MySQL database

If the costs of your MySQL infrastructure in the cloud are starting to bite, do not despair. There are likely plenty of savings opportunities available. Nice one!

[Read More]

Understanding asynchronous APIs

Categories

Tags app-development devops apis cloud

If you’ve worked mostly with REST APIs, you might not be as familiar with asynchronous API protocols like WebSocket and gRPC. Asynchronous APIs allow you to stream data, send multiple requests at the same time, and manage communication intelligently between services, while synchronous APIs require you to make a new request every time you need data. By Melinda Gutermuth.

Let’s take a closer look at what makes asynchronous APIs different from synchronous APIs:

  • The difference between asynchronous and synchronous APIs
  • When to use an asynchronous API
  • Example asynchronous API use cases

In many cases, applications benefit from using a combination of synchronous and asynchronous APIs. While asynchronous APIs can offer perks like faster communication, quicker response times, and reliable scaling, there are advantages to synchronous APIs. Good read!

[Read More]

AWS CDK - The good, the bad and the scary

Categories

Tags app-development devops aws cloud cio programming

AWS Cloud Development Kit (CDK) has become, in its short history, a very popular infrastructure-as-code tool. It’s not too surprising why - it allows engineers to use richer programming languages to define infrastructure, rather than having to use JSON or YAML. By Mike Roberts.

In this article author shares his thoughts - both positive and negative - about CDK, for technical decision makers. This should help as you make your own choices about what infrastructure tooling to use.

The article highlights the information on:

  • The good
    • Programming language superpowers
    • Engineer enthusiasm The bad
    • Runtime debugging headaches
    • Ongoing meta-responsibilities
  • The scary
    • Longer-term operations requirements
    • AWS support of CDK over the long term
  • Should you use CDK or not?

Because of the fundamental nature of CDK being a client-side tool, and not a cloud-side tool, author thinks this expectation is false, or at least is yet to be proven. This brings up some the longer-term concerns outlined in the article. Nice one!

[Read More]