Welcome to curated list of handpicked free online resources related to IT, cloud, Big Data, programming languages, Devops. Fresh news and community maintained list of links updated daily. Like what you see? [ Join our newsletter ]

Arm64 performance improvements in .NET 7

Categories

Tags programming performance apis azure

The .NET team has continued improving performance in .NET 7, both generally and for Arm64. Following along the lines of ARM64 Performance in .NET 5, in this post author will describe the performance improvements the team made for Arm64 in .NET 7 and the positive impact it had on various benchmarks. By Kunal Pathak.

The instruction set architecture or the ISA of x64 and Arm64 is different for each one of them and this difference is always surfaced in the form of performance numbers. While this difference exists between the two platforms, team wanted to understand how performant .NET is when running on Arm64 platforms compared to x64, and what can be done to improve its efficiency.

In the article the following were some of the benchmarks that author finalized for his investigations:

  • BenchmarkGames
  • Bing.com
  • ImageSharp
  • Paint.NET
  • Micro benchmarks
  • Runtime improvements
    • L3 cache size
    • Thread pool scaling
    • LSE atomics

… and more. To conclude, .NET 7 release contains lots of improvements made in various areas from libraries to runtime, to code generation. The .NET team closed the performance gap between x64 and Arm64 on specific hardware. Nice one!

[Read More]

Deep dive: How AI content generators work

Categories

Tags big-data machine-learning data-science software-architecture

Artificial intelligence (AI) has been steadily influencing business processes, automating repetitive and mundane tasks even for complex industries like construction and medicine. By Victor Dey.

AI can not only aid in responding to your audience’s questions but can also help connect with consumers, generate leads, build connections and, in turn, gain consumer trust. These advantages are now being made possible, in part, with the use of AI content generator tools.

Further in the article:

  • How AI content generators work
  • AI content generation use cases
  • Top content generation tools
  • Pros and cons of AI content generation

AI content generators work by generating text through natural language processing (NLP) and natural language generation (NLG) methods. This form of content generation is beneficial in supplying enterprise data, customizing material to user behavior and delivering personalized product descriptions. Good read!

[Read More]

Key points from the IBM Cost of a Data Breach Report 2022

Categories

Tags ibm cloud cio management infosec miscellaneous

The volume and impact of data breaches have accelerated largely in 2022, which has contributed to many adverse effects for businesses. Tc highlights several updated factors that have generated great costs across 17 countries and regions, and 17 industries. The report has included new related areas of analysis as well. By tripwire.com.

Organizations that had mature cloud security procedures showed a cost decrease of more than half a million dollars over those in the early stages of securing their cloud environments. The highest maturity level in the application of cloud security practices reported a cost of USD 3.87 million, while the lowest maturity level in cloud security practices where no controls are used had a higher cost of USD 4.59 million. Link to survey details in this video presentation.

The key points from the survey:

  • Cloud security and remote work
  • New key cost factors
  • XDR technologies
  • Incident response (IR)
  • Risk quantification
  • Zero trust

The impact of the zero trust security framework on data breaches is analyzed for the second time since the prior year’s report. Organizations saved nearly 1 million dollars in costs by having zero trust deployed. Organizations that had a zero trust framework had an average cost of USD 4.15 million, while organizations that didn’t reported a cost of USD 5.10 million. Good read!

[Read More]

How to program an IoT device in Elixir using Nerves?

Categories

Tags iot elixir servers performance distributed apis

Elixir is a great choice language for IoT devices due to its fault-tolerant nature, but also because of the ability to handle a lot of concurrent I/O operations thanks to the BEAM scheduler running under the hood. By Artur Ziętkiewicz.

In the article author discusses:

  • Minimum requirements
  • Configuration
  • Setting up an Over-The-Air updating
  • Adding web interface with Phoenix
  • Other UI libraries

Nerves is a platform that comes with a set of tooling that simplifies the process of creation and maintenance of an Elixir app on IoT devices. Software built using it are already battle-tested and working on production. Nerves supports most common boards (for example, every type of Raspberry Pi), but there’s one restriction: it has to be able to run Linux, that’s because Nerves actually runs your Elixir program on a lightweight Linux distro. Nice one!

[Read More]

Technology leader insights from the PwC Pulse Survey

Categories

Tags miscellaneous cio management

There are always some unknowns in business, and right now those include how exactly the pandemic will play out, what the outlook for corporate taxes will be and when supply chain disruptions will ease. By @PwC.

The main points form the survey:

  • Technology and teaming will drive growth in 2022
  • Tax leaders and tech leaders are the new dynamic duo
  • Reinvention, cloud and data top the CIO agenda for 2022
  • AI leads innovation while emerging tech convergence drives the metaverse

AI tops the list of those they see as very important to the company’s products and services strategy (61%). Next on their list is digital identity (57%), 5G (56%) and IoT (54%). In fact, the ultimate tech convergence is reflected in the metaverse—which 46% of CIOs say will be very important to their offerings. While each of the technologies on our list is notable and can underpin a company’s innovation strategy, in reality many of these will be used in combination with one another. Good read!

[Read More]

Uber freight carrier metrics with near-real-time analytics

Categories

Tags data-science apache event-driven messaging distributed devops

Uber Freight has been around since 2016 and is dedicated to provide a platform to seamlessly connect shippers with carriers. We’re simplifying the lives of trucking companies by providing a platform for carriers to browse through all available shipment opportunities with upfront pricing and book with the tap of a button, and making the fulfillment process more scalable and efficient. By Ujwala Tulshigiri, Yeqing Lu, Ting Chen, Branden Colen.

The article describes how Uber Freight developed the Carrier Scorecard to show the carriers several metrics, including engagement with the app, on-time pickup/delivery, tracking automation, and late cancellations. By showing this information in near real time on the Carrier App, they are able to provide feedback to carriers in real time and set ourselves apart from most of our competitors in the industry:

  • Backend requirements
  • Potential solutions considered
  • Final system design
    • Kafka
    • Flink
    • Pinot
  • Data schema and challenges
  • Flink stateful stream processor
  • Hybrid Pinot table
  • Golang GRPC service
  • Impact

Apache Pinot provides rich index optimization techniques like inverted, Star-tree, JSON, sorted column and many other indexes to accelerate the query performance. For example, the Star-tree pre-aggregation index can speed up the queries to summarize the average wait time at facilities. The fast query made it an interactive experience for carriers to check out the wait time on a carrier app before they book a shipment.

Providing reliable service to shippers is critical for Uber Freight in order to gain their trust. Because carriers’ performance could significantly impact reliability of Freight’s service, we need to be transparent with carriers about the level to which we are holding them accountable, providing them with a clear view of how well they are performing and, if needed, where they can improve. Excellent read!

[Read More]

How to prevent Scala 3 compiler regressions with Community Build

Categories

Tags scala programming akka java web-development

We always assume the language compiler’s or interpreter’s impeccability when writing code in any programming language. Just as any other program, it might contain inconsistencies with its specification or subtle bugs. By Wojciech Mazur.

The article then dives into:

  • How does the compiler team test Scala?
  • Increasing the coverage of the Scala 3 Community Build
  • How does Open Community Build work?
  • Infrastructure and general flow
  • How to create a build plan
  • Execute the plan
  • Collecting the results of projects compiled with a new version like Scala 3
  • Impact of the Scala 3 Open Community Build

In author’s biew: We believe the Scala 3 compiler version should be treated as any other external dependency. We should always try to use the latest version whenever possible. The latest versions of Scala should improve performance or fix security vulnerabilities. Basically, bumping up the version shouldn’t be associated with troubleshooting, especially in terms of Scala’s minor versions. Good read!

[Read More]

GitHub CI/CD pipeline design choices for deploying Terraform code to GCP data domain

Categories

Tags devops cicd kubernetes containers

We have built our GCP data platform using Data Mesh principles. Each line-of-business (LoB) roughly translates to a domain on GCP. Each domain will have 3 environments, Dev, Non-Prod and Prod, and each environment will have 3 GCP projects/zones. By Bharath N.

Author has come up with multiple designs for CI/CD deployment pipelines:

  • Design 1: 3 environments, 3 branches and 3 code bases in GitHub
  • Design 2: 3 environments, 1 branch and 1 code base in GitHub
  • Design 3: 3 environments, 2 branches and 2 code bases in GitHub
  • Design 4: 3 environments, 1 branch and 1 code base in GitHub

Each designed solution contains explanation about advantages and downsides. Good read!

[Read More]

Why you absolutely must document your no-code software

Categories

Tags software-architecture big-data bots programming data-science devops

Here’s a conceptual framework to help keep your no-code and low-code effort simple, but comprehensive. By Joe Procopio.

The main points captured in the blog post:

  • Yes, you need to document code you didn’t write
  • Create a single, central document
  • Document before you act
  • Be verbose but direct
  • Document not just what you did, but why
  • Be judicious about what makes a release
  • Don’t rely on the platform’s versioning

Some platforms allow you to create save points and restore to previous versions like I mentioned above, but most don’t do it well, and some don’t do it at all. Make your own backup copies of text, scripts you’ve modified, settings you’ve changed, anything that would require a lot of rethinking to to re-do. Good read!

[Read More]

How to build low-code mixed-reality apps in Power Apps, AI Builder and HoloLens

Categories

Tags software-architecture big-data bots management data-science software

Off-the-shelf tools and components like Power Apps, AI Builder and HoloLens let you deliver your own industrial metaverse at a low cost. Microsoft’s low-code Power Platform is a key piece of its business software suite. By sitting between Microsoft 365’s productivity tools and the Dynamics 365 line-of-business applications, it’s a way to build out custom workflows and add your own user experiences. By Simon Bisson.

There are three ways to build Power Apps applications: using Canvas apps to drag and drop controls onto a design surface, attaching code to them, or using model-driven apps to go straight from data to code.

The article also describes:

  • Power Platform in the metaverse
  • Adding mixed reality to a Power Apps application
  • Bringing Power Apps, device sensors and AI together
  • Building the future of application development with Power Apps

Building complex mixed-reality apps like this used to be hard, requiring a lot of developer resources. By using Power Apps, businesses can take advantage of its ability to quickly connect together different applications, using device cameras and cloud services along with simple workflows. Nice one!

[Read More]