Tag: Python
-
Automating AWS IAM remediation in Python
Posted on June 20, 2022, Level advanced Resource Length long
Since automating IAM remediation requires recurring parsing of JSON documents, modulating your parsing function(s) will save you time as you work on each control. If you have controls that pertain to trust policies, you will need a separate function to parse those out since the format differs from that of permission policies. By Cody Bench.
Tags python app-development infosec programming cio
-
Introduction to Linear Programming in Python
Posted on June 19, 2022, Level intermediate Resource Length medium
A guide to mathematical optimization with Google OR-Tools. Linear programming is a technique to optimize any problem with multiple variables and constraints. It's a simple but powerful tool every data scientist should master. By Maxime Labonne.
Tags python app-development programming open-source
-
How to make anonymous requests using TorRequests and Python
Posted on April 11, 2022, Level intermediate Resource Length short
Tor is quite useful when you have to use requests without revealing your IP address, especially when you are web scraping. This tutorial will use a wrapper in python that helps you with the same. By scrapehero.com.
Tags python apis devops
-
Ray on databricks
Posted on January 31, 2022, Level intermediate Resource Length long
Ray is an open-source project first developed at RISELab that makes it simple to scale any compute-intensive Python workload. With a rich set of libraries and integrations built on a flexible distributed execution framework, Ray brings new use cases and simplifies the development of custom distributed Python functions that would normally be complicated to create. By Stephen Offer.
Tags data-science python machine-learning big-data
-
How Airbnb enables consistent data consumption at scale
Posted on December 25, 2021, Level intermediate Resource Length long
In this post, we will focus our story on how Minerva drastically simplifies and improves the data consumption experience for our users. Specifically, we will showcase how a unified metric layer, which we call the Minerva API, helps us build versatile data consumption experiences tailored to users with a wide range of backgrounds and varying levels of data expertise.
Tags data-science database cloud python distributed
-
API authentication with tokens
Posted on December 12, 2021, Level intermediate Resource Length medium
In this article I'm going to show you a few common patterns for client authentication based on tokens, and how can they be implemented in a Python API back end. This method of authentication works well for rich clients, like JavaScript-based front end applications running in the browser, or perhaps a command-line (CLI) application. By Miguel Grinberg.
Tags programming apis learning python
-
Introduction to Numpy in python
Posted on November 25, 2021, Level beginner Resource Length long
NumPy is a valuable and efficient tool for dealing with large amounts of data. NumPy is quick; thus, it's easy to work with a vast amount of data. Data analysis libraries like NumPy, SciPy, Pandas, and others have exploded in popularity due to the data science revolution. By Sonia Jessica.
Tags python machine-learning big-data how-to learning
-
Build and secure FastAPI server with Auth0
Posted on October 26, 2021, Level intermediate Resource Length medium
Learn the basics of FastAPI, how to quickly set up a server and secure endpoints with Auth0. By Mark Halpin.
Tags apis app-development infosec javascript python
-
Parallelism, concurrency, and AsyncIO in Python - by example
Posted on September 15, 2021, Level intermediate Resource Length medium
Concurrency and parallelism are similar terms, but they are not the same thing. This post looks at how to speed up CPU-bound and IO-bound operations with multiprocessing, threading, and AsyncIO. Older article by Amal Shaji.
Tags python programming web-development app-development performance
-
10 common SQL operations to perform using Pandas
Posted on August 30, 2021, Level beginner Resource Length medium
One of the key features of being a data analyst is to query the data from files, databases etc to perform some data manipulation or visualisation and sometimes it's much better if we can do it directly through code instead of looking into the database tables over and over again.. By Akash Mishra.
Tags database machine-learning big-data data-science python
-
Python's ChainMap: Manage multiple contexts effectively
Posted on August 23, 2021, Level intermediate Resource Length long
Sometimes when you're working with several different dictionaries, you need to group and manage them as a single one. In other situations, you can have multiple dictionaries representing different scopes or contexts and need to handle them as a single dictionary that allows you to access the underlying data following a given order or priority. In those cases, you can take advantage of Python's ChainMap from the collections module. By Leodanis Pozo Ramos.
Tags python programming oop app-development
-
Greykite: A flexible, intuitive, and fast forecasting library
Posted on May 29, 2021, Level intermediate Resource Length medium
In this blog post, we introduce the Greykite library, an open source Python library developed to support LinkedIn's forecasting needs. Its main forecasting algorithm, called Silverkite, is fast, accurate, and intuitive, making it suitable for interactive and automated forecasting at scale. Co-authors: Reza Hosseini, Albert Chen, Kaixu Yang, Sayan Patra, Rachit Arora, and Parvez Ahammad.
Tags python open-source software big-data machine-learning