Continuous Archiving for Postgres

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

Reliable data integration & processing for advertisers

Local emulator for Google Cloud Storage

Unified cloud storage API for storage services.

Jupyter support for Google Cloud Storage

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

A global file-based mutex lock using Google Cloud Storage

A full text RSS generator which can hosted on google app engine

A file system with the power of an object store.

Python examples on Google Cloud Platform (GCP). How to manage Compute Engine VM instances, Cloud Storage buckets, etc.

Cloud Dataflow Tutorial for Beginners

Django storage module implementation for Google Cloud Storage

💾 ☁️ Tutorial for interacting with Google Cloud Storage via the Python SDK.

My personal project for data engineering zoomcamp

asyncio Python library for distributed mutex with GCS as a backend

It will take backup of given topic and store that into either local filesystem or S3.It will also restore from given local filesystem or S3.

A set of modules for deploying custom Git LFS servers on different infrastructure providers