Application of our De-identification Framework with open source technologies, enabling enterprises to take ownership of the de-identification process and deploy it in trusted environments.
-
Updated
Nov 15, 2021 - Python
#
datalake-ingestion
Here are 7 public repositories matching this topic...
Este projeto é uma adaptação com base em um teste real para uma posição de Engenheiro de Dados Jr.
-
Updated
Jun 16, 2023 - Python
This repository is designed for a data science project aimed to education, wich uses a public database from brazilian educational research institute about the nationam highschool exam and applies ETL and datamining association rules to this dataset.
-
Updated
Jun 24, 2021
Acquisition of energy industry balancing and settlement calculation data, into a data lake
-
Updated
Nov 4, 2024 - C#
End to end data reporting project using Azure services like Azure Data Factory for data orchestration, Azure Synapse Analytics for data warehousing, Databricks for data transformations, and Power BI for intuitive data visualization and reporting.
sql
azure
end-to-end
end-to-end-testing
powerbi
databricks
tsql
databricks-notebooks
datafactory
datalake-ingestion
datalake-etl
datalake-storage
-
Updated
Dec 30, 2023 - Jupyter Notebook
This repo is designed to show how to read and write data from/to google cloud storage with pyspark. The raw data is ingested, transformed and stored in the data lake in snapshot format.
-
Updated
Feb 27, 2023 - Python
Improve this page
Add a description, image, and links to the datalake-ingestion topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the datalake-ingestion topic, visit your repo's landing page and select "manage topics."