Graph visualization of big messy data

Synthetic dirty data generator

Package for entity matching, standardization, and visualization using embeddings from large language models.

Script for classifying your messy directories

See how a model comes apart when repeatedly photogrammetry'd

A Python tool that transforms clean datasets into realistic messy datasets for testing data cleaning processes

[READ-ONLY MIRROR] A Python implementation for Hadley Wickham's Tidy Data paper

Statistical Programming in SAS

😺 The easiest way to structure unstructured data

Robust CSV dialect detection methodology for Python that outperforms existing state of the art solutions by 8.35% in terms of their F1 scores, using only built-in Python modules.

Configurable messy CSV generator for testing data pipelines and ETL processes. Three mess levels, 20+ field types, SQL/XSS injection simulation. No install required.

A Python data cleaning project demonstrating advanced Pandas techniques, regex, and data standardization on a messy HR dataset.

An end-to-end Python data cleaning pipeline using Pandas to resolve corrupt, missing, and inconsistent transactional logs in a Café Sales Dataset.

To get a hands-on experience with real-life messy data, I chose to work with food and nutrient data available on FoodData Central. I wanted to compare nutrients across different types of foods available in the US market.

Use generator expressions, formatting operations, and cleaning methods to prepare data for analysis.