US Household Data Cleaning Project- MySQL

In this project we walk through the process used for cleaning the raw household data.

Link to GitHub

Background: Received raw household data from a client and needed to transform and clean the data to be used in a Web Application.

Process: Used MySQL to ingest the data, identified data inconsistencies, and normalized the data using processes shown below.

First, let's take a look at the data:

 We need to check for duplicates first. Let's do this by running a count on the id which should be unique.

With this code we can see we have multiple duplicates. We need to remove these duplicates and we do that with this code:

All the duplicates have been removed in the data.

Next, the data needs to be standardized and uniform:

We also found the data was inconsistent and was mis-labeled, misspelled, or not clear.

Found it here...

And here...

Then end result is the data is cleaned and ready to be used. No misspelling or duplicates.