How data moves through the site
In PlugZero Analytics, data isn’t just a file. it’s a living thing that changes through four stages.
The Four Stages of Data
Stage 1: Raw Files
We start with messy files (CSV, Excel) that users upload.
- Where they live: We store them in a secure bucket (AWS S3) exactly as they were uploaded.
Stage 2: Cleaning the Data
We turn those files into a clean table using the Pandas library.
- We strip out extra spaces and fix dates.
- We tag every row so we know which file it came from.
Stage 3: Doing the Math
The Analysis Engine computes the averages, the outliers, and the trends.
- The results are saved in the database so we don’t have to calculate them again.
Stage 4: Showing the User
The frontend React app gets a clean JSON file with all the math done.
- It draws the charts and tables that the user sees in their browser.
Technical Note: We never change the user’s original file. We only save a “clean” version in the database for the site to use.
Last updated on