Demo & Testing

Environment management and testing utilities

Caution: Destructive Operations

These operations will permanently delete data from the backend server. Use only for testing and demos. Always confirm before proceeding.

Reinitialize Environment
Complete reset of all data and metadata

This will:

  • Drop ALL bronze, silver, and gold tables
  • Clear ALL metadata (pipelines, transformations)
  • Clear ALL data sources
  • Reset environment to initial state
⚠️ This is a complete reset. Cannot be undone.
Drop Medallion Tables
Remove data tables only, preserve metadata

This will:

  • Drop ALL bronze.* tables
  • Drop ALL silver.* tables
  • Drop ALL gold.* tables
  • Preserve metadata (pipelines, data sources)
⚠️ Data tables only. Metadata preserved.
📋 Standard Testing Protocol
Follow this protocol for consistent demo/testing

Step 1: S3 Files (Always select these 2 files)

  • dealer_regions.csv
  • vehicles.csv

Step 2: PostgreSQL Query (Historical Sales)

SELECT * FROM vehicles.daily_sales WHERE sales_date < '2019-01-01'

Contract: transformation_name: "PostgreSQL - Daily Sales Historical"

Target table: daily_sales

Step 3: Time Dimension (Always generate)

Start Date:

January 1, 2016

End Date:

Today