Data EngineeringADA AsiaProduction

Dynamic SQL Query Generation

Metadata-driven SQL generation system translating user-defined filter configurations into executable BigQuery queries.

Akash Sharma

Akash Sharma

Primary Owner

2022 – 20241 min read

The Problem

Customer dashboard filters needed to dynamically generate different SQL queries based on user configuration; building this with hard-coded SQL per filter was unmaintainable.

What Was Built

Built a metadata-driven parser that reads filter configuration (field, operator, value, data type) and generates valid BigQuery SQL. Supports complex filter combinations, nested conditions, and data type–aware comparisons.

Business Impact

Enabled dynamic, user-configurable dashboard filtering without code changes, supporting diverse enterprise customer analytics requirements.

Share

Tech Stack

PythonSQLBigQueryJSON

Domain Tags

SQL GenerationMetadata-DrivenAnalytics EngineeringBigQuery

Details

Role
Primary Owner
Status
Production
Tier
Tier 2
Period
2022 – 2024
Employment
ADA Asia
More Work

Related Data Engineering Projects

Data Engineering
Production

PySpark Data Pipeline Migration

Migrated the revenue metrics pipeline from single-machine pandas to distributed PySpark, resolving critical implementation bugs to unblock daily ML scoring.

PySparkSpark SQLGCP Dataproc+2
View Case Study →
Data Engineering
Production

Campaign Entity Resolution

Fuzzy matching + BERT embedding system to deduplicate and resolve campaign entities across CRM and marketing platform data sources.

PythonSplinkBERT Embeddings+2
View Case Study →