Data Transformer

Overview

The Data Transformer normalizes raw ingested data into the platform's internal data model format. Each external data source has its own schema, field names, and data structures; the Data Transformer bridges this gap by converting diverse input formats into a consistent format that the platform can process.

The service receives data from the Data Ingestion service and applies source-specific transformation logic to map external fields to platform fields, convert units, apply data quality filters, and enrich records with additional context. The transformed data is then passed to Data Fusion for aggregation with other sources.

Related Services

• Data Ingestion — Provides raw data inputs
• Data Stream Ingestion — Provides streaming data inputs
• Data Fusion — Consumes transformed data for aggregation
• Experiment Manager — Data coordination