Data Pipelines
Automate data ingestion, transformation, and delivery.
Pipeline Definition
from oneml.pipeline import Pipeline
pipeline = Pipeline([
Ingest("s3://bucket/raw"),
Transform(normalize, augment),
Validate(schema),
Export("s3://bucket/processed")
])
pipeline.run(schedule="daily")