Skip to content

upload_bronze

Purpose

UploadBronzeJob takes the raw dataset files that were previously downloaded to the local filesystem (by download_bronze) and uploads them into the pipeline's S3-compatible object store under the bronze/ prefix. This makes the data available to all subsequent pipeline stages, which operate entirely on cloud storage.

Entrypoint

Method Command
CLI dip upload-bronze

Like download_bronze, this job does not expose get_tasks / process_task -- it is a one-shot local utility.