How Reporter works
Reporter is a component in the BeBanjo infrastructure that runs every 2 hours and extracts, transforms and loads (ETL) the data from your Movida / Metadata and Sequence accounts:
- Extract. Every two hours, Reporter retrieves a snapshot of all your data from the Movida / Metadata and Sequence databases.
- Transform. The raw data, as extracted from the application databases, is not structured or optimised for reporting purposes. In this stage, Reporter cleans and schematizes the data to conform to a normalized data model optimal for reporting.
- Load. Finally, Reporter updates your own private dataset in Google BigQuery with the transformed data.
Last updated January 12th, 2021.