n8n - Northbeam ETL

This workflow is a Northbeam data ETL pipeline that exports marketing analytics data to Google Cloud Storage on a daily schedule, with optional backfill capability.

Workflow Flow
Schedule Trigger - Runs daily at 7:00 AM (cron: 0 7 * * *)
Backfill Enabled? (Set node) - Configuration control that determines:
Daily mode (backfill: false): Exports yesterday's data only
Backfill mode (backfill: true): Exports date range from start_date to end_date.
BACKFILL (Code node) - Generates date ranges:
In daily mode: Creates single date entry for yesterday
In backfill mode: Creates entries for each day in the specified range
Outputs formatted dates for API calls and file naming
POST DATA EXPORT (HTTP Request) - Calls Northbeam API to export:
Metrics: AOV, CAC, CPM, CTR, impressions, ROAS, spend, visits, transactions, attributed revenue, email signups, and custom metrics
Attribution: Northbeam custom model, 1-day window, accrual accounting
Granularity: Daily data at ad level
Destination: GCS bucket fd-data-storage with path northbeam/ad_daily_clicks_only_accrual_1window/
Batches requests (1 per batch, 2s interval) with 20s timeout and retry logic
Slack - ETL Success Message - Sends success notification to Slack webhook when complete
Key Features
Flexible execution: Toggle between daily incremental loads and historical backfills
Comprehensive metrics: Tracks 20+ marketing and revenue metrics
Error handling: Retry logic with 2s wait between attempts
Monitoring: Slack notifications for successful runs