# Ingestion Orchestration Agent

*/Agents/Ingestion_Orchestration_Agent*

## Neighborhood

### What it consumes

- [Open Banking APIs](/Software/Open_Banking_APIs) — consumed by · Software
- [Brokerage Account Feeds](/Software/Brokerage_Account_Feeds) — consumed by · Software

### What it does

- [Build and Schedule ETL Pipelines](/Tasks/Build_and_Schedule_ETL_Pipelines) — performs · Tasks
- [Backfill Missed Ingestion Windows](/Tasks/Backfill_Missed_Ingestion_Windows) — performs · Tasks
- [Resolve Pipeline Run Dependencies](/Tasks/Resolve_Pipeline_Run_Dependencies) — performs · Tasks
- [Retry Failed Pipeline Stages](/Tasks/Retry_Failed_Pipeline_Stages) — performs · Tasks
- [Poll Integration Endpoints](/Tasks/Poll_Integration_Endpoints) — performs · Tasks
- [Draft Re-authentication Messages](/Tasks/Draft_Re-authentication_Messages) — performs · Tasks
- [Extract Transaction Metadata](/Tasks/Extract_Transaction_Metadata) — performs · Tasks
- [Identify Dropped Connections](/Tasks/Identify_Dropped_Connections) — performs · Tasks
- [Normalize Currency Formats](/Tasks/Normalize_Currency_Formats) — performs · Tasks

### Realizes

- [Managed Data Pipeline Orchestration](/Services/Managed_Data_Pipeline_Orchestration) — realizes · Services
- [SLA Backed Data Delivery](/Services/SLA_Backed_Data_Delivery) — realizes · Services

### Uses tool

- [Prefect](/Products/Prefect) — uses tool · Products
- [Dagster](/Products/Dagster) — uses tool · Products
- [Apache Airflow](/Products/Apache_Airflow) — uses tool · Products
- [Trigger Downstream Pipeline](/Action/Trigger_Downstream_Pipeline) — uses tool · Action
- [Emit Run Status Event](/Action/Emit_Run_Status_Event) — uses tool · Action

### Optimizes

- [Ingestion Success Rate](/Metrics/Ingestion_Success_Rate) — optimizes · Metrics
- [Data Latency](/Metrics/Data_Latency) — optimizes · Metrics
- [First-Pass Normalization Yield](/Metrics/First-Pass_Normalization_Yield) — optimizes · Metrics
- [Pipeline Uptime](/Metrics/Pipeline_Uptime) — optimizes · Metrics

### Composed of

- [General Ledger API](/Software/General_Ledger_API) — composes · Software
- [Data Pipeline API](/Software/Data_Pipeline_API) — composes · Software
- [Schema Normalization Engine](/Software/Schema_Normalization_Engine) — composes · Software
- [Open Banking Sync API](/Software/Open_Banking_Sync_API) — composes · Software
- [OAuth State Monitor](/Software/OAuth_State_Monitor) — composes · Software

### What it uses

- [Xero](/Software/Xero) — uses · Software
- [Fivetran](/Products/Fivetran) — uses · Products
- [Plaid](/Products/Plaid) — uses · Products
- [QuickBooks Online](/Software/QuickBooks_Online) — uses · Software

### Replaces this role

- [Financial Data Clerk](/JobTypes/Financial_Data_Clerk) — replaces · JobTypes

### Required skills

- [Data Analysis](/Skills/Data_Analysis) — requires skill · Skills
- [Operations Monitoring](/Skills/Operations_Monitoring) — requires skill · Skills
- [Quality Control Analysis](/Skills/Quality_Control_Analysis) — requires skill · Skills
- [Systems Evaluation](/Skills/Systems_Evaluation) — requires skill · Skills
- [Troubleshooting](/Skills/Troubleshooting) — requires skill · Skills

### What it addresses

- [Fragmented Financial Data Intake](/Problems/Fragmented_Financial_Data_Intake) — addresses · Problems

### Latent gaps

- [PII Redaction Pipeline](/Opportunities/PII_Redaction_Pipeline) — latent gap · Opportunities
- [Integration Generation Agent](/Opportunities/Integration_Generation_Agent) — latent gap · Opportunities
- [Feed Fallback Automation](/Opportunities/Feed_Fallback_Automation) — latent gap · Opportunities
- [Backfile Ingestion Service](/Opportunities/Backfile_Ingestion_Service) — latent gap · Opportunities
- [Transaction Enrichment API](/Opportunities/Transaction_Enrichment_API) — latent gap · Opportunities

### Problems this exposes

- [Bank Feed Connection Outages](/Problems/Bank_Feed_Connection_Outages) — exposes problem · Problems
- [Vendor Parsing Maintenance Costs](/Problems/Vendor_Parsing_Maintenance_Costs) — exposes problem · Problems
- [Unstructured PII Exposure Risk](/Problems/Unstructured_PII_Exposure_Risk) — exposes problem · Problems
- [Integration Engineering Headcount](/Problems/Integration_Engineering_Headcount) — exposes problem · Problems
- [Historical Data Onboarding Churn](/Problems/Historical_Data_Onboarding_Churn) — exposes problem · Problems
- [Batch Processing Decision Latency](/Problems/Batch_Processing_Decision_Latency) — exposes problem · Problems
