sk Skill · affaan-m
data-throughput-accelerator
Use when large data ingestion, backfill, export, ETL, warehouse loading, manifest catch-up, or table synchronization needs to become much faster while preserving data correctness.
Open on skills.sh ↗read 2026-09-17
- installs 8w
- 1,505
- 30-day movement
- starts with the next reading
- Related entries
- 2
- Connections
- 6
JavaScript
An agent skill (SKILL.md) that guides an AI coding agent through speeding up large data movement tasks like ingestion, backfill, ETL, and table sync while preserving correctness. It defines a workflow, fast-path heuristics (e.g., warehouse-native processing, manifests/checkpoints), a hard accounting output block, and guardrails against misleading metrics.
Reach for it when the bottleneck is moving, transforming, or saving lots of data and you want speed without sacrificing correctness or auditability.
Use it to
- Accelerate large data ingestion or backfill jobs
- Speed up warehouse loading and table synchronization
- Optimize ETL and export pipelines
- Run manifest catch-up with checkpoint tracking
- Enforce accounting and guardrails on data pipelines
For Engineers running large-scale data pipelines via AI agents
- Host repository
- affaan-m/ECC
- Installs, lifetime
- 2,700
- Installs, 8 weeks
- 1,505
- Allowed tools
- Read, Write, Edit, Bash, Grep, Glob
- Licence
- MIT
- Host stars
- 261k
- Host language
- JavaScript
topicsdata-pipelinesetlthroughputbackfillagent-skillcorrectness