Commit Graph

7 Commits

Author SHA1 Message Date
74abf12dcf feat: add exponential backoff retry strategy
Introduce a retry policy with exponential backoff and jitter for extractor and loader errors, with configurable max attempts and delay caps.
2026-04-13 14:00:00 -05:00
7f3d2b8cc4 refactor: rename Batch to Partition across pipeline
Rename internal types and channels from Batch to Partition for consistency with the data model.
2026-04-11 18:00:00 -05:00
1f8689cdfc feat: add configuration parsing and job definitions
Add a YAML config schema for migration jobs (source/target schema, table, primary key, options) and parse it at startup.
2026-04-10 14:00:00 -05:00
6d805dd372 feat: add mssql data extraction
Add an initial mssql extraction script that streams rows from a source table.
2026-04-04 18:00:00 -05:00
438b6afa1c feat: add postgres connection helper
Add a thin wrapper around pgx to open and verify a Postgres connection from a URL or individual parameters.
2026-04-01 09:00:00 -05:00
69ea51a8b6 feat: add config module with env and yaml loading
Introduce a typed configuration layer loaded from environment variables and a YAML file.
2026-03-31 14:00:00 -05:00
3e1db7b9e4 chore: init project with go.mod and base layout
Bootstrap the go-migrate project:
- go.mod (Go 1.26)
- cmd/ entrypoint skeleton
- base .gitignore and config files
2026-03-31 09:00:00 -05:00