kylesoda
  • Joined on 2026-02-24
kylesoda pushed to main at kylesoda/go-migrate 2026-04-17 20:58:25 +00:00
846a49d40c feat: implement GenericLoader for batch processing and utility functions
kylesoda pushed to refactor/extractor-retry-logic at kylesoda/go-migrate 2026-04-17 19:00:45 +00:00
ec96532d04 refactor: optimize row handling in mssql extractor and transformer
46597c4ffd refactor: implement extractor retry logic and streamline extractor interface
15d1b96849 refactor: streamline error handling and remove redundant code in mssql extractor
73b65e2a3f refactor: remove extractor error channel and simplify retry logic in mssql and postgres extractors
Compare 4 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-17 06:18:30 +00:00
93b302db8e feat: refactor job result handling and remove unused files
kylesoda pushed to refactor/extractor-retry-logic at kylesoda/go-migrate 2026-04-17 04:49:43 +00:00
1c3db39b21 update extractor interface
kylesoda created branch refactor/extractor-retry-logic in kylesoda/go-migrate 2026-04-17 04:49:43 +00:00
kylesoda pushed to refactor/retry-backoff at kylesoda/go-migrate 2026-04-16 22:11:55 +00:00
f65e67e02f feat: add backoff package for retry logic and implement example usage in new backoff-test script
93b302db8e feat: refactor job result handling and remove unused files
39c0d99502 feat: extend context timeout to 1 minute for database queries in mssql.go and postgres.go
b418ded78b feat: update SQL query to filter out specific column names in mssql.go
0d0511716f feat: add row count mismatch error handling in processMigrationJob and update SQL query to exclude additional graph-related columns
Compare 14 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-16 20:05:12 +00:00
39c0d99502 feat: extend context timeout to 1 minute for database queries in mssql.go and postgres.go
b418ded78b feat: update SQL query to filter out specific column names in mssql.go
0d0511716f feat: add row count mismatch error handling in processMigrationJob and update SQL query to exclude additional graph-related columns
67fb0148ae feat: add Makefile for building binaries across platforms
098cf36e3c feat: comment out TRUNCATE statements in pre_sql for MANZANA and PUERTO jobs
Compare 9 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-16 01:24:01 +00:00
0384d5423f feat: add range configuration to job settings for enhanced data processing control
1ce3d9e153 refactor: update partition handling to use Range struct for better clarity and consistency
Compare 2 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-16 01:22:36 +00:00
ed889b740a add db-wrapper package types
kylesoda pushed to refactor/retry-backoff at kylesoda/go-migrate 2026-04-14 03:27:12 +00:00
c740d02821 feat: add backoff package for retry logic and implement example usage in new backoff-test script
kylesoda created branch refactor/retry-backoff in kylesoda/go-migrate 2026-04-14 03:27:12 +00:00
kylesoda pushed to main at kylesoda/go-migrate 2026-04-14 03:27:07 +00:00
803f8988b8 refactor: update extractor interfaces to return row counts instead of using pointers for rows read
kylesoda pushed to main at kylesoda/go-migrate 2026-04-13 13:18:30 +00:00
33c9cd9c3e feat: implement database wrapper interfaces for MSSQL and Postgres; enhance migration job processing with pre and post SQL execution
85074da2ec feat: add max partition and chunk error limits to extractor and loader error handlers
Compare 2 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-13 01:36:06 +00:00
f126d5bbd0 feat: implement exponential backoff strategy for error handling in extractor and loader processes; enhance retry configuration options
5633dc98d0 fix: enhance error handling in extractor and loader processes; ensure proper job error propagation and logging
01780b4b02 refactor: remove unused ColumnType and inspect-columns files; update migration job to use separate table analyzers for source and target databases
aded502ee4 feat: implement Postgres table analyzer with column type querying and metadata retrieval
4d3cd6e4cf feat: add MSSQL table analyzer and integrate partition range generation for improved data migration
Compare 17 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-11 00:07:17 +00:00
c2ea84bfcf feat: implement extractor error handling and batch processing for MSSQL and Postgres
6345a0d694 feat: enhance migration job processing with detailed metrics and error handling
1db35c796c feat: enhance migration job processing with parallel execution and improved logging
0d9f955b2f feat: enhance batch processing by adding rowsPerBatch parameter and improving logging messages
524d892a60 feat: refactor migration job structure to use SourceTableInfo and TargetTableInfo for improved configuration handling
Compare 7 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-09 14:26:36 +00:00
3375f72c8e feat: add configuration parsing and job settings structure for YAML migration configuration
kylesoda pushed to main at kylesoda/go-migrate 2026-04-09 12:18:40 +00:00
a0b51f40c1 feat: add context support to migration job processing for improved cancellation and error handling
b64a76ca45 feat: improve error handling and job cancellation in migration process
51480015ba feat: enhance concurrency management by adding WaitGroup support in extractors and loaders
dc632361e5 feat: implement loader error handling and refactor chunk processing in migration job
0ee5d9032c feat: add context support to error handlers for improved cancellation and error management
Compare 11 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-09 01:22:18 +00:00
e158986947 feat: enhance error handling with JobError struct and update extractor logic
bc6f9a6a70 feat: implement batch processing for MSSQL with improved structure and logging
Compare 2 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-09 00:18:59 +00:00
d32d4df6e4 feat: implement batch processing for MSSQL with improved structure and logging
51d83661a4 fix: update globalID generation for consistency in UUID handling
75b04d4b2e feat: add MANZANA migration job and update related processing logic
3765e8adb3 feat: implement PUERTO data generation and loading with improved structure and logging
Compare 4 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-08 14:57:47 +00:00
4434054b21 feat: implement data generation and loading for MANZANA with improved structure and logging
1e2a37e59f fix: adjust migration parameters for improved performance and consistency
8afdb45318 feat: implement batch processing for MSSQL extraction and transformation with range handling
8903a04f4d fix: standardize variable naming and adjust loader sleep duration for consistency
Compare 4 commits »