kylesoda
  • Joined on 2026-02-24
kylesoda pushed to main at kylesoda/go-migrate 2026-06-10 22:31:06 +00:00
86258718d8 refactor: update benchmark results and configuration for improved performance in go-migrate
13cd02a824 refactor: add reverse configuration and enhance transformation logic for PostgreSQL to SQL Server migration
f844004942 refactor: add comprehensive README documentation for go-migrate tool
4ba26092a9 refactor: implement bidirectional transformation support with PostgreSQL integration
537b7fbd28 refactor: remove obsolete skill registry documentation
Compare 50 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-29 19:39:15 +00:00
86258718d8 refactor: update benchmark results and configuration for improved performance in go-migrate
13cd02a824 refactor: add reverse configuration and enhance transformation logic for PostgreSQL to SQL Server migration
f844004942 refactor: add comprehensive README documentation for go-migrate tool
4ba26092a9 refactor: implement bidirectional transformation support with PostgreSQL integration
537b7fbd28 refactor: remove obsolete skill registry documentation
Compare 6 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-19 16:22:13 +00:00
b386965bb8 refactor: enhance database configuration handling with individual parameters and URL resolution methods
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-15 13:38:29 +00:00
961fa48025 refactor: implement dry run feature to validate connections and count source rows without migrating
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-12 16:08:04 +00:00
837fdc7abb refactor: add validation feature to compare row counts between source and target databases
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-12 16:02:31 +00:00
04b799ce08 refactor: add validation feature to compare row counts between source and target databases
9c7662d5cb refactor: add logging for successful database connections in main function
13bbd4e82c refactor: update SOURCE_DB_URL in .env.example to include connection timeout settings
b3e1979bfb refactor: implement expiry check to manage database connection interruptions
Compare 4 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-11 16:26:36 +00:00
b98c998820 refactor: update MockTableAnalyzer methods to improve parameter handling and capture range constraints
fe35d2a34c refactor: update RangeConfig to use pointers for min and max; adjust partition calculation logic to handle nil values
0784458106 refactor: add prefix support for storage column configuration and update blob path generation
6f2e3e28f1 refactor: enhance error handling in ProcessPartition by tracking last row values
Compare 4 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-11 13:37:02 +00:00
604702ef43 refactor: add unit tests for loaderAccumulator and consume functions; enhance error handling and batch processing logic
34a3122e5b refactor: add comprehensive tests for batch processing and error handling in Consume
68220e4c41 refactor: implement loaderAccumulator for batch processing; streamline error handling in Consume
ab9a2d8694 refactor: simplify batch processing by removing partition dependency and introducing batch accumulator
Compare 4 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-09 17:16:57 +00:00
16217f6ee2 refactor: update debug log to display partition count instead of partitions
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-09 15:38:26 +00:00
723041ff2c refactor: add partition calculation strategy and implement estimation logic; enhance table analyzers for max/min column queries
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-09 13:52:20 +00:00
8f8d2d11a4 refactor: enhance config handling in main; unify config parsing logic across scripts
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-09 07:07:20 +00:00
0c59d06af6 refactor: adjust configuration parameters for extractors and transformers; optimize batch processing settings
6fa9b21b1c refactor: update totalRows and chunkSize constants for improved performance
a8be31c18b refactor: adjust configuration parameters for extractors and loaders; enhance logging messages for clarity
5a8bce7701 refactor: update totalRows constant and add siteHolderAttach data generation logic; enhance row generation and loading process
b690e580c5 refactor: enhance logging and batch processing in migration; adjust configuration parameters for improved performance
Compare 12 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-08 12:51:06 +00:00
c4e233401b refactor: update GenericLoader to use ProcessBatchWithRetries; enhance error handling and retry logic
a216a8016f refactor: update extractor methods to support FromJsonColumns; enhance data processing capabilities
46ddd0d6b7 refactor: enhance extraction query handling; add support for JSON column extraction and wildcard patterns
Compare 3 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-06 23:57:05 +00:00
80babf24f2 refactor: implement Consume method in GenericLoader; enhance error handling in ProcessBatch
f12937a1c3 refactor: standardize job error channel size; update batch size for transformed batches
Compare 2 commits »
kylesoda pushed to refactor/etl-interfaces at kylesoda/go-migrate 2026-05-06 04:16:28 +00:00
2a5f703f3c refactor: enhance retry handling in extractor processes; unify backoff delay computation
7cb959a103 refactor: update migration job configuration parameters; rename queue and batch size fields for clarity
6414943cf3 refactor: streamline error handling and processing in GenericExtractor; implement partition processing with retries
00459e42e6 refactor: update column field names in ExtractionQuery struct; enhance logging in consume and process methods
52fe083ab7 refactor: add consume and process methods for GenericExtractor; streamline data extraction logic
Compare 10 commits »
kylesoda created branch refactor/etl-interfaces in kylesoda/go-migrate 2026-05-06 04:16:28 +00:00
kylesoda pushed to main at kylesoda/go-migrate 2026-04-26 05:38:13 +00:00
6ad25e5889 feat: update job configuration for infraestructura_site_holder__attach; enhance storage handling and retry logic
0ac5f01b65 feat: update configuration handling to use cleanenv; remove unused dependencies and improve error logging
Compare 2 commits »
kylesoda pushed to main at kylesoda/go-migrate 2026-04-21 19:28:38 +00:00
3b1371a270 feat: integrate Azure storage handling in migration process; update transformers and job processing logic
bb7b35619a feat: add ToStorage configuration to JobConfig for enhanced data handling
cd2efb8692 feat: add new job configuration for red_terminal__attach with source and target definitions
9964ef819b feat: refactor migration job to use preSQL and postSQL from TargetTable; update config structure for job definitions
bd51223855 feat: add truncate query handling in migration process; update job configuration to remove commented truncate SQL
Compare 15 commits »
kylesoda pushed to feat/mssql-to-mssql at kylesoda/go-migrate 2026-04-17 21:29:45 +00:00
63cf26e1ab feat: update target database type to sqlserver and clean up unused code in mssql.go
kylesoda created branch feat/mssql-to-mssql in kylesoda/go-migrate 2026-04-17 21:29:45 +00:00