Commit Graph

  • 1be7018ba3 feat: refactor configuration to include source and target database types Kylesoda 2026-04-10 22:58:57 -05:00
  • a5b5a04feb feat: update extractor and transformer constructors to return Extractor interface Kylesoda 2026-04-10 20:42:16 -05:00
  • c1bae79f98 feat: implement Postgres loader and refactor migration job processing Kylesoda 2026-04-10 20:40:01 -05:00
  • 053e6bd673 feat: add MSSQL extractor and transformer implementations for improved data migration Kylesoda 2026-04-10 19:59:44 -05:00
  • eb3c3bbfce feat: refactor error handling to use custom_errors.LoaderError for improved error management Kylesoda 2026-04-10 19:35:38 -05:00
  • 9493a2d32f feat: refactor error handling to accept max retry attempts as a parameter for improved flexibility Kylesoda 2026-04-10 19:32:12 -05:00
  • d228a048b8 feat: update extractor error handling to use models.UnknownRowValues for improved type consistency Kylesoda 2026-04-10 19:29:07 -05:00
  • ca621352c9 feat: refactor models to improve type handling and enhance error management across migration processes Kylesoda 2026-04-10 19:27:27 -05:00
  • c2ea84bfcf feat: implement extractor error handling and batch processing for MSSQL and Postgres Kylesoda 2026-04-10 19:06:41 -05:00
  • 6345a0d694 feat: enhance migration job processing with detailed metrics and error handling Kylesoda 2026-04-09 21:55:19 -05:00
  • 1db35c796c feat: enhance migration job processing with parallel execution and improved logging Kylesoda 2026-04-09 20:02:04 -05:00
  • 0d9f955b2f feat: enhance batch processing by adding rowsPerBatch parameter and improving logging messages Kylesoda 2026-04-09 19:46:45 -05:00
  • 524d892a60 feat: refactor migration job structure to use SourceTableInfo and TargetTableInfo for improved configuration handling Kylesoda 2026-04-09 19:20:50 -05:00
  • e8ace6ecf9 feat: implement job configuration structure and YAML parsing for migration jobs Kylesoda 2026-04-09 18:12:11 -05:00
  • adbc962464 feat: add configuration parsing and job management in YAML format Kylesoda 2026-04-09 17:47:58 -05:00
  • a0b51f40c1 feat: add context support to migration job processing for improved cancellation and error handling Kylesoda 2026-04-09 00:43:11 -05:00
  • b64a76ca45 feat: improve error handling and job cancellation in migration process Kylesoda 2026-04-09 00:38:16 -05:00
  • 51480015ba feat: enhance concurrency management by adding WaitGroup support in extractors and loaders Kylesoda 2026-04-09 00:22:30 -05:00
  • dc632361e5 feat: implement loader error handling and refactor chunk processing in migration job Kylesoda 2026-04-08 23:42:31 -05:00
  • 0ee5d9032c feat: add context support to error handlers for improved cancellation and error management Kylesoda 2026-04-08 23:07:41 -05:00
  • d3a3b26bb3 feat: enhance error handling and context management in MSSQL extraction process Kylesoda 2026-04-08 22:39:07 -05:00
  • 554618daad feat: refactor transformation logic in MSSQL processing to use context and improve error handling Kylesoda 2026-04-08 21:47:24 -05:00
  • 7924dd3af7 feat: refactor chunk handling in loader and transformer for improved data processing Kylesoda 2026-04-08 21:11:26 -05:00
  • f6dfcd390f feat: refactor chunk handling in extractor and transformer for improved data processing Kylesoda 2026-04-08 21:09:26 -05:00
  • 853be4a5a6 feat: update chunk size for MSSQL processing and enhance error handling in transformation functions Kylesoda 2026-04-08 20:48:36 -05:00
  • eeef3bc813 fix: correct variable name for job error in MSSQL extraction Kylesoda 2026-04-08 20:39:16 -05:00
  • e158986947 feat: enhance error handling with JobError struct and update extractor logic Kylesoda 2026-04-08 20:21:58 -05:00
  • bc6f9a6a70 feat: implement batch processing for MSSQL with improved structure and logging Kylesoda 2026-04-08 17:35:12 -05:00
  • 51d83661a4 fix: update globalID generation for consistency in UUID handling Kylesoda 2026-04-08 14:12:33 -05:00
  • 75b04d4b2e feat: add MANZANA migration job and update related processing logic Kylesoda 2026-04-08 10:16:27 -05:00
  • 3765e8adb3 feat: implement PUERTO data generation and loading with improved structure and logging Kylesoda 2026-04-08 10:08:17 -05:00
  • 4434054b21 feat: implement data generation and loading for MANZANA with improved structure and logging Kylesoda 2026-04-08 09:57:11 -05:00
  • 1e2a37e59f fix: adjust migration parameters for improved performance and consistency Kylesoda 2026-04-07 23:52:49 -05:00
  • 8afdb45318 feat: implement batch processing for MSSQL extraction and transformation with range handling Kylesoda 2026-04-07 23:39:55 -05:00
  • 8903a04f4d fix: standardize variable naming and adjust loader sleep duration for consistency Kylesoda 2026-04-07 20:22:00 -05:00
  • c318428563 feat: update chunk size for MSSQL data loading and add utility functions for database operations Kylesoda 2026-04-07 17:57:08 -05:00
  • 8738ef92b7 feat: implement MSSQL bulk loading functionality with transaction handling Kylesoda 2026-04-07 16:21:10 -05:00
  • 270a66dbbf feat: enhance logging and performance metrics for migration processes Kylesoda 2026-04-07 15:53:17 -05:00
  • 7bb67ddfcf feat: refactor data extraction and loading functions for improved context handling Kylesoda 2026-04-07 12:55:05 -05:00
  • 6da321c4bb feat: implement MSSQL row transformation and loading functions Kylesoda 2026-04-07 11:47:27 -05:00
  • 2f8263d332 feat: add ensureUTC function and apply it to datetime transformations in MSSQL processing Kylesoda 2026-04-07 11:37:04 -05:00
  • aea310a3dd feat: add WKB to EWKB conversion with SRID handling and integrate into MSSQL transformation Kylesoda 2026-04-07 10:05:45 -05:00
  • f305ddec0b feat: add MSSQL UUID transformation and update migration process for channel handling Kylesoda 2026-04-06 21:53:09 -05:00
  • 8de4838e00 feat: streamline data extraction from MSSQL and Postgres, add UUID transformation Kylesoda 2026-04-06 21:37:17 -05:00
  • d4786ed920 feat: implement PostgreSQL data extraction and transformation process Kylesoda 2026-04-06 21:04:17 -05:00
  • f589664320 feat: implement MSSQL data extraction and transformation process Kylesoda 2026-04-06 20:36:11 -05:00
  • 382c2099f7 feat: add ORDER BY clause to SQL extract queries for consistent result ordering Kylesoda 2026-04-06 19:13:14 -05:00
  • dfc76eecd0 feat: implement ETL process with extractors and loaders Kylesoda 2026-04-06 13:50:36 -05:00
  • c0e9bcf88c feat: add extract query builders Kylesoda 2026-04-06 11:39:27 -05:00
  • c49ff65b1d feat: remove unused column type logging and streamline migration job processing Kylesoda 2026-04-06 10:48:56 -05:00
  • 828fc57121 feat: refactor column type handling and streamline database column queries Kylesoda 2026-04-04 13:30:07 -05:00
  • de0d4a5516 feat: enhance column type querying functions for improved error handling and SQL compatibility Kylesoda 2026-04-04 10:17:20 -05:00
  • 46c08323ad feat: add ColumnType struct and associated methods for database column metadata Kylesoda 2026-04-04 09:30:07 -05:00
  • b05e566fca feat: refactor database connection logic and add column type querying functions Kylesoda 2026-04-04 00:23:28 -05:00
  • 5ebaac482d feat: implement database connection functions for SQL Server and Postgres Kylesoda 2026-04-03 23:33:19 -05:00
  • 45407b070f feat: implement database connection logic for SQL Server and Postgres Kylesoda 2026-04-03 23:27:16 -05:00
  • fa7ea94979 feat: add logging configuration and implement migration logic Kylesoda 2026-04-03 23:05:19 -05:00
  • b04f1315af feat: enhance mssql configuration and update extraction script Kylesoda 2026-04-03 22:55:30 -05:00
  • 7eaa3478e1 fix: update schema and table names for mssql metadata extraction Kylesoda 2026-04-03 00:08:26 -05:00
  • 50169bee9e feat: add mssql info extraction script Kylesoda 2026-04-02 18:23:55 -05:00
  • c696314f86 feat: add mssql data extraction script Kylesoda 2026-04-02 15:09:37 -05:00
  • ad89519ece refactor: database url config Kylesoda 2026-04-02 14:28:03 -05:00
  • 36af9378ad feat: add casting for special postgres types Kylesoda 2026-04-01 14:18:21 -05:00
  • deedf7f95d feat: add dinamic query building Kylesoda 2026-04-01 12:14:16 -05:00
  • 8775103a9d feat: add extractData method for retrieving data from postgresql Kylesoda 2026-04-01 10:03:14 -05:00
  • e5a5a5e415 feat: add postgres connection Kylesoda 2026-03-31 18:59:04 -05:00
  • ef69ecd47d feat: add config module Kylesoda 2026-03-31 10:14:14 -05:00
  • c2aa7409cf Init project Kylesoda 2026-03-31 00:29:19 -05:00