|
|
6ad25e5889
|
feat: update job configuration for infraestructura_site_holder__attach; enhance storage handling and retry logic
|
2026-04-22 15:23:19 -05:00 |
|
|
|
0ac5f01b65
|
feat: update configuration handling to use cleanenv; remove unused dependencies and improve error logging
|
2026-04-22 12:31:31 -05:00 |
|
|
|
3b1371a270
|
feat: integrate Azure storage handling in migration process; update transformers and job processing logic
|
2026-04-21 14:15:20 -05:00 |
|
|
|
bb7b35619a
|
feat: add ToStorage configuration to JobConfig for enhanced data handling
|
2026-04-21 13:43:03 -05:00 |
|
|
|
cd2efb8692
|
feat: add new job configuration for red_terminal__attach with source and target definitions
|
2026-04-21 13:38:11 -05:00 |
|
|
|
9964ef819b
|
feat: refactor migration job to use preSQL and postSQL from TargetTable; update config structure for job definitions
|
2026-04-21 12:30:40 -05:00 |
|
|
|
bd51223855
|
feat: add truncate query handling in migration process; update job configuration to remove commented truncate SQL
|
2026-04-21 11:40:02 -05:00 |
|
|
|
aa71eeb5c1
|
feat: enhance range handling in MSSQL and Postgres extractors; update partition range generator logic
|
2026-04-21 11:32:52 -05:00 |
|
|
|
9eb8800864
|
feat: add range configuration to job and update extractors for inclusive range handling
|
2026-04-21 11:29:34 -05:00 |
|
|
|
09bd364976
|
feat: implement Azure Blob Storage client and refactor configuration structure
|
2026-04-21 11:03:56 -05:00 |
|
|
|
f2e6edd8fa
|
feat: add caarlos0/env package for environment variable management and refactor appConfig structure
|
2026-04-21 10:41:38 -05:00 |
|
|
|
c5a18f6d95
|
chore: update .env.example to set LOG_LEVEL to INFO and add Azure storage configuration variables
|
2026-04-21 10:15:01 -05:00 |
|
|
|
8217b13d08
|
feat: add azblob client implementation for file uploads
|
2026-04-21 10:01:42 -05:00 |
|
|
|
16c232762e
|
feat: refactor extractor interface and implement Consume function for ETL process
|
2026-04-20 00:19:41 -05:00 |
|
|
|
b4a846575d
|
Update .env.example with new variables
|
2026-04-19 23:08:09 -05:00 |
|
|
|
5bd730f026
|
feat: update .gitignore to include .vscode directory
|
2026-04-19 23:06:18 -05:00 |
|
|
|
7bd80d4180
|
feat: enhance logging configuration to use dynamic log level from environment variable
|
2026-04-19 23:06:13 -05:00 |
|
|
|
846a49d40c
|
feat: implement GenericLoader for batch processing and utility functions
|
2026-04-17 15:58:08 -05:00 |
|
|
|
93b302db8e
|
feat: refactor job result handling and remove unused files
|
2026-04-16 16:47:35 -05:00 |
|
|
|
39c0d99502
|
feat: extend context timeout to 1 minute for database queries in mssql.go and postgres.go
|
2026-04-16 13:19:46 -05:00 |
|
|
|
b418ded78b
|
feat: update SQL query to filter out specific column names in mssql.go
|
2026-04-16 13:14:39 -05:00 |
|
|
|
0d0511716f
|
feat: add row count mismatch error handling in processMigrationJob and update SQL query to exclude additional graph-related columns
|
2026-04-16 12:46:55 -05:00 |
|
|
|
67fb0148ae
|
feat: add Makefile for building binaries across platforms
|
2026-04-16 11:51:05 -05:00 |
|
|
|
098cf36e3c
|
feat: comment out TRUNCATE statements in pre_sql for MANZANA and PUERTO jobs
|
2026-04-16 11:46:24 -05:00 |
|
|
|
5484716b81
|
feat: add source and target database type fields to MigrationConfig
|
2026-04-16 09:08:21 -05:00 |
|
|
|
df4c3bc390
|
feat: refactor db handling to use db-wrapper package; enhance connection management and result handling for MSSQL and Postgres
|
2026-04-16 08:48:29 -05:00 |
|
|
|
ea41a7c218
|
feat: register MSSQL and Postgres drivers in db-wrapper for improved factory pattern support
|
2026-04-15 23:09:56 -05:00 |
|
|
|
f09284ecdc
|
feat: enhance db-wrapper with improved MSSQL and Postgres implementations; add row result handling and dialect support
|
2026-04-15 22:55:14 -05:00 |
|
|
|
0384d5423f
|
feat: add range configuration to job settings for enhanced data processing control
|
2026-04-15 20:23:45 -05:00 |
|
|
|
1ce3d9e153
|
refactor: update partition handling to use Range struct for better clarity and consistency
|
2026-04-15 20:23:45 -05:00 |
|
DiegoAlessandroMotta
|
ed889b740a
|
add db-wrapper package types
|
2026-04-15 20:22:23 -05:00 |
|
|
|
803f8988b8
|
refactor: update extractor interfaces to return row counts instead of using pointers for rows read
|
2026-04-13 19:25:18 -05:00 |
|
|
|
33c9cd9c3e
|
feat: implement database wrapper interfaces for MSSQL and Postgres; enhance migration job processing with pre and post SQL execution
|
2026-04-13 07:57:18 -05:00 |
|
|
|
85074da2ec
|
feat: add max partition and chunk error limits to extractor and loader error handlers
|
2026-04-12 20:57:31 -05:00 |
|
|
|
f126d5bbd0
|
feat: implement exponential backoff strategy for error handling in extractor and loader processes; enhance retry configuration options
|
2026-04-12 20:35:29 -05:00 |
|
|
|
5633dc98d0
|
fix: enhance error handling in extractor and loader processes; ensure proper job error propagation and logging
|
2026-04-12 20:11:19 -05:00 |
|
|
|
01780b4b02
|
refactor: remove unused ColumnType and inspect-columns files; update migration job to use separate table analyzers for source and target databases
|
2026-04-12 19:16:14 -05:00 |
|
|
|
aded502ee4
|
feat: implement Postgres table analyzer with column type querying and metadata retrieval
|
2026-04-12 13:38:36 -05:00 |
|
|
|
4d3cd6e4cf
|
feat: add MSSQL table analyzer and integrate partition range generation for improved data migration
|
2026-04-11 01:23:13 -05:00 |
|
|
|
7830ae862d
|
refactor: rename batch-related variables and functions for consistency and clarity
|
2026-04-11 00:44:12 -05:00 |
|
|
|
955bc65ce9
|
refactor: rename Batch to Partition in error handling and processing functions for consistency
|
2026-04-11 00:32:50 -05:00 |
|
|
|
9eb9821daf
|
refactor: rename Batch to Partition and update related types and channels for consistency
|
2026-04-11 00:09:28 -05:00 |
|
|
|
cd0e53b1d2
|
feat: implement MSSQL extractor, transformer, and Postgres loader for enhanced data migration
|
2026-04-10 23:39:37 -05:00 |
|
|
|
1be7018ba3
|
feat: refactor configuration to include source and target database types
|
2026-04-10 22:58:57 -05:00 |
|
|
|
a5b5a04feb
|
feat: update extractor and transformer constructors to return Extractor interface
|
2026-04-10 20:42:16 -05:00 |
|
|
|
c1bae79f98
|
feat: implement Postgres loader and refactor migration job processing
|
2026-04-10 20:40:01 -05:00 |
|
|
|
053e6bd673
|
feat: add MSSQL extractor and transformer implementations for improved data migration
|
2026-04-10 19:59:44 -05:00 |
|
|
|
eb3c3bbfce
|
feat: refactor error handling to use custom_errors.LoaderError for improved error management
|
2026-04-10 19:35:38 -05:00 |
|
|
|
9493a2d32f
|
feat: refactor error handling to accept max retry attempts as a parameter for improved flexibility
|
2026-04-10 19:32:12 -05:00 |
|
|
|
d228a048b8
|
feat: update extractor error handling to use models.UnknownRowValues for improved type consistency
|
2026-04-10 19:29:07 -05:00 |
|
