HixEDGE Migration to ADF
Designed the target solution on Azure, encompassing environment architecture, selection of appropriate services, Azure Data Factory (ADF) pipeline design, and deployment of ETL packages. Develop the Azure cloud infrastructure to support the migration and execution of on-premises batch processes in the cloud environment. Migrate data from 20 SQL Server instances into a single consolidated Azure database instance. Migration of the 80+ SSIS packages and 18+.NET batch to Azure. Customize the ETL packages on migration to cloud. Integrate and schedule HIXedge processes for 20 individual clients-each with a dedicated pipeline-within a unified Azure Data Factory (ADF) framework. Provide SLA based support to application teams throughout the migration journey.
HixEDGE required consolidating 20 individual SQL Server estates and 80+ SSIS packages into a single Azure Data Factory framework with 20 client-specific pipelines. The migration had to preserve SLAs while reducing operational complexity across environments.
Objective
- Designed the target solution on Azure, encompassing environment architecture, selection of appropriate services, Azure Data Factory (ADF) pipeline design, and deployment of ETL packages.
- Develop the Azure cloud infrastructure to support the migration and execution of on-premises batch processes in the cloud environment.
- Migrate data from 20 SQL Server instances into a single consolidated Azure database instance.
- Migration of the 80+ SSIS packages and 18+.NET batch to Azure.
- Customize the ETL packages on migration to cloud.
- Integrate and schedule HIXedge processes for 20 individual clients-each with a dedicated pipeline-within a unified Azure Data Factory (ADF) framework.
- Provide SLA based support to application teams throughout the migration journey.
Solution
- Designed the Azure architecture which replicates the on-prem and supports the ETL batches.
- Developed IaC Terraform scripts for the establishing Azure infrastructure.
- Established and validated ECG connection for on-prem storage connectivity.
- Merged 20 SQL server instances into single instance in the Azure SQL Managed Instance.
- Created the ADF pipeline for the end-to-end process and validated. After which it can replicate for all other 20 clients.
- Committed the code and change in GitHub for the environment promotion.
- Created comprehensive documentation with code snippets to guide support teams.
Impact & Benefits
- Accelerated cloud migration and modernization by successfully moving SSIS packages, .NET batches, and on-prem workloads to a secure and scalable Azure platform.
- Improved operational efficiency and scalability through standardized ADF pipelines, Azure Batch processing, and consolidation of 20 on-prem SQL instances into Azure SQL MI.
- Enhanced security and reliability with a well-architected Azure foundation, secure file transfer (ECG connectivity), and robust IaC-driven deployments.
- Faster onboarding and support readiness enabled by multiple Azure POCs and comprehensive documentation with code snippets for smooth handover.
My Roles & Responsibilities
- Led end-to-end planning and execution of the HixEDGE migration to Azure, covering infrastructure setup, ADF implementation, SQL migration, and application modernization activities.
- Coordinated cross-functional teams including architects, developers, cloud engineers, database administrators, and client stakeholders to align scope, timelines, dependencies, and migration priorities.
- Established project governance, tracked milestones, managed risks and dependencies, and drove timely resolution of technical, environment, and deployment-related challenges.
- Oversaw migration readiness, validation, testing, and deployment planning to ensure smooth transition of 80+ SSIS packages, 18+ .NET batch processes, and 20 SQL Server instances to Azure.
- Drove stakeholder communication through regular status reporting, leadership reviews, and migration progress updates, ensuring transparency throughout the project lifecycle.
- Ensured successful delivery through schedule management, quality oversight, documentation governance, knowledge transfer coordination, and support readiness planning.