SteepGraph’s Role
- End to End Responsibility till Go-Live and Support
- ETL Migration Tool
Industry
- High- tech
Data Complexity Challenges:
- Identify the correction version from EBOM Structure Versions
- Part Data missing in the Part table but present in BOM structure Table
- Duplicate data with unique values has space
- Migration for Material Declaration Files in different formats for IPC-1752
Migration Approach
- ETL Approach
- Selective Trigger off
- No History Migration
- SOV Stamping on during migration
- Dedicated Linux Server for data Load with only Server installation (for MQL access)
- During data load, 120 Threads were running pointing to the same database using MQL
- The Server CPU was 60-70%
- Dedicated Database Server
- During data load, the server CPU reached 85-90% – normally it is 2-3%
- Total time to migration 14.76 million: 5-6hrs
Data Validation Approach
- Extract complete data loaded in 3DX
- Apply transformation rules on Source data
- Compare 3DX data with Source data
- Data Cleanup Use cases (executed during migration):
- Duplicate Data
- Special Character Handling
- Tools/Framework used during Data Migration:
- ETL Tool for Extraction, Transformation and Loading
- DS Tools used:
- DS OOTB APIs for Material Declaration File Processing
- Specific Licenses required during Project/Development:
- DS Licenses:
- MCM/MCY/PDE/PDM
- DS Licenses:
GO- LIVE Approach
- Incremental
- 1month before Go Live – Build Deployed on Production – No User on-boarding/No Announcement of Build Availability on Production
- On Go Live – Delta Migration of 1months Data
Benefits to Customer
- Improvements: Enhanced UI with more validations in 3DExperience
- Data Accuracy: Effective duplicate data and special character handling