Dynamic Assistant System Engineer at Tata Consultancy Services with expertise in AWS cloud services and DevOps practices. Achieved significant cost reductions through optimized ETL processes using AWS Glue. Proficient in Reltio MDM, enhancing data governance and quality. Strong problem-solving skills complemented by a solid foundation in Python programming and SQL database management.
English, Hindi, Marathi
ETL Integration Workflow Development, Integration Development: Developed an integration to receive data from Salesforce in S3 format, generating event files based on create, update, and delete events., AWS Glue Job Implementation: Implemented an AWS Glue job that processes incoming data in batches, ensuring effective handling of accumulated event files., Layered Architecture: Created a filter layer, ingestion layer, and transformation layer within the Glue job, enabling the reuse of components across multiple integrations., Error Handling and Logging: Established comprehensive logging for failures in ServiceNow, incorporating an error processing mechanism to manage failed events and facilitate reprocessing., Data Storage: Stored the final processed data in Reltio MDM for consumption by downstream systems., Data Loading Job Development, Job Creation: Developed an AWS Glue job to efficiently process 100,000 records per hour, ensuring rapid data loading and transformation., Performance Optimization: Increased processing speed by approximately 50% and reduced resource usage by around 10% through targeted optimizations., Error Handling: Established robust error capture mechanisms to log failures, allowing for effective monitoring and reprocessing of problematic records., Data Transformation: Designed data transformation processes to ensure data quality and integrity before loading into target systems.