Vijay Mathivanan

As a Data Engineering Manager at TCS, I am responsible for leading a team of data engineers and overseeing the end-to-end data engineering process. My key responsibilities include:

• Collaborating with cross-functional teams to understand business requirements and translate them into technical solutions.
• Designing and implementing data pipelines to extract, transform, and load data from various sources.
• Ensuring data quality and integrity through data cleansing, validation, and normalization.
• Implementing data governance and security measures to protect sensitive data.
• Managing and optimizing data storage and retrieval systems for efficient and high-performance data access.
• Leading and mentoring a team of data engineers, providing guidance and support in their professional development.
• Staying updated with the latest trends and technologies in data engineering and implementing best practices to drive innovation and continuous improvement.
• Managed, coached, and developed a teams of experienced engineers.
• Contributing to the development and implementation of data strategies and roadmaps to support business objectives.
• Collaborating with stakeholders to understand their data needs and provide actionable insights through data analysis and visualization.

As a Senior Data Engineer at Bank of America, Chennai, I played a crucial role in developing and implementing data processing systems and pipelines for various projects. My responsibilities included:

• Designing and implementing data processing systems and pipelines using technologies such as Apache Spark, Hadoop, and SQL.
• Working with large datasets and implementing optimization techniques such as partitioning and bucketing in Hive and Spark SQL.
• Orchestrating the integration of Spark with diverse data lakes, including HDFS and Azure Datalakes Gen2.
• Processing large-scale structured and semi-structured datasets using Spark SQL for querying, filtering, mapping, reducing, grouping, and aggregating data.
• Creating Hive scripts to automate incremental data processing based on timestamps.
• Working in an agile environment and communicating with cross-functional teams and multiple stakeholders.

One of my notable accomplishments includes successfully migrating a Mainframe and Oracle applications to on-prem big data in Bank of America, Chennai.

As a Team Lead at NTT DATA Inc, I led a team of data engineers and actively participated in developing and implementing data solutions. My key responsibilities included:

• Collaborating with cross-functional teams to gather and analyze business requirements for data engineering projects.
• Designing and developing ETL pipelines to automate data ingestion, processing, and insights creation.
• Implementing best practices for data warehousing, data integration, and data modeling.
• Performing root cause analysis of issues related to Data applications and ensuring efficient project execution and delivery.
• Providing technical guidance to junior team members to improve their understanding of data engineering technologies.
• Working closely with the engineering and business team using scrum/agile methodology.

As a Associate at The RBS India Inc, I was part of team of ETL engineers that actively participated in developing and maintaining the applications on various data platforms. My key responsibilities included:

• Participated in designing and developing ETL workflows for data integration and transformation.
• Assisted in monitoring and troubleshooting data pipelines to ensure smooth operations.
• Collaborated with the team to implement data quality checks and resolve issues.
• Documented processes and provided support for maintaining and improving data applications.