Koteeswari Gunasekar
Senior Software Engineer
Chennai
Summary
Resourceful Data Engineer with 5+ years of experience in designing scalable data pipelines, optimizing performance, and solving complex technical challenges and a total of 10 years in the IT industry. Skilled in SQL, PySpark, and cloud platforms (AWS, Azure) and ETL process. Passionate about cultural exploration, creative problem-solving, and delivering impactful data solutions. Skilled in managing cross-functional teams and delivering projects on time.
Overview
10
10
years of professional experience
3
3
Languages
Work History
Project 1 - Data Engineer
Accenture Solutions Pvt.Ltd
09.2022 - 09.2024
- Collaborated with clients to gather ETL requirements, understand data sources, and design pipelines tailored to their business needs.
- Experienced in following Scrum-based Agile development.
- Comprehensive knowledge of ETL from sources like Oracle, Hadoop HDFS, flat files, JSON, Avro, Parquet, and ORC.
- Extensive experience onboarding various data sources via real-time, batch, or scheduled loads (cloud, on-prem, SQL, API-based).
- Expertise in extracting data via JSON, REST API, Web Services, and XML.
- Operational experience with Big Data technologies and engines, including Spark, Hive, and Hadoop..
- Utilized Apache Airflow to orchestrate complex workflows, managing task dependencies, and ensuring seamless execution of data pipelines.
- Scheduled and managed Airflow DAGs with CRON jobs, automating routine ETL processes to deliver timely, consistent data updates across multiple environments.
- Strong knowledge in creating flow as per user requirements for data to be transformed and delivered via AWS Cloud using Lambda Trigger, SNS services.
- Implemented data cleansing operations for over 500,000 datasets, resulting in improved data accuracy.
- Created 40+ comprehensive reports analyzing business operations and trends.
- Take complete ownership in developing end-to-end requirements in ingestion, storage, querying, processing, and analysis of big data.
- Stay up to date with emerging cloud and data engineering technologies, and demonstrate a continuous learning mindset
Project 2 - Data Engineer
Accenture Soln. Pvt. Ltd.
10.2018 - 12.2021
- Designed and optimized scalable ETL pipelines using Python scripts to handle large-scale data ingestion, transformation, and loading processes efficiently.
- Configured and scheduled workflows to run in predefined intervals for processing large-scale batch data pipelines, ensuring consistent and timely data availability.
- Monitored pipeline performance metrics and optimized workflows to minimize execution time, improve resource utilization, and reduce operational costs.
- Experience in Cloudera Hadoop Distribution.
- Effective Handel AWS Glue Services for repeated task to be delivered.
- Maintained and updated test documentation, including test plans, test cases, and test scripts.
- Validated data in various formats (CSV, XML, JSON) to ensure proper handling across ETL processes.
- Involved in working on the Data Analysis Team for the DATA Set to be structured and stored in HIVE.
- Designed, developed, and deployed a data-driven application supporting 2000+ users.
- Hybrid Cloud Observability
Project 1 - Process Associate
HP Inc
08.2014 - 07.2018
- Possessed knowledge of analysis in Product Data Management and Database Management in AWS RDS and Azure MI.
- Good in handling DMS Tool, DMA (Data Migration Assistant) tool during pre-migration and migration phase.
- Experience in performing hassle free database migration from on-premise to cloud service like AWS RDS, Azure MI.
- Performance tuning of huge data with use of PLSQL collections and records.
- Effectively made use of Table Functions, Indexes, Table Partitioning, Collections, Analytical functions, Materialized Views.
- Used Materialized views for data replication in distributed environments.
- Created database objects like tables, views, sequences, synonyms, indexes using Oracle tools like SQL
- Plus and PLSQL developer.
- Knowledge on tuning of SQL Queries, Explain plan, DBMS_Profiler.
Education
B. E - Electronics and Communication Engineering
Sri Muthukumaran Institute of Technology
Chennai03-2014
Class XII -
Don Bosco Matriculation Higher Secondary School
Chennai03-2010
Class X
Don Bosco Matriculation School
Chennai03-2008
Skills
SQL
Timeline
Project 1 - Data Engineer
Accenture Solutions Pvt.Ltd
09.2022 - 09.2024
Project 2 - Data Engineer
Accenture Soln. Pvt. Ltd.
10.2018 - 12.2021
Project 1 - Process Associate
HP Inc
08.2014 - 07.2018
B. E - Electronics and Communication Engineering
Sri Muthukumaran Institute of Technology
Class XII -
Don Bosco Matriculation Higher Secondary School
Class X
Don Bosco Matriculation School
Similar Profiles
Sneha S. YangadiSneha S. Yangadi
Test Automation Eng. Senior Analyst at Accenture Solutions Pvt.LtdTest Automation Eng. Senior Analyst at Accenture Solutions Pvt.Ltd
Mehul SinghMehul Singh
Quality Auditing Analyst at Accenture Solutions Pvt.LtdQuality Auditing Analyst at Accenture Solutions Pvt.Ltd
Rithick BRithick B
Application Development Senior Analyst at Accenture Solutions Pvt.LtdApplication Development Senior Analyst at Accenture Solutions Pvt.Ltd
ATCHAYA SATCHAYA S
Intern at L&T (Department of Indirect Taxation)Intern at L&T (Department of Indirect Taxation)
Sankara SubbuSankara Subbu
Associate Technical Analyst at Cratio Software Pvt LtdAssociate Technical Analyst at Cratio Software Pvt Ltd