Aaron Elvis Douyere
Lead Data Engineer
Bengaluru,Karnataka
Summary
Results-driven Data Engineer with over 5 years of experience in designing and implementing comprehensive data integration solutions. Proficient in building and optimizing data pipelines to ensure efficient data flow and accessibility, with expertise in orchestrating complex workflows and utilizing advanced data modeling techniques. Experienced in containerization and orchestration, focused on deploying scalable applications and services, as well as developing high-performance APIs for seamless data access. Committed to creating impactful dashboards that drive data-driven decision-making and support business objectives, while effectively leading teams and communicating complex technical concepts to diverse stakeholders.
Overview
5
5
years of professional experience
1
1
Professional Certification
Work History
Lead Engineer - Data & Integrations
DISH Network Technologies
Bengaluru
08.2022 - Current
- Led the implementation efforts for the Data Lake Project, integrating data from various third-party systems into Snowflake and enhancing data accessibility, while promoting robust reporting capabilities.
- Developed and maintained data integration pipelines using AWS services (Lambda, Step Functions, S3, EC2, API Gateway) and Snowflake, optimizing data storage and access through effective data modeling strategies, including the use of SQL and approaches such as the Star Schema.
- Implemented Oracle Integration Cloud (OIC) for seamless integrations with Oracle HCM and legacy systems, enhancing data interoperability and achieving real-time data synchronization between Oracle HCM and enterprise systems, boosting data accuracy by 40%, and reducing processing times.
- Implemented Apache Airflow for orchestrating complex workflows, automating data pipeline management, and ensuring reliable scheduling and monitoring of data processes.
- Built and managed integrations with Oracle Integration Cloud to facilitate connectivity between cloud and on-premises systems, streamlining business process automation.
- Employed Docker to create consistent development and production environments, enabling easy deployment of applications across different stages of the data pipeline; researched Kubernetes for container orchestration and management.
- Developed high-performance APIs using FastAPI to optimize data access and processing, significantly improving overall system efficiency.
- Spearheaded Python automation initiatives, cutting repetitive tasks by 60% and streamlining workflows across departments.
- Utilized Git for version control to ensure efficient collaboration and streamlined management of code changes within the development team.
- Created insightful dashboards in Tableau, translating complex data sets into actionable insights for stakeholders and driving informed decision-making.
- Collaborated with other departments on the development of new products and processes, conducted research into emerging technologies to identify potential applications in current projects, and implemented quality assurance procedures to ensure compliance with industry standards.
- Provided technical guidance, training, and mentorship to junior engineers, fostering a collaborative and knowledgeable team environment.
- Experienced in Agile and Scrum methodologies, facilitating efficient project management and delivery.
- Demonstrated ability to communicate complex technical concepts to non-technical stakeholders, ensuring alignment on project goals.
- Strong collaborative skills, working effectively with cross-functional teams, including data scientists, analysts, and business units.
Senior Website Developer
Ameex Technologies (Acquired by Perficient)
Chennai
05.2019 - 07.2022
- Developed highly scalable websites using PHP frameworks, primarily Laravel, ensuring robust performance and maintainability.
- Built headless, decoupled applications utilizing Headless Drupal with AngularJS, enhancing flexibility and user experience.
- Designed and implemented strong UI/UX interfaces using HTML, CSS, and SCSS, ensuring responsive and visually appealing web applications.
- Managed web hosting and domain management, ensuring optimal site performance and uptime.
- Conducted website maintenance and SEO optimization, improving search visibility and user engagement.
- Utilized MySQL as the backend database, optimizing queries for performance and ensuring data integrity.
- Employed Jenkins for CI/CD processes, facilitating build, test, and deployment workflows to streamline development operations.
- Leveraged tools, such as Screaming Frog, for SEO analysis and website auditing, driving continuous improvement in site performance.
Education
Masters of Computer Applications (MCA) - Computer Engineering
MADRAS CHRISTIAN COLLEGE
Chennai, India04-2019
Bachelors of Computer Applications (BCA) - Computer Engineering
PATRICIAN COLLEGE OF ARTS & SCIENCE
Chennai, India04-2016
Skills
- Programming: Python, SQL
- Cloud: AWS, GCP (beginner)
- Data Warehousing: Snowflake, Redshift
- Workflow Orchestration Tools: Apache Airflow
- Integration Tools: Oracle Integration Cloud (OIC)
- Databases: MySQL, PostgreSQL, Oracle, DynamoDB, and Cassandra
- Containerization: Docker, Kubernetes
- API Development: FastAPI, REST, and SOAP
- Version Control: Git
- Data Visualization: Tableau
- Data Modeling: Lucidchart
- CI/CD: GitLab, Jenkins
Certification
- Advanced Certification in Software Engineering for Cloud, Blockchain & IoT
IIT Madras & Great Learning, April 2021 - Oracle Cloud Infrastructure 2023 Certified Application Integration Professional
Valid from August 2023 to December 2025 - OCI Generative AI Certification
Valid from June 2024 to June 2025 - Certificate in C, C++, and Data Structures
NIIT, January 2013 - Certificate in Java & Advanced Java (Servlet, JSP)
NIIT, January 2013
Personal Information
- Date of Birth: 09/25/95
- Age: 29
- Nationality: Indian
- Marital Status: Married
Projects
HR Data Lake Project
Role: Lead Data Engineer
Overview: Spearheaded the implementation of an HR Data Lake, integrating data from various third-party systems to enhance data accessibility and reporting capabilities.
Technologies Used:
- Snowflake: Designed and optimized data storage solutions for efficient querying and analysis.
- Apache Airflow: Orchestrated complex workflows to automate data ingestion and transformation processes.
- Docker: Created containerized environments to ensure consistent application deployment across development and production stages.
- Kubernetes: Researched and implemented orchestration for managing containerized applications at scale.
Challenges Faced:
- Data Integration: Faced difficulties in integrating diverse data sources due to differing formats and structures.
Solution: Developed custom transformation scripts using Python to standardize data before loading it into Snowflake. - Workflow Automation: Initial pipeline setups were prone to failures and required manual intervention.
Solution: Implemented robust error handling and alerting mechanisms in Apache Airflow to improve reliability and reduce downtime. - Performance Optimization: Data retrieval and processing times were longer than anticipated.
Solution: Optimized SQL queries and leveraged Snowflake's caching capabilities to enhance performance.
Technologies Learned: Throughout this project, I deepened my expertise in Snowflake, Apache Airflow, Docker, and Kubernetes, gaining hands-on experience in building scalable data solutions and managing containerized applications.
Languages
English
First Language
Tamil
Upper Intermediate (B2)
B2
French
Beginner (A1)
A1
Accomplishments
- Curiosity Award
Q3 2023, DISH Network Technologies
Recognized with the prestigious Curiosity Award for demonstrating exceptional inquisitiveness. - SPOT Award
Q1 2023, DISH Network Technologies
Received the SPOT Award for exceptional performance and outstanding teamwork.
Work Preference
Work Location
RemoteInterests
Music: Playing guitar and singing
Sports: Playing cricket
Timeline
Lead Engineer - Data & Integrations
DISH Network Technologies
08.2022 - Current
Senior Website Developer
Ameex Technologies (Acquired by Perficient)
05.2019 - 07.2022
Masters of Computer Applications (MCA) - Computer Engineering
MADRAS CHRISTIAN COLLEGE
Bachelors of Computer Applications (BCA) - Computer Engineering
PATRICIAN COLLEGE OF ARTS & SCIENCE
Similar Profiles
Rahul UnnithanRahul Unnithan
Senior Software Engineer at Dish Network Technologies (previously SlingMedia)Senior Software Engineer at Dish Network Technologies (previously SlingMedia)
PRAVEEN KUMARPRAVEEN KUMAR
Senior Engineer at Dish Network Technologies India Pvt LtdSenior Engineer at Dish Network Technologies India Pvt Ltd
Arindam BanerjeeArindam Banerjee
Lead Software Engineer at Dish Network Technologies India Pvt. LtdLead Software Engineer at Dish Network Technologies India Pvt. Ltd