NIKHIL RAO
Bangalore
Summary
" Data Engineer with a passion for transforming raw data into actionable insights. Proficient in designing and optimizing ETL processes, data pipelines, and scalable architectures. Skilled in database management and implementing cutting-edge technologies to enhance data quality and efficiency. Proven ability to collaborate with cross-functional teams and drive impactful business solutions. Committed to staying ahead of industry trends and delivering robust data infrastructure."
Overview
2
2
years of professional experience
Work History
Specialist Programmer-Data Engineer
Infosys
Bangalore
08.2021 - Current
- Part of a data engineering team, leading the ETL (Extract, Transform, and Load) process and constructing data pipelines for ingesting substantial volumes of data (equivalent to 2 million dollars) for job runs
- Leveraged cutting-edge technologies, such as Apache Spark, Databricks, SQL, and Python, with a dedicated focus on ensuring data accuracy, integrity, and availability
- Optimized the ETL process by employing efficient resources and code, resulting in a remarkable 22% reduction in overall monthly costs
- Managed the synchronization of code between on-premises and cloud environments, creating a unified codebase capable of running seamlessly on both platforms
- Spearheaded the automation of ETL processes, significantly reducing manual efforts and enhancing operational efficiency
- Excelled both independently and within a team, consistently achieving successful outcomes and surpassing expectations through proactive problem-solving and effective communication.
Education
Bachelor of Engineering -
KLE Technological University
08.2021
Skills
- Apache Spark
- Azure cloud
- Azure Databricks
- Github
- Python SQL
- Pyspark
- Azure data factory
- Jira
- Apache Airflow
- Software Development
- Data Analysis
- Report Generation
- Performance Tuning
Projects
Fraud Detection, Mainly committed to executing extraction, transformation, and loading (ETL) processes, emphasizing the adaptation of data transformations to align with business specifications. The core aim is to categorize extracted data as fraudulent or non-fraudulent. Additionally, involved in the extraction of XML data, referred to as scale data, to assess the presence of fraudulent transactions.
Technical Skills
- Proficient in PySpark, Python, and Azure Databricks, driving impactful contributions to big data analytics.
- Demonstrated experience with GitHub, SQL, ADLS, ADF, Hive DB, and XML data extraction.
- Skilled in setting up key vaults, notebooks,databricks workflows and clusters to streamline and enhance data management efficiency.
- Actively monitor and enhance fraud detection performance, adhering to agile methodologies.
- Strong debugging skills and foundational knowledge in CI/CD processes.
Work Availability
monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse
Quote
The human brain is an incredible pattern-matching machine.
Jeff Bezos
Timeline
Specialist Programmer-Data Engineer
Infosys
08.2021 - Current
Bachelor of Engineering -
KLE Technological University
Similar Profiles
Tristan ZaleskiTristan Zaleski
Application Developer V at InfosysApplication Developer V at Infosys
Balaji Krishnan SBalaji Krishnan S
Program Manager / Project Manager at InfosysProgram Manager / Project Manager at Infosys
Ayush Pratap SinghAyush Pratap Singh
System Associate at infosysSystem Associate at infosys
Hariharan THariharan T
Senior Associate Consultant at InfosysSenior Associate Consultant at Infosys
Muskan JainMuskan Jain
Associate – Bid Management at Subex Ltd.Associate – Bid Management at Subex Ltd.