Summary
Overview
Work History
Education
Skills
Personal Information
Timeline
Generic
Nimish Jain

Nimish Jain

Python developer, data engineer and data analyst.

Summary

More than 2.5 years of experience, skilled in data engineering, data analysis, back-end development and problem-solving. Strong knowledge of Python frameworks, libraries and tools.

Overview

2
2
years of professional experience

Work History

Python Developer, Data Engineer and Data Analyst.

Airlinq India Pvt Ltd
12.2021 - Current
  • Developed a comprehensive report scheduling module that generates reports in various formats (CSV, Excel, PDF) based on data retrieved from a MySQL database and performs data filtering manipulation using pandas and numpy.
  • Utilized Apache Airflow to implement automated model training workflows, scheduling model training every hour for continuous refinement and optimization. Employed cross-validation methods to fine-tune model parameters, ensuring robustness and optimal performance in predictive and clustering models. Utilized Descriptive Statistics and regression analysis to build a predictive model, enhancing accuracy and insights. Employed KD tree to create a clustering model for zoning user locations based on desired location parameters.
  • Developed and implemented shell scripts to securely fetch compressed files from SFTP locations, incorporating fail-safe mechanisms to ensure reliable data retrieval. Designed and optimized batch file processing routines to enhance efficiency, significantly reducing processing time for subsequent analysis and filtering tasks.
  • Developed an ETL pipeline using Apache Airflow to efficiently perform data migration activities during scheduled maintenance windows, ensuring minimal downtime and data integrity.
  • Developed a custom notification script leveraging Kafka consumer to process data with PySpark, ingest results into MySQL, and trigger event-based email notifications.
  • Developed stored procedures to fetch data from multiple tables based on customer-specific inputs from Grafana, facilitating enhanced data visualization and insights.
  • Developed a Robust Data Management Framework with Python Libraries for integrated data cleaning, filtering, and ingestion functionalities, ensuring seamless extraction and ingestion from REST APIs and third-party databases.
  • Developed and deployed a comprehensive data processing pipeline, leveraging REST APIs to monitor continuous events and trigger actions based on predefined thresholds. Integrated Kafka for real-time data streaming, Spark for data processing, and MySQL for data storage, enabling seamless transformation and ingestion of processed data, while ensuring scalability, fault tolerance, and performance optimization.
  • Designed and implemented views, common table expressions (CTEs), and view partitioning strategies to optimize data analysis for teams, facilitating efficient querying and visualization of structured data.

Education

X -

XII -

B. Tech. in Electrical Engineering -

Rajasthan Technical University, Kota

Skills

  • Python, Pandas and Numpy, SQL, Shell Scripting, Pyspark, Machine learning, Problem-Solving, Performance Optimization

Personal Information

  • Date of Birth: 02/11/88
  • Gender: Male

Timeline

Python Developer, Data Engineer and Data Analyst.

Airlinq India Pvt Ltd
12.2021 - Current

X -

XII -

B. Tech. in Electrical Engineering -

Rajasthan Technical University, Kota

Similar Profiles

CREATE PROFILE
Nimish JainPython developer, data engineer and data analyst.