Ajay Dubey

A fast learner and passionate technologist with 15+ years of proven experience in conceptualizing, architecting, planning and executing enterprise scale, and time critical software solutions.

I have commercial experience in delivering green field as well as brown field projects with responsibility of making key technology decisions and leading team of developers. The past couple of years I have designed & delivered batch & cdc data pipelines for gaining insights and doing analytics on massive scale data using the latest technologies like Spark, Hadoop & various cloud services. I have production experience in migrating applications and databases to AWS with a certified Solutions Architect Associate certification.

I am hands on developer and have expertise in Java, Scala & JavaScript programming languages. I have rich experience in developing array of multithreaded, resilient and scalable microservices using Java and Akka concurrent framework.

• Having Total 12+ years of extensive Big Data and Application Development experience in fields of software design, development, implementation and support of business applications in Devops methodology. Currently Working as Sr technical Lead Big Data at Airtel International Gurgaon. 8+ Years of extensive experience of working in a Big-Data project and Well versed experienced in the Hadoop ecosystem components like HDFS, Sqoop, Scala, Apache Spark, Apache Spark-SQL, Hive, Drools, snowFlake, redshift, MongoDb and Microsoft Power BI etc. 5 Years of extensive experience of working in Professional Software Development with Microsoft Stack. Able to assess business rules, collaborate with stakeholders and perform source-to-target Big Data pipelines. Improve Hive query performance by using partitioning, bucketing, indexing and other techniques. Used Spark API over Cloudera Hadoop YARN to perform analytics data on Hive. Implemented Spark using Scala and SparkSQL for faster processing of data. Involved in converting Hive/SQL queries into Spark Transformation using Spark RDDs and action. Incorporating data analysis of raw data in order come up with conclusions/recommendations Hands on experience in Sqoop to transfer data from RDBMSs directly into HDFS and Hive. Analyze and gather the business requirement and prepared Business documents as per requirement. Good analytical abilities, quick grasping power, zeal for learning new technologies like Spark (real time processing) and Machine learning Concepts. Efficient in achieving version controls by using GIT, STASH, TFS. Well versed with Devops and Agile with Scrum Model and JIRA for development. Creation and Execution of Unit Test Cases and Code review of junior developers. Good development skills using Spark, Impala, Hive, Kafka, Apache Kudu, AWS redshift, AWS Dynamo DB, MongoDb, SnowFlake, Redshift, Azure Cosmos DB, Scala, Python, ASP.NET, MVC, C#, SQL Server2X, Web Services, WCF, Win Form, Multithreading, WebApi, ZeroMq, RabbitMQ, AWS, Kafka Azure and LINQ, Fix protocol. Technology: Domain Specific Area in Domain Languages C#, SQl, Python , Scala, Operating Windows Systems(OS) Databases Sql Server, Hive, Redis, CosmosDB, Sybase, MongoDb , Redshift, Snowflake, Big Data Hadoop, Map-Reduce, SQOOP, HIVE, Flume, Apache Spark, Apache Spark-SQL, Kafka, Scala, Python, Power BI Desktop, InteliJ, Impala, Apache Druid, AWS S3, Snowflake. Reporting Tool Power BI. Version Control Tools GIT/Stash/Source Tree, SVN, TFS. Other Tools Jira, Rally, Database Control Manager (DCM), Confluence