Dynamic Technical Lead at Solix Technologies Ltd, adept at leveraging Azure and AWS for cloud solutions. Spearheaded infrastructure automation with Terraform and Ansible, enhancing deployment efficiency. Passionate about big data, I excel in Spark and Kubernetes, driving performance improvements while fostering team collaboration and innovation.
Azure, AWS, AKS, EKS, HDInsight, EMR, Linux, Windows, Terraform, Ansible, Azure DevOps, GitHub Actions, Jenkins, Docker, Kubernetes, Helm, Prometheus, Grafana, Spark, Hive, HDFS, Solr, Impala, Sqoop, Kafka, Kerberos, TLS/SSL, Ranger, Sentry, Data Encryption, Bash, Python, SQL, MySQL, Git, Tomcat
Solix Common Data Platform (Bottom Up Security Enhancements) This project is about providing security on HDFS data, Hive tables, and Solr collections using Ranger and HDFS ACLs for Hortonworks distributed Hadoop cluster through SCDP application
Technologies Used: Hortonworks distributed Hadoop, Ranger, Hive, SoIr,Tomcat
Roles & Responsibilities:
• Designing Architecture and Setting up Hortonworks distributed Hadoop Cluster using Ambari troubleshooting the issues
• Implemented Hadoop security (Keberos, Encryption, Ranger, Data Encryption at Rest, Data Encryption in Transit, HDFS ACLs)
• Configuring SSL encryption for all HDP Services, Creating hive databases, HDFS Encryption zones and solr collections
• Providing Ranger delegate admin access to hive db, solr collections
• Taking backup of metastore, namespace and SCDP Repositories
Solix Common Data Platform (SAP Archiving)
This project is about SAP data (ADK & CSV) archiving to HDFS. Using NFS Gateway we will mount HDFS directories on SAP server to copy data from SAP server to HDFS and vice versa
Technologies Used: Cloudera Hadoop, Hortonworks, SAP, NFS, Tomcat
Roles & Responsibilities:
• Designing Architecture and Setting up Cloudera/Hortonworks Hadoop Cluster
• Implemented Hadoop security
• Configuring NFS Gateway
• Mounting HDFS through NFS gateway on SAP Server
• Taking Back Up of metastore & SCDP Repositories
Solix Big Data Suite
This project is about Data Migration/ Data Archiving/Application Retirement from various sources (Oracle, IDMS, Mysql) to Hadoop (HDFS, Hive, Solr), Data Masking, EBR, Saved Queries, Reports, APM Search(Solr) using Solix Big Data Suite.
Technologies Used: Cloudera Hadoop,Hortonworks ,Hive, Solr, Oracle, Mysql, Tomcat
Roles & Responsibilities:
• Deploying Hadoop Clusters
• Configuring High Availability
• Configuring Apache Solr
• Deploying Backup Strategies
• Setting Up Alerts in cloudera manager
• Troubleshooting the issues at client environments