Hariharasudhan Sabapathi

Sharp and talented Senior Data Engineer with 10+ years of product development history. Expertise in driving projects and leading cross-functional teams to consistently meet key program deliverables; targeting Lead level assignments in Big Data/Data Analytics with an organization of reputation.

• Apache Hadoop
• Hive
• Sqoop
• Spark
• AWS
• Databricks
• Terraform
• Concourse CI/CD

• Mysql
• PostgresSQL
• Nosql

• Apache Maven
• SBT

• S3
• EMR
• Lambda
• Step Functions
• ECS
• SES, SNS
• IAM
• Glue Catalog
• Athena
• RDS-Aurora Postgress
• Cloud Watch

• Ensuring the successful delivery of emerging big data solutions
• Defining strategy, principles, vision, and standards
• Providing advisory services around data frameworks, governance, and quality
• Simulating, designing, developing & deploying computationally complex and practical data
• Leading the development of enterprise technology standards, governance processes, and performance metrics
• Analyzing & reviewing business, functional, and high-level technical requirements

• AOS (Ad-server Operative System) Data Mapping - Spark Developer, Existing on-prem Operative (o1) migrating to cloud operative system. Extracting the source from different topics from datalake and apply transformation to map the datasets and load the results into S3 target bucket for the downstream teams., Spark Scala, AWS S3, Terraform, concourse CI/CD, Databricks.
• AOS DataStream To DataLake - Big data Developer, Spark Streaming application ingest configured topics from AOS kafka broker to S3 datalake and store them as "delta" format files. Application uses AOS Kafka Schema registry to deserialize AVRO payloads from AOS datastream. AWS (s3, cloudwatch, elastic search, athena, spark scala), Terraform, Grafana, Kafka, DynamoDB, Concourse CI/CD, Databricks Delta lake and data versioning
• iVerify on-prem to Cloud movement - BigData Developer, iVerify adjuster and appnexus processors movement from on-prem to cloud. Pull impressions and files from iverify-api and performed required transformation and writing the result into AWS S3 data lake., Spark with Scala, AWS (emr, s3, cloudwatch, lambda step functions, sns, athena, Hudi), Terraform, concourse CI/CD
• Zoho CRM Data Migration from various sources - Spark Developer, To get the Co-ordinates (latitude & longitude) of a record based on the address information and update/insert the Co-ordinates values in those corresponding records. Using these geocode info, sales persons can find the entities located near him. We used BigData technologies and Zoho Maps api to achieve our goal. For streaming data we used Kafka., Cloudera, Sqoop, Spark with Scala, Hive
• EffecTv Data Portal - NodeJS, Aws(glue api, ECS, cloud watch, event rule, glue job, lambda), Spark with Scala, Angular, Postges Aurora Serverless, Internal portal/tool for Comcast-EffecTV customers where they can visit this website (dataportal.comcast.com) and ask for access of tables and buckets and view how many roles/users accessed the table/bucket on any day. Admin/Managers can approve or deny the bucket access request.
• Zoho Survey-CRM integration - Java, JavaScript api, Zoho Survey, Surveys are useful marketing tools that help Customer business. It's a method by which customer put specific questions to a group of people whose answers will help you improve their products or services. This integration eliminates the need to manually put CRM and Survey data together. It will be done automatically. Surveys are pushed inside
• Zoho CRM. CheckIn For an Event - Java, JavaScript api, Zoho Map api, Google Map api, In Zoho CRM, sales managers and sales reps can manage their work-related visits easily with the help of check-ins from the Zoho CRM mobile app. A check-in from the Zoho CRM mobile app is always associated with an event. When you check-in from a location, the app prompts you to associate the check-in with an existing event
• Google Calendar Synchronization with Zoho CRM - Java, Google Calendar api, Synchronizing calendar entries of Google Calendar and that of the Zoho CRM Calendar is now made easy with the Google Calendar Synchronization feature. You can update the calendar entries in either Google Calendar or Zoho CRM and have them updated in both.

• Pursuing PG Diploma in Artificial Intelligence (AI) and Machine Learning (ML) - IIT Madras