Himateja Madala

Responsibilities

• Built a Data Mesh(Domain Driven Architecture) to cater to infrastructure needs of 3 organizations(Hulu,Disney,Disney Streaming) and helped 15+ teams migrate their workloads to one Unified Data Platform.
• Architected and Developed "State of the Art" Observability framework to unify logs & metrics across the unified data platform that is used for metrics collection, compliance ,alerting and visualization.
• Designed and Delivered Infrastructure blue prints via Self-serve Terraform modules which enable users to create and maintain resources in over 50 AWS accounts.Published Inner Source Infrastructure as Code via Disney CDK(Cloud Development Kit) that is scalable and complies with global governance and security standards
• Led design discussions and played solution architect role providing custom made solutions for teams looking to move to Unified Platform
• Managed 2 teams of 35 engineers including 5 first level managers with a solid experience in hiring great talent and mentoring teams.

Environment: AWS Cloud Suite(VPC,EMR,ECR,ECS,ALB), Terraform, Databricks, CDK, Python, Git, Docker, JIRA.

Responsibilities

• Revamped the existing Redshift pipelines into Spark jobs and built a data lake that feeds to all reporting and data science tools.
• Partnered with Data Science teams to build look-a-like modeling based on the Seed audiences generated from the Audience builder Platform.
• Conduct code reviews, process implementations and own the deliveries from the team

Environment: Apache Spark, Scala,Kafka, AWS, EMR, Lambda, Airflow, Databricks, Redshift, Git, Docker, JIRA.

• Managed a team of data engineers on site to handle the data delivery for a crucial WB project-ARROW
• Partnered with Data Scientists to create personalized movie recommendations using NLP machine learning models used Embeddings, TF-IDF and Cosine Similarity
• Designed and developed systems that would serve as Data Warehouse and Data Lake to make data accessible to the business teams and data science teams.
• Designed and developed CI/CD pipelines that would enable faster deployments to production and maintain backward compatibility
• Developed a robust alerting and monitoring systems to bring all data related jobs on to a unified platform and categorize failures for reporting to the respective teams.

Environment: Apache Spark, Scala,Kafka, AWS, EMR, Lambda, Airflow, Elastic Search,SnowFlake, Git, Docker, JIRA and Jenkins.

-Developed pipelines to generate reports on game statistics, reveneus delivered to C-Level executives

Environment: Hadoop, Spark, Hive, Java (jdk1.7), Git, Oozie, Flume, Sqoop, RabbitMq, Docker.

• Developed Machine Learning models to solve Transaction Classification problems.
  
• Worked on boosting queries in Elastic Search to aid in the data search.
  
• Worked with Data Scientists to tune the ML algorithms to use for the particular use case.
  

Environment: Hadoop, Map Reduce, Hive, Java (jdk1.7), Elastic Search, Python, Scikit Learn, Pandas.

• Developed an equivalent version of Mint for India, a first of its kind product to cater to the Indian Personal Finance Market.

• Developed Flow sheets run on bed side kiosk that help capture vital statistics of the patient