Simran

• Project: Sony Artist Portal – Global Streaming Analytics Platform
  Experience
  Built and operated scalable data pipelines serving analytics for 200+ global music partners,
  processing 10–25 TB of data monthly across ingestion, transformation, and API delivery
  layers.
  •
  Designed Python-driven ETL workflows that execute complex transformations on Amazon
  Redshift , improving query latency by 30–40% through schema tuning, distribution keys, and
  query refactoring.
  •
  Optimized data movement using parallel COPY/UNLOAD patterns, reducing batch processing
  time by 40–50%, and improving data freshness for downstream consumers.
  •
  Partnered with upstream lake teams, ingesting data via EMR Serverless and S3, aligning
  schema standards, and downstream consumption patterns for analytics scalability.
  •
  Built scalable REST APIs for analytics delivery with horizontal scaling across four EC2
  instances behind a load balancer, handling over 100,000 API requests per day.
• Implemented production-grade monitoring, logging, and automated alerting, improving
  pipeline reliability to 99.9% uptime, and reducing operational incidents.
  •
  Applied distributed processing concepts (Spark-style transformations, partitioning strategies)
• 
  to handle high-volume datasets efficiently.
  •
  Mentored and onboarded two junior engineers, conducted knowledge-transfer sessions on
  system architecture and data pipelines, and contributed to production deployment and
  incident response practices.
  •
  Collaborated using GitHub for code reviews and version control, and managed delivery using
  JIRA for sprint planning, story tracking, and release coordination.
  •
  Regularly partnered with senior stakeholders and business leaders for requirement
  clarification, technical design reviews, and delivery updates.

Project: Sony Charts – Global Music Charts Data Platform.

Designed ingestion pipelines that consume data from 10+ third-party partners (Spotify, Apple
Music, Amazon, YouTube, Deezer, KKBOX) via APIs and web sources, processing millions of
records monthly.
•
Built automated ingestion workflows using Python and Pandas, standardizing raw feeds into
Parquet-based S3 data lake zones.
•
Implemented distributed transformations using PySpark on EMR Serverless for schema
validation, normalization, enrichment, and quality enforcement.
•
Enabled analytics consumption through external tables and automated metadata
crawling, loading curated datasets into Redshift fact and dimension models.
•
Developed a multi-stage entity resolution and product matching pipeline using PySpark,
matching chart tracks against Sony's master catalog using hierarchical matching strategies.
•
Improved match accuracy and reduced manual reconciliation by 30–40% through optimized
matching logic and validation rules

• Designed and created ETL code installations, aiding in transitions from one data warehouse to another.
• Wrote and optimized in-application SQL statements.,
• Worked independently to design, develop and test code.
• Participated in architectural discussions to build confidence and promote customer success when developing new and migrating existing applications, software and services on AWS platform.
• Built, tested and deployed scalable, highly available and modular software products.

• Identified new problem areas and researched technical details to build innovative products and solutions.
• Researched, designed and implemented machine learning applications to solve business problems affecting various of users.
• Studied new technologies to support machine learning applications .
• Prototyped machine learning applications and quickly determined application viability.
• Produced clean, validation-ready code for project needs.
• Researched, designed and implemented scalable applications for data extraction, analysis, retrieval and indexing.
• Designed intuitive graphical user interfaces using knowledge of serial communications and database design to improve user experience.

• Reviewed project specifications and designed technology solutions that met or exceeded performance expectations.
• Interfaced with cross-functional team of business analysts, developers and technical support professionals to determine comprehensive list of requirement specifications for new applications.
• Revised, modularized and updated old code bases to modern development standards, reducing operating costs and improving functionality.
• Working closely with UX and Front-end Developers
• Participating in architectural, design and product discussions
• Designing and creating RESTful APIs for internal and partner consumption
• Wrote and optimized test cases to maximize success of manual software testing with consistent, thorough approaches.
• Planned website development, converting mockups into usable web presence with HTML, JavaScript, AJAX and JSON coding.
• Applied change control best practices to Django development processes to provide software enhancements without disruptions for end users.
• Integrated api service such as REST and SOAP into database management projects using Python.
• Remained abreast of developments in related Python frameworks.

• Developed back-end components to connect applications with web services.
• Worked closely with Project Managers and other developers to define parameters and plan detailed specifications with clear project deliverables and timelines to meet strict deadlines.
• Wrote server-side and client-side code for projects using Python, PHP, HTML, CSS and JavaScript, specifically with Django and Yii framework.
• Researched, tested and implemented various client feature requests to deliver internal content management systems and content delivery applications.