Manohar Venkatesh
Data Engineer
Kuala Lumpur
Summary
Experienced Data Engineer well-versed in defining requirements, planning solutions and implementing structures at the enterprise level. Analytical problem-solver with a detail-oriented and methodical approach. Prepared to offer 10 years of related experience to a dynamic new position with room for advancement.
Overview
9
9
years of professional experience
4
4
years of post-secondary education
Work History
Data Engineer
Hastraa Consulting Services
Kuala Lumpur
10.2017 - Current
- Developed, implemented and maintained data analytics protocols, standards and documentation.
- Designed compliance frameworks for multi-site data warehousing efforts to verify conformity with state and federal data security guidelines.
- Generated detailed studies on potential third-party data handling solutions, verifying compliance with internal needs and stakeholder requirements.
- Developed spark code and deployed it in EMR
- Interacted with other technical peers to derive technical requirements
- Have a general understanding of entire Hadoop ecosystem, Cloudera DataHub
- Handled the complex data processing and creation
- Implemented Scala programs to handle semi/unstructured data like XML, JSON, Avro data files, Parquet files, and sequence files for log files
- Developed Sqoop jobs to import and store massive volumes of data in HDFS and Hive
- Designed a data quality framework to perform schema validation and data profiling on a spark
- Performed data uploading/downloading using Amazon S3
- Experienced in implementing Spark RDD transformations, actions to implement the business analysis
- Extensively worked on creating combiners, partitioning, and distributed cache to improve the performance of Scala jobs
- Improved and implemented customer risk rating criteria with KYC management and procedure for both consumer and corporate customers
- Reviewed all required AML/ KYC regulatory requirements for all clients and analyzing any transactions that appear unusual based on the customer's profile
- Reviewed different accounts and loans application files to verify that application data is complete and meets establishment standards to combat fraud.
ETL Developer
HTC Global Services Sdn Bhd
Kuala Lumpur
11.2016 - 10.2017
- Designed integration tools to combine data from multiple, varied data sources such as RDBMS, SQL and big data installations.
- Designed and created ETL code installations, aiding in transitions from one data warehouse to another.
- Verified performance and reliability of development database transformation solutions via extensive simulation testing.
- Optimized broken and inefficient assets through effectively troubleshooting technical processes and workflows.
- Managed data quality issues during ETL processes, directing qualitative failures to team lead for amelioration.
- Collaborated with business intelligence staff at customer facilities to produce customized ETL solutions for specific goals.
- Interpreted data models for conversion into ETL diagrams and code.
- Wrote and optimized in-application SQL statements.
ETL Developer
Wipro Ltd
Bangalore
03.2013 - 10.2016
- Responsible for the assigned tasks and coordinating with different teams to get the inflow and outflow of data setup
- Performing data integration for data warehouse applications
- Creating star schema data models and implementing them
- Have been in customer-facing or business group-facing roles
- Have worked in common SDLC structures including waterfall, agile, or scrum
- Taken responsibility in Peer review of SQL, Control M jobs and DataStage jobs
- Single point of contact for the client from the development team
- Discussions with Business and Functional users to get the details required for the development and enhancement tasks
- Implementation planning and successful deployment of the developed code in a production environment
- Assign the issue tickets and Tasks to the team members
- Provide post-implementation support after go-live
- Create a learning plan and mentor new and existing team members
- Attending status meetings with clients
Education
Bachelor Of Technology -
Jawaharlal Nehru Technological University
10.2008 - 05.2012
Skills
Data Eco System : Hadoop, Sqoop, Hive, Impala, HBASE, Apache Spark, Kafka, Cassandra, Nifi, AWSundefined
Accomplishments
- Resolved product issue through consumer testing.
- Supervised team of 5 staff members.
- Collaborated with team of 13 in the development of Model Monitoring.
- Documented and resolved data exploited issues which led to save te fine of 1 Million Ringgit from Bank Negara malaysia.
Timeline
Data Engineer
Hastraa Consulting Services
10.2017 - Current
ETL Developer
HTC Global Services Sdn Bhd
11.2016 - 10.2017
ETL Developer
Wipro Ltd
03.2013 - 10.2016
Bachelor Of Technology -
Jawaharlal Nehru Technological University
10.2008 - 05.2012
Similar Profiles
Sriram RamanujamSriram Ramanujam
Devops Engineer at Hastraa Consulting ServicesDevops Engineer at Hastraa Consulting Services
Sharath Chandra KujalaSharath Chandra Kujala
Senior Business Analyst at IndraSur Consulting Services, Pvt. Ltd (Akytech Consulting LLC & ProGov Partners LLC)Senior Business Analyst at IndraSur Consulting Services, Pvt. Ltd (Akytech Consulting LLC & ProGov Partners LLC)
YUSUF MARIAMYUSUF MARIAM
Officer 1 at Integrated Consulting Managment Accounting Services (ICMA SERVICES)Officer 1 at Integrated Consulting Managment Accounting Services (ICMA SERVICES)