| Description :
|
Job description:
Overview:
Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key role in growing and transforming analytics landscape.
Looking for Data Migration Engineer having an experience migrating data from on prem to cloud.
Must Have: AWS (S3, Aethna, EMR, EC2), Python, Spark, PySpark
Good to have: Snowflake
Requirements:
• Candidate must be experienced working in projects involving data migration on AWS
• Experience on data migration from On-Prem databases to AWS Cloud on S3
• Understands where to obtain information needed to make the appropriate decisions
• Demonstrates ability to break down a problem to manageable pieces and implement effective, timely solutions
• Identifies the problem versus the symptoms
• Manages problems that require involvement of others to solve
• Reaches sound decisions quickly
• Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit
Roles & resposibilities:
• Acts as a single point of contact for data migration to AWS projects for customer
• Provides innovative and cost-effective solution using AWS, Spark, python & customer suggested toolset
• Optimizes the use of all available resources
• Develops solutions to meet business needs that reflect a clear understanding of the objectives, practices and procedures of the corporation, department and business unit
• As a leader in the Cloud Engineering you will be responsible for the overseeing development
• Learn/adapt quickly to new Technologies as per the business need
• Develop a team of Operations Excellence, building tools and capabilities that the Development teams leverage to maintain high levels of performance, scalability, security and availability
Skills:
• The Candidate must have 3-5 yrs of experience in AWS, PySpark & Python
• Hands on experience on AWS Cloud platform especially S3, lamda, EC2, EMR
• Experience on spark scripting
• Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform
• Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses.
• Strong experience with relational databases and data access methods, especially SQL.
• Knowledge of Amazon AWS architecture and design
|