Job Description

Looking for a cloud Data Engineer to design and execute the process of transferring large datasets from a company's on-premises servers to Amazon Web Services (AWS) cloud storage, utilizing appropriate AWS migration tools and techniques to ensure a smooth transition with minimal disruption to business operations,

Responsibilities:

• Designs, develops, modifies, tests and automation used to provide data warehouse and business intelligence applications solutions. This includes design, development, architecture recommendations, quality management, metadata and repository creation, trouble-shooting problems and tuning warehouse applications.
• Advanced analytical ability and technical skill as well as the ability to provide innovative solutions to technical needs and business requirements.
• Ability to exercise independent judgment in making complex business decisions.
• Acute attention to detail with a high level of data integrity and accuracy.
• Develops all or part of complex data warehouse applications, develops software from established requirements, builds reports and dashboards, plans and coordinates work of lower level programmers to meet delivery commitments, creates prototypes; offers insight on the feasibility of system designs.
• Contributes to the design of technology infrastructure and configurations, recommends process improvements.
• Reviews complex patches and new versions of data warehouse applications. Implements complex software packages and deploys code.

Qualifications:

• Bachelor’s degree in computer science, Information Systems, or another related field
• 9+ years of experience in data engineering, data science, and software engineering.
• Focus on Cloud Data Migration. On premises Applications to Cloud.
• AWS(EC2 S3 Redshift).
• Data Migration, Application Migration.
• Experience creating scripts with Python.
• Expert in developing and analyzing complex SQL on a variety of RDBMS (Microsoft SQL Server, Oracle).
• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.
• Experience with ETL tools (Informatica).
• Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices (S3, DMS, Glue, Lambda).
• Development/modeling experience with Amazon Redshift.
• Experience using the AWS service APIs, AWS CLI, and SDKs to build applications.
• Proficiency in developing, deploying, and debugging cloud-based applications using AWS
• Ability to use a CI/CD pipeline to deploy applications on AWS (GitLab, Terraform, DBMaestro).
• Ability to apply a basic understanding of cloud-native applications to write code.
• Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)

Job Tags

Similar Jobs