Job Description

Job Title: Lead Data Engineer

Location: Chicago, IL (Remote is ok)

Duration: 12+ months with possible extension

Certifications: Relevant certifications in Amazon Glue, SQL, Python, DevOps Solutions, or Snowflake are a plus.

Experience: 8-12 Years

Skill (Primary): Data Fabric-ETL-Amazon Glue

Job Summary:

AWS Senior Data Lead with Glue, SQL, Python

Job Description:

The Senior Technical Lead will be responsible for overseeing and leading technical projects related to Amazon Glue, SQL, Python, DevOps Solutions, and Snowflake. The role involves ensuring the successful development, implementation, and integration of these technologies to meet business objectives and enhance overall technical capabilities. (1.)

Key Responsibilities:

1. Provide technical leadership and guidance on projects involving amazon glue, SQL, python, DevOps solutions, and snowflake.
2. Design and develop robust solutions using amazon glue for data integration and ETL processes.
3. Utilize SQL for database management and querying to support various data initiatives.
4. Develop and maintain scalable python applications to automate processes and enhance data workflows.
5. Implement and manage DevOps solutions to streamline deployment and ensure continuous integration and delivery.
6. Work with snowflake to design and optimize data warehousing solutions for improved analytics and reporting.
7. Collaborate with cross functional teams to drive technical innovation and best practices in line with business goals.

Skill Requirements:

1. Proficiency in amazon glue for ETL processes and data integration.
2. Strong understanding of SQL for database management and querying.
3. Advanced knowledge of python programming for automation and application development.
4. Experience with DevOps solutions for continuous integration and delivery.
5. Familiarity with snowflake for data warehousing and analytics.
6. Excellent problem-solving skills and ability to troubleshoot technical issues efficiently.
7. Strong communication and leadership abilities to effectively lead technical teams and collaborate with stakeholders.

MUST HAVES:

• Snowflake, Python, AWS-Lamda, Fivetran, DBT
• 6 years+ experience on Snowflake SQL advanced SQL expertise
• 6 years+ experience on data warehouse experiences hands on knowledge with the methods to identify, collect, manipulate, transform, normalize, clean, and validate data, star schema, normalization / denormalization, dimensions, aggregations etc.,
• 6 years+ experience working in reporting and analytics environments development, data profiling, metric development, CICD, production deployment, troubleshooting, query tuning, Atlassian Bitbucket and Bamboo, etc.,
• 4 years+ on Python advanced Python expertise
• 4 years+ on any cloud platform AWS preferred
• Hands on experience on AWS on Lambda, S3, SNS / SQS, EC2 is a bare minimum,
• 4 years+ on any ETL / ELT tool Informatica, Fivetran, DBT etc.
• 4 years+ with developing functional metrics in any specific business vertical (finance, retail, telecom, etc.)

Job Tags

Similar Jobs