What you’ll do:

• Design, develop, and implement scalable, secure, and highly performant data pipelines using Azure data services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.

• Proficiency with the Snowflake platform with experience in SQL, stored procedures, and ELT within the Snowflake environment. Skilled in constructing and managing Snowpipes and streams, Development of stored procedures and UDFs using Snowflake scripting.

• Proficient in managing data migration into Snowflake. This includes extracting data from various sources, transforming it into a usable form, and loading it into the Snowflake platform.

• Monitoring of health, performance, and resource usage, with the implementation of necessary optimizations in the Snowflake environment.

• Experience with Snowflake performance optimization techniques for data pipelines.

• Proficient in exploring new Snowflake features and doing quick POC’s around it.

• Ability to handle Snowflake administration is good to have.

• Proficient in Python programming language and experienced in automation, capable of transforming manual processes into automated tasks, check for vulnerabilities on Azure and Snowflake platforms by writing python scripts

• Familiarity with GitHub for code version control and collaboration

• Familiarity with CI/CD practices, Terraform, and experience with tools like Jenkins or Azure DevOps. Use tools like Terraform to define and deploy infrastructure using code, including provisioning resources using terraform, configuring security settings, and applying updates will be a plus.

• Experience with Azure administration tasks, including resource provisioning, security configuration, and updates will be an advantage

• Ability to work independently and as part of a team

Qualifications:

Graduate Degree in Comp Science / Engineering / Equivalent.

4-8 years of experience in data engineering, with a strong focus on Snowflake and Microsoft Azure data services. Familiarity with any cloud services like AWS, Azure, or GCP though Azure is preferred

Skills:

Azure/Snowflake data engineers require a unique set of technical and soft skills to be successful in their role. Some key soft skills include:

• Communication: The ability to clearly and effectively communicate technical concepts to non-technical stakeholders is essential.

• Leadership: A senior data engineer must be able to lead and mentor team members wherever required.

• Problem-solving: Must be able to analyze complex data engineering problems and develop innovative solutions.

• Customer service: Must be able to understand customer needs and work to deliver solutions that meet those needs.

• Creativity: Think outside the box and come up with new and innovative solutions to data problems.

• Analytical skills: Must be able to analyze large sets of data, identify patterns and insights, and use that information to inform decision making.