Job Summary: We are seeking a skilled DevOps Engineer to join our technology team, focusing on automating, and optimizing our data engineering pipelines. The ideal candidate will have a strong background in software development, automation of CICD using Jenkins in data platforms like Databricks and Snowflake. You will play a crucial role in developing and enhancing CI/CD pipelines, automating tasks, and ensuring seamless data operations across our platforms.
Key Responsibilities
Develop and enhance CI/CD pipelines using Jenkins to automate and streamline deployment processes.
Write and maintain scripts in Groovy to support automation and integration tasks.
Utilize REST APIs to integrate different systems and services, and process JSON responses effectively using Python.
Work closely with data engineering teams to understand their Devops needs and implement solutions that enhance data workflow efficiencies.
Deploy dathub jobs using Jenkins pipeline.
Collaborate with development and operations teams to ensure system reliability, security, and efficiency.
Stay updated with the latest industry trends and technologies and apply insights to improve existing systems and workflows.
Qualifications
Proven experience as a DevOps Engineer or similar role with a focus on data engineering platforms.
Strong programming skills in Groovy, Python, and experience in Jenkins and CI/CD practices.
Experience with REST APIs and data manipulation, particularly JSON.
Familiar with Databricks and Snowflake.
Strong problem-solving skills, attention to detail, and ability to work in a collaborative team environment.
Excellent verbal and written communication skills.
This role is perfect for someone passionate about automation, data flow, and continuous improvement in data operations environments.
Seniority level
Entry level
Employment type
Full-time
Job function
Engineering and Information Technology
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Donato Technologies, Inc. by 2x