About the Role
Responsibilities:
• Architect, build, and sustain scalable data pipelines and ETL workflows to support seamless data integration and analytics.
• Collaborate closely with data architects, modelers, and IT colleagues to evolve the comprehensive cloud data architecture strategy, including data warehousing, data lakes, streaming analytics, and data governance frameworks.
• Work jointly with data scientists, analysts, and business stakeholders to grasp data needs and deliver effective solutions.
• Optimize and manage data storage systems such as S3, Snowflake, and Redshift, ensuring data quality, integrity, security, and availability.
• Implement rigorous data quality and validation mechanisms to guarantee data reliability and precision.
• Develop and maintain detailed documentation of data processes, architectures, and workflows.
• Monitor and address performance issues within data pipelines promptly.
• Engage with designated clients and stakeholders regularly to understand their processes and needs, providing consulting and analysis to recommend solutions or enhancements.
• Stay current with emerging trends and technological advancements in data engineering to continuously refine practices.
Requirements
Location: Ridgefield, Connecticut, United States Hybrid: 2-3 days / week on site
Security Clearance Required: No
Visa Candidate Considered: No
Interview Travel Reimbursed: Yes Qualifications:
Associate degree in Computer Science or MIS with at least four years of relevant experience; or a bachelor’s degree in Computer Science, MIS, or related field with a minimum of two years of experience; or a master’s degree in Computer Science or MIS with at least one year of experience; alternatively, a minimum of four years of relevant Business or IT experience.
Moderate technical proficiency and proven knowledge in integrating data between applications and data warehouses.
Basic understanding of project management with experience contributing to project teams.
Familiarity with lifecycle methodologies.
Exposure to or expertise in at least one major cloud platform such as AWS, Azure, or GCP.
Moderate understanding of software development lifecycle practices.
Experience working collaboratively in project teams toward successful deliverables.
Hands-on experience with AWS services including Glue, Lambda, Athena, Step Functions, and Lake Formation.
Proficiency in Python and SQL.
Mandatory:
AWS services such as AWS Glue, Lambda, Athena, Step Functions, and Lake For
Proficiency in Python and SQL
DevOps / CI / CD
Nice to have:
Over four years of progressive experience in data engineering, particularly with cloud-based platforms.
Practical knowledge of ETL/ELT solutions and orchestrators such as Apache Airflow, Azure Data Factory, AWS Glue, and DBT.
Strong grasp of data governance, quality, and metadata management.
Ability to evaluate AWS solutions and offer architecture recommendations; AWS Solutions Architect certification is advantageous.
Familiarity with Snowflake.
Experience with DBT (data build tool).
Robust analytic and troubleshooting capabilities, notably in optimizing and resolving data pipeline issues.
About the Company
Our client firmly believes that Data & AI possess the potential to revolutionize healthcare, enhancing the lives of millions of patients and animals alike. As a vital member of the EDP team, you will join a dedicated group focused on fostering a resilient data & AI culture, advancing pivotal data transformation projects, and influencing the progression of data-driven decision-making throughout our worldwide organization.
We are in search of a highly skilled and seasoned Data Engineer to design, construct, and sustain our scalable and dependable data infrastructure on a cloud-based platform. In this crucial role, you will play a key part in upgrading our data systems, refining data workflows, and ensuring data accessibility. Your responsibilities will include both the hands-on development of data pipelines and the strategic planning of overall data architecture.
As a team member at our client, you will actively engage in the exploration, creation, and delivery of products that serve our patients and customers. Their global footprint provides employees with opportunities for international collaboration, enhanced visibility, and direct contribution to our client’s overall success. Our client recognizes that their competitive edge is driven by their people. They support them through diverse initiatives promoting a healthy work environment, meaningful work, diversity and inclusion, mobility, networking, and work-life balance. Our client's competitive compensation and benefits offerings reflect the company's deep commitment to its staff.