As a Data Engineer, you'll be a key player in building and managing our robust data infrastructure, ensuring that data is accessible, reliable, and ready to fuel business insights. Key Responsibilities:
Data Platform Architecture: Design, implement, and maintain scalable data architectures, including data pipelines, warehouses, and lakes, leveraging BigQuery as a core component.
ETL Development: Develop and optimize ETL processes, ensuring efficient data extraction, transformation, and loading from diverse sources.
Data Pipeline Orchestration: Utilize Airflow to orchestrate complex data pipelines, ensuring seamless data flow and dependency management.
Performance Tuning: Continuously monitor and optimize the performance of our data infrastructure, including BigQuery queries and ETL workflows.
Data Quality & Governance: Implement data quality checks and validation processes, ensuring data accuracy, completeness, and integrity.
Data Modeling: Design and implement robust data models to support various business needs and analytical use cases.
Collaboration & Mentorship: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical guidance.
Qualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.
5+ years of hands-on experience in data engineering and analysis.
Strong proficiency in Python, Java and SQL, with experience utilizing them for data processing and analysis.
Expertise in database technologies like CDC, Kafka, BigQuery, dbt, Airflow, and ETL tools.
Solid understanding of data warehousing principles and best practices.
Experience working in cloud environments (preferably AWS or GCP).
Excellent problem-solving skills and a passion for data.
Strong communication skills and ability to collaborate effectively with cross-functional teams.
Preferred Qualifications:
Experience with DevOps tools and practices, enabling efficient and reliable deployments.
Familiarity with data security and privacy best practices, including handling sensitive data like PHI.
Knowledge of data visualization tools (e.g., Data Studio, Looker) to empower business users.
Exposure to machine learning concepts and workflows.
Why Join Us:
Be part of a major transformation program and have a real impact on data strategy.
Work with cutting-edge technologies like BigQuery and Airflow.
Collaborate with a talented team of data professionals.