Position Overview:
We are seeking a highly skilled and experienced Data Engineer Manager to join our team. The ideal candidate will have extensive experience with Google BigQuery (GBQ), PostgreSQL, and ETL technologies. This role will involve leading the data engineering team, designing and implementing scalable data pipelines, and optimizing our data infrastructure. You will work closely with cross-functional teams to ensure data availability, reliability, and performance.
Key Responsibilities:
-
Leadership and Strategy:
- Lead and mentor a team of data engineers, providing technical guidance and fostering a collaborative environment.
- Develop and execute data engineering strategies that align with business objectives.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
-
Data Engineering and Implementation:
- Design, develop, and implement robust ETL processes to ensure the efficient ingestion, transformation, and loading of data from various sources into GBQ and PostgreSQL.
- Architect and manage scalable data pipelines and workflows to handle large volumes of data and support real-time analytics.
- Optimize and maintain data infrastructure, including GBQ and PostgreSQL databases, for performance and reliability.
-
Data Management and Optimization:
- Monitor data pipelines and databases to ensure data accuracy, consistency, and availability.
- Implement best practices for data governance, security, and compliance.
- Troubleshoot and resolve data-related issues, including performance bottlenecks and data quality problems.
-
Collaboration and Communication:
- Work closely with other engineering teams to integrate data solutions with existing systems and applications.
- Communicate complex technical concepts to non-technical stakeholders in a clear and effective manner.
- Prepare and present regular reports on data engineering metrics, progress, and initiatives.
