We are currently looking to recruit an enthusiastic candidate to join our team and implement improvements to data pipeline architecture and maintain scalable data in Databricks Platform. The candidate would also be responsible in managing data processing and exploring the expansion of data capability to unlock the business potential by using data.
- Migrating Data warehouse to new platform of Databricks.
- Performing ETL, Data Modeling and Data Analytics to meet business requirements with optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS…etc
- Overseeing and managing the work-flow of data quality management, data cleansing and data exchanges processes by designing and implementing different rules and best practice
- Ensuring data reliability and analyzing data to isolate and explain data irregularities
- Streamlining the internal process improvements such as the automation of manual processes, infrastructure design for greater scalability, etc
- Working with stakeholders including the Data Analysts, business and technology stakeholders to assist with data-related technical issues and support their data infrastructure needs
