Develop ETL strategy and ETL logic.
Conduct analysing work on requirements of analytics use case to determine the data mapping required.
Develop data model from conceptual to logical and physical or to support the leader to design the data model.
Drive conversation with customer project team members to get the output required for us to develop the ETL.
Develop unit test scripts, system integration test scripts, user acceptance test scripts.
Conduct QA on ETL result done by other data engineers in the team.
Conduct optimization of ETL logic that had been developed.
Responsible for testing and validating data from UAT
Responsible to do fix on the ETL code and regression testing.
Bachelor’s degree in information systems, Computer Science, Engineering, or a related field or foreign equivalent from a recognized university.
Databricks
At least 3 to 5 years of development experience on Databricks, Microsoft Fabric
Must possess a strong command of SQL and be able to write Stored Procedures, SSIS, T-SQL from scratch
Must have strong analytical skills and have strong attention to detail.
Be able to work independently and ensure strict timelines are met without continuous technical supervision
Knowledge of TDD and various concepts of testing and test automation tools e.g., Selenium is advantageous.
Experience in using cloud platform and configuration
Experience in programming with Python, C#, PowerShell
Good to have experience in designing and building data visualization dashboards.
Past consulting background and experience in working with business and technical stakeholders will be desirable
Candidates with team management experience will be considered for Team Lead role