Data Engineers at Softtest pays pty ltd in Sydney, New South Wales, AU

Australian Citizens residing in Australia only respond. must hold a valid Baseline security clearance or be willing and eligible to obtain one.

Essential criteria:

1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment. 50%

2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Graph Databases Azure SQL. 25%

3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure. 25%

Desirable criteria:

1. Experience working with Azure Data Factory and Databricks.

2. Experience/Knowledge of working with Data Lake and Lakehouses