[ref. m9672704] Data Engineer

About Our Client

The team culture is fantastic with a customer driven approach and a focus on goals and values. They are looking for someone in this role who can hit the ground running and add value to their highly motivated team.

Job Description

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.

1. Design, construct, install, test and maintain highly scalable data management systems.
2. Develop and implement data pipelines in Azure Data Factory (ADF).
3. Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
4. Work closely with data science and engineering teams to provide direct and indirect data-related support.
5. Ensure systems meet business requirements and industry practices.
6. Integrate up-and-coming data management and software engineering technologies into existing data structures.
7. Develop set processes for data mining, data modelling, and data production.
8. Create custom software components and analytics applications.
9. Research new uses for existing data.

• Experience: strong experience in data engineering with a strong track record in Azure and PySpark applications.
• Technical Skills: Proficient in designing and maintaining scalable data systems, developing data pipelines with Azure Data Factory, and implementing real-time streaming with Spark.
• Problem-Solving: Excellent analytical and troubleshooting skills, with the ability to optimize data processes and integrate new technologies.
• Collaboration: Proven ability to work effectively with data science and engineering teams to meet data requirements and support business needs.
• Adaptability: Experience with emerging data management technologies and a knack for developing innovative solutions.
• Communication: Strong communication skills to clearly articulate technical concepts and collaborate with cross-functional teams.

• Flexible Work Arrangements: Enjoy a hybrid work model with the flexibility to work from home and occasional office visits in Melbourne.
• Competitive Rate: Up to $1,100/day incl. super for a 6-month contract.
• Career Development: Opportunity to work on high-impact projects and advance your career in a leading data-centric role.
• Inclusive Culture: A commitment to a diverse and inclusive workplace with ongoing DEI initiatives.
• On-site cafe
• Fitness club facilities