- Sydney, New South Wales, Australia
- Permanent, Full time
- Macquarie Group
- 19 Apr 19
Big Data Engineer
Big Data EngineerAs a Big Data Engineer, you will be part of an exciting technology team working on a cutting-edge platform. We need an experienced Data Engineer to help us build the next generation of data technology within our Banking & Financial Services business group. You will join a cross-functional Agile team with a diverse range of skills which you'll be able to leverage to develop your own T-shaped skill-set and grow your career.
You'll bring your in-depth knowledge of big data technologies best practice and a desire to work in a DevOps environment where you have end-to-end accountability for developing, deploying and supporting your data assets.
You will have some of the following skills and experience, with a preference for Scala / Java and distributed platform capabilities.
Your key responsibilities will include:
- data Warehousing/ETL concepts or have worked on similar projects
- strong Linux/Unix skills
- strong SQL
- experience with AWS or other cloud environments
- demonstrated experience using distributed computer frameworks on Hadoop, Spark, distributed SQL, and/or noSQL query engines
- significant experience in Scala, Java, and/or Python
- Big Data querying tools like Hive or Presto.
Ideally you will also bring:
- deep understanding of AWS cloud architecture
- exposure to Data Vault 2.0
- talend preferred, but not required
- experience working with Datastax Cassandra implementation
- security Concepts and best practices
- data Pipelines tools like Apache oozie, LUIGI or Airflow
- maven, SBT.
We are looking at candidates from a range of different backgrounds, and we also encourage candidates to apply who are interested in flexible working arrangements. If the above sounds like the right opportunity to further your career, apply via the link below or get in touch with email@example.com for more information.
The Corporate Operations Group (COG) brings together specialist support services including workplace, human resources, market operations and technology. COG's purpose is to drive operational excellence through business-aligned services with a focus on quality, cost and risk. COG comprises the following divisions: Business Improvement and Strategy, Business Services, Human Resources, Market Operations, and Technology.
Macquarie understands the importance of diversity and inclusion - our long history of success has come from being different. At Macquarie we value the innovation and creativity that diversity of thought brings. The one thing we all have in common is our focus on high performance. If you're capable, motivated and can deliver, we want you on our team.
We facilitate a range of flexible working arrangements within our teams. Talk to us about what flexibility may be available. Our Technology Returner program is an opportunity for you to re-integrate yourself into the workforce following an extended professional career break. Find out more and apply at https://www.macquarie.com/au/about/careers/jobs/returner-program
Find out more about Macquarie careers at www.macquarie.com/careers
Advertised: 26 Feb 2019 AUS Eastern Daylight Time