Senior Data Engineer

About Us InDebted is changing the world of consumer debt collection for good. We’ve disrupted the traditional debt collection industry by providing businesses with a better way to support overdue customers to get back on track. Our solution is product-led, driven by AI and ML, and places customer experience at the core.

We’re fully remote, with a team of over 300 people living and working all around the world. Founded in Australia, we’ve since expanded into the United States, United Kingdom, Canada, and New Zealand. We’ve doubled our revenue year over year, with significant growth on the horizon. Now is an incredible time to join the team as we continue on our mission to help millions of consumers resolve debt, better.

Role Overview We are seeking a Senior Data Engineer to join our foundational engineering team. This role is pivotal as we embark on building a new data lake from the ground up using AWS native components alongside Spark, Iceberg, and DBT. Our data journey is just beginning, with our initial few billion events falling within a 1-20 terabyte range. We anticipate the increasing relevance of big data technologies such as Spark, Kafka, and Samza in the near future.

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and infrastructure to support our data lake initiative.
• Utilise AWS native components in conjunction with Spark, Iceberg, and DBT to construct efficient data solutions.
• Collaborate with cross-functional teams to ensure data accuracy, integrity, and availability for various business needs.
• Continuously evaluate and integrate emerging big data technologies (e.g., Spark, Kafka, Samza) to enhance our data architecture.
• Implement infrastructure as code using CDK and Terraform to manage and deploy cloud resources.
• Embrace a language-agnostic approach, selecting the best tools and technologies suited to the problem space.

Requirements:

• Minimum of 5 years of experience as a data engineer.
• Strong expertise in AWS and experience with CDK and Terraform or equivalent IaC frameworks.
• Proficiency in big data technologies, with prior exposure to Spark and Kafka preferred.
• Demonstrated ability to design and implement scalable, secure, and cost-effective data solutions.
• Language-agnostic, with a deep understanding of various data technologies and frameworks.
• Excellent problem-solving skills and the ability to work autonomously.
• Strong values of truth, knowledge, and transparent collaboration across different functions.

Preferred Qualifications:

• Experience with data lake architecture and implementation.
• Familiarity with real-time data processing frameworks such as Kafka and Samza.
• Prior experience in building and scaling data platforms for high-volume transactions.
• Knowledge of data modelling, ETL processes, and data warehousing best practices.

What We Offer:

• Competitive salary and benefits package.
• Opportunity to work in a fast-growing, profitable company with a global reach.
• Collaborative and innovative work environment.
• Autonomy and trust to shape the future of our data infrastructure.
• The chance to make a significant impact on the consumer debt recovery industry.