Data Engineering Manager

Engineering · Full-time · São Paulo, Brazil

Job description

We've been building since day one a diverse and ready to cross the oceans team and mindset with the most innovative professionals in their field. We are not only committed to delivering cutting-edge solutions to help our clients build their products. We want to promote change in how the world deals with financial services and impact millions of lives.

We are a Remote-first company, so yes, you can work pretty much from anywhere. But if you still need to go to the office every now and then, we currently have three offices located in Brazil (São Paulo), The USA (Austin), The UK (Bristol) and Singapore.

Investors

We are backed by some of the most prominent investment companies in the market, such as SoftBank, Amazon, Accel, B3, Falabella Ventures, Headline, PruVen and Redpoint eventures.

What you'll do

Our Data Engineering Manager will be accountable for developing with the team the state-of-art of our Data Pipelines both in Streaming and to our Data lake, improving practices and the Data stack to enhance Data Processing performance and Data related developer contribution standards. Some activities you will be involved with:

  • Conduct 1:1 with the team members reinforcing our culture of trust and diligence;
  • Development of Data Team's carrier in a global company;
  • Improvement of Data ETL/ELT using Spark and SQL Engines;
  • Improvement of DataStreaming stack adding more flexibility and performance;
  • Proposal and development of processes or changes to Software and Technological Architecture to evolve the Data Platform, reducing bottlenecks and enhancing its resilience, modularity, performance or scalability;
  • Coordination to manage incidents in production with your troubleshooting and problem-solving skills (like anyone in the team but with a Manager's perspective);
  • Agile methodologies and code review (as anyone in the team but with a Data Engineering focus);
  • Tutor engineers and organise complex cross-team initiatives related to your expertise.
  • Work and communicate clearly on multidisciplinary teams;

Minimum Qualifications

  • At least 3 years leading Data engineering teams;
  • At least 5 years of experience as a Data Engineer developing Data pipelines, Streaming and/or Batch, for ingestion and transformation (e.g. Spark, Flink, Kinesis and Serverless Lambdas);
  • Solid knowledge of SQL and at least one programming language. We work mostly with python, but java, scala, or golang are also possible:
  • Agile Software Development Practices (e.g. git, versioning, code review, );
  • Data Orchestration Managing Systems (e.g. Airflow, Prefect, Luigi or others);
  • Data Integration with SQL and non-SQL databases (eg; MySQL, DynamoDB, MongoDB, Cassandra, ElasticSearch, Redis);

Core Benefits

  • Remote work
  • Flexible hours
  • Gympass
  • Meal & Food vouchers
  • Remote work financial support
  • Life Insurance
  • Medical and Odontological Assistance
  • Employee child care benefit: daycare
  • Vidalink partnership
  • Day off (Birthday)
  • Support for studying languages
  • 50% off AWS and GCP certifications

Technologies that we apply in our day

  • Java, Groovy e Go
  • SQL / NoSQL
  • Git
  • Kafka
  • Spark
  • Serveless
  • Airflow
  • Cloud (AWS and Google)
  • Docker

Open roles at Pismo

Two candidates
The Org
helps you hire
great candidates
It takes less than ten minutes to set up your company page.
It’s free to use - try it out today.