Technical Lead - Data Engineering (hybrid/remote)

Who we are 

GroupBy's cloud-native SaaS technology powers the world's most relevant and highly converting eCommerce websites. Our composable Product Discovery Platform powered by Google Cloud Discovery AI, provides industry-leading features for data enrichment, search, recommendations, navigation, personalization, merchandising and search analytics and much more! GroupBy’s next-generation Product Discovery Platform creates seamless eCommerce experiences optimized for business outcomes, including revenue, margin, and profit. In late 2021, we kicked off our exciting partnership with Google Cloud making GroupBy a provider of choice for site search and recommendations and allowing us to expand globally while raising our business to new heights. Today, GroupBy is recognized for its success enhancing large-scale, complex B2B and B2C eCommerce configurations.

While we have numerous accolades, we would like to highlight that Groupby was honored with a spot on LinkedIn Top Startups 2018: The 25 most sought-after startups in Canada LinkedIn Top 25.  In October 2022, GroupBy received the Gold Merit Award for Technology beating out Amazon in the same category.

Do you thrive in a diverse and exciting environment that’s continuously evolving? Join our team and find out why GroupBy is such a great place to work!

GroupBy is looking for a Technical Lead for our Data Engineering team, with the authorization to work in Canada or the United States. You'll be responsible for working with the product team in designing solutions to collect ingest and process data from various sources as well as building and optimizing our Analytics solution and infrastructure in Google Cloud Platform for implementation by our engineering team. GroupBy's data infrastructure is used across the business including analytics microservices, as well as billing, reporting, and R&D projects.

Responsibilities

• Owning the technical solution in regards to the services, applications and architecture under your technical domain
• Work closely with other product and engineering team stakeholders to ensure that engineering solutions meet product requirements as well as uphold existing standards with an eye to the future
• Maintain and keep up to date and execute an architecture roadmap with a focus on technological improvements and paying off tech debt
• Use Google Cloud Platform’s managed data services (Dataflow, Bigtable, PubSub, BigQuery) and modern cloud technologies like Kubernetes to deploy a data pipeline infrastructure that is efficient, reliable and flexible
• Design automated systems to monitoring data quality and pipeline efficiency
• Research and build efficient data warehousing solutions with backfilling capability
• Developing microservices to clean, validate and aggregate marketing data  in a multi-cluster Kubernetes environment
• Test Driven Development in an agile environment, building highly-scalable stateless stream-based data processing systems
• Work with the delivery and engineering team to ensure projects/solutions are feasible and delivered on-time
• Recommend development processes and best practices
• Ensure technical understanding and competency of GroupBy solution as it relates to product set
• Provide development knowledge, expertise and best practices and mentoring to other GroupBy developers

Skills you already have

• Excellent Communication skills, you will work cross-functionally across multiple teams
• Experience leading a team of developers to execute your technical designs to completion
• Aptitude to independently learn new practices and technologies as well as prototype proposed software designs
• High level of proficiency in SQL
• Familiarity with the following concepts: Cloud computing, Event driven Architecture, Distributed Systems, asynchronous data collection
• Some experience in the following technologies: Kubernetes, SQL (big data), Airflow
• Experience in at least 1 (one) or more of the following languages: Java, Go, NodeJS, Typescript, python

Nice to have

• Experience working in a startup
• SAAS experience preferred but not required
• Cloud Native development experience (GCP preferred but not required)
• Experience working with GCP, AWS or Azure
• Experience with client-side data collecting
• Knowledge of Microservices Architecture
• Knowledge of distributed message queue technologies such as PubSub or Kafka
• Knowledge of iOS and Android systems