Data Engineering Manager

About Roscommon Analytics:

Roscommon Analytics LLC is a fast-growing business that uses technology and analytics expertise to generate profits in the energy commodity markets, with a focus on power and natural gas. Since its inception in November 2016, Roscommon has had a single, “brand-name” institution as its financial partner. The firm has grown to over 100 employees and offices around the globe.

The firm commenced operating in the US Power and Congestion markets with its first trades in the Financial Transmission Rights market in April 2017. Growing that base in 2018 with the addition of Power basis trading on ICE and Nodal exchanges.  

2020 brought entry to the US Natural Gas and Weather markets, complementing our core power and basis strategies.  Beaufort Energy LLP was created in 2021 marking our entry to the European Markets enabling us to capitalize on global energy trading opportunities.  Quickly following in 2022, Beaufort expanded, adding offices in Berlin & Zug.  Roscommon Nordic Energy AB was also founded in 2022 headquartered in Stockholm with a focus on Nordic power markets.

In US markets, the major 2022 growth initiative was a Joint Venture in Spearmint Energy focused on renewable energy markets, developing utility-scale batteries, and leveraging Roscommon’s deep understanding of the Global Power Markets.  This venture is growing rapidly, with our first utility-scale battery (150 MW) coming online in Crane County, Texas, in late 2023 and over 1 GW in the development pipeline.  Our international expansion continues with the creation of PRIZM a quantitative trading platform that will initially focus on European markets and to later be leveraged globally.

Position Overview:

We are hiring an engineering manager to shape the strategy for the firm’s data platform and help build the software and systems needed to deliver enhanced capabilities. The data engineering team is responsible for building and maintaining our storage infrastructure and ETL processes. This team also serves as the owner for the data collected by all lines of business and supports the interface layer that delivers data for users and applications across the front, middle, and back office.

The data engineering manager will oversee the team and collaborate with others to ensure that standardized technologies are adopted across the firm. The position provides the opportunity to build out the foundational functionalities of our enterprise platform, which provides components utilized by applications throughout Roscommon, including web deployment and workflow orchestration. This is a hands-on role, and candidates should have experience supporting production code in cloud environments. A successful candidate in this position will drive the evolution of the firm’s technological capabilities, improve aspects of the development lifecycle, and maintain high engineering standards.

  

Responsibilities:

• Deliver the next iteration of our internal data platform
• Architect, develop, and maintain platform components
• Build infrastructure to make data sets accessible and useful
• Develop tools and processes for automated acquisition, validation, and organization of large volumes of structured and unstructured data from many sources
• Develop systems to improve and test data quality
• Support and educate team members on best practices in data engineering
• Serve as the lead code reviewer for the team
• Establish a strong engineering culture and high code quality standards
• Produce documentation for technical and non-technical audiences
• Provide leadership for the team by providing feedback on performance
• Manage data systems efficiently at scale through standardization, automation, testing, and monitoring
• Enforce standards for all phases of software development including source control and testing
• Work with business owners to regularly re-prioritize projects, while delivering both tactical and long-term objectives
• Develop well defined processes for integrating new technologies to meet both business and technical needs
• Drive the elimination of operational tasks through automation and self-service
• Drive efficient utilization of resources through metrics and reporting
• Architect, develop and maintain solutions for business teams and help them do the same

Required Qualifications:

• Strong background in software and data engineering (10+ years)
• Very strong Python knowledge including object-oriented programming (OOP)
• Broad knowledge and experience with relational databases (i.e. stored procedures, indexing, partitioning, table design, query optimization)
• Expertise with all aspects of SQL
• Experience with designing and implementing data pipelines for quality, ingestion, validation and related infrastructure
• Exposure to data warehouses (i.e. snowflake, redshift, big query)
• Working knowledge of cloud environments (preferably AWS, ideally exposure to both windows and Linux), including networking
• Experience with automation/orchestration platforms (Airflow)
• Extensive experience with version/source control systems (Git)
• Exposure to commodities and weather-related data including electricity, congestion, natural gas, oil, and emissions (ISOs, data vendors, governments).
• Experience working with large datasets
• Ability to execute independently, on a deadline, and under pressure
• Communication skills and project management experience
• Excellent troubleshooting and analytical skills
• Experience with data visualization and web user interfaces
• Familiarity with infrastructure as code (Terraform)
• Exceptional attention to detail
• Ability to understand unfamiliar code bases (multi and mono repo structure) and debug applications
• Experience managing a team of developers
• Experience designing and architecting libraries
• Consistent track record managing and balancing priorities across a diverse set of stakeholders and guiding them toward strategic solutions
• Some knowledge of derivative pricing, products, and markets