Data Platform Engineer

• The U.S. Government agencies we work with have contracts that require all personnel working on their corresponding contracts to have U.S. citizenship – do you meet this requirement?

Accrete is looking for a Data Platform Engineer who will play a critical role in designing, building, and maintaining our data platform to support the organization's data processing and analytics needs. You will collaborate with data engineers, data scientists, and other cross-functional teams to create scalable and efficient data solutions. The ideal candidate should have a strong background in data engineering, cloud technologies, and data architecture, along with a passion for innovation and problem-solving.

Accrete is an AI prime defense contractor with the U.S. government that creates AI software, enabling its customers to make better decisions, faster. Accrete is on a mission to create AI so powerful it amplifies human reasoning and enables enterprises to grow in previously unimaginable ways. Prior to launching Accrete in 2017, Prashant Bhuyan, Accrete’s Founder and CEO, spent over a decade in high-frequency trading where he and a core team experimented with and developed AI technology that ultimately became the early underpinnings of Accrete.

Accrete’s solutions enable the Department of Defense to predict covert behavior from foreign adversaries seeking to influence the supply chain; the U.S. Air Force to identify vulnerabilities in microprocessor firmware; major music labels to identify superstars before competitors; auto dealers to automatically generate marketing content from vehicle feature lists; employee benefits brokers to identify the shortest path to the hottest leads; and more.

To learn more about Accrete, please visit our website: Accrete.ai

Responsibilities:

• Lead the design and development of our data platform to support the ingestion, organization, and retrieval of data.
• Work closely with stakeholders to ensure the timely arrival of data that is prepared for downstream use.
• Operate and maintain technologies associated with the platform.
• Optimize data storage and retrieval strategies, ensuring data availability, consistency, and reliability.
• Implement data governance and data security practices to protect sensitive data and ensure compliance with regulatory requirements.
• Develop and maintain data platform documentation, including data models, data dictionaries, and system architecture.
• Conduct performance tuning and optimization of data processing workflows for enhanced efficiency and scalability.
• Stay up-to-date with emerging data technologies, industry trends, and best practices, and evaluate their potential to enhance our data platform.
• Mentor and provide guidance to junior data engineers, fostering a culture of knowledge sharing and skill development.

Requirements:

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• 2-3+ years of experience in data engineering and data platform development.
• Proven expertise in designing and building scalable data platforms, data warehouses, and data lakes.
• Strong proficiency in data modeling, ETL processes, and data integration techniques.
• Extensive experience with cloud platforms such as AWS, Azure, or Google Cloud, and cloud-based data services.
• Proficiency in programming languages commonly used in data engineering, such as Python, Java, Rust, C, or Go.
• Familiarity with data governance, data security, and data compliance practices.
• Operational knowledge of common data systems like: Kafka, Airflow, Spark, Trino, Ranger.
• Knowledge of containerization technologies, such as Docker and Kubernetes, for data platform deployment.
• Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data issues.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.
• A proactive and self-driven approach to learning and staying updated with evolving data technologies and tools.

The base salary range for this role is $145,000 to 160,000.

Benefits:

We offer a competitive salary, benefits package, and opportunities for growth and advancement within the company. If you are an innovative and results-driven leader, we encourage you to apply for this exciting opportunity.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.