Lead Data Engineer

Open Architects (OA) seeks a Lead Data Engineer to strategically enhance our ETL processes and data connectors, enabling reliable, sustainable, and scalable integration with diverse data systems. Reporting directly to OA’s Director of Technology, you will guide the development of our data engineering strategy, drive key architectural decisions, and build pipelines to extract customer data. Our ideal candidate is an experienced Python developer with a complementary DevOps skillset that allows them to make informed decisions. OA supports school districts, municipalities, and education non-profits with custom-built visualizations and data tools that empower leaders to make informed decisions. In our ninth year, OA provides a collaborative and inclusive environment driven by a deep commitment to our clients and the students they serve, and we eagerly get into the trenches to help solve our clients’ problems. We are also a learning organization that embraces the messiness of the work and has fun along the way. We take our work seriously but not ourselves. Role & Responsibilities

• Lead and implement strategic improvements to OA’s ETL infrastructure and processes.
• Build and maintain robust data connectors to dozens of systems, ensuring reliability, scalability, and sustainability.
• Monitor data pipeline performance, proactively troubleshooting and resolving issues to maintain data integrity and system uptime.
• Collaborate with district IT departments to address and resolve technical issues beyond client service capabilities.
• Develop internal documentation, guidelines, and best practices to support growth and onboarding.
• Influence platform and technology decisions to improve pipeline resilience and transparency.

Qualifications

Required Technical Skills and Experience

• 4+ years of experience as a data engineer with Python as the primary programming language
• Strong DevOps skills in a Linux environment, including CI/CD, Git, and containerization tools such as Docker
• Experience with data pipeline orchestration and management technologies (e.g., Docker, Airflow, Kubernetes)
• Proven ability to establish and document technical standards and operational best practices.
• Bachelor’s degree required

Required Personal Skills and Experience

• Highly self-motivated and able to structure independent work effectively in a fully remote environment.
• Exceptional communication skills, capable of translating complex technical concepts clearly for internal stakeholders and clients.
• Enthusiastic collaborator, comfortable working within a flexible and flat organizational structure.
• Commitment to maintaining strict confidentiality and ethical standards when handling sensitive client data.
• Experience effectively engaging with diverse stakeholders, especially education and municipal leaders.

Preferred Skills and Experience

• Familiarity with educational technology (EdTech) or experience working with student data systems.
• Availability during standard U.S. Eastern Time business hours.