Principal Engineer, Tableflow Architecture

Location: East Coast Region, United States Employment Type: Full-Time Location Type: Remote Department: Engineering Compensation: $274.5K - $329.4K - Offers Equity At Confluent, we are dedicated to not just creating cutting-edge technology but redefining data movement to unlock new possibilities. Our platform ensures that data flows in real-time, empowering companies to adapt swiftly, innovate intelligently, and offer truly engaging experiences. We seek individuals who challenge assumptions, provide constructive feedback, and support each other. This is a collaborative environment with no room for egos—just insightful, curious minds working towards a greater goal together. About the Role: As a Principal Engineer, you will take on a pivotal technical leadership role that shapes the architecture and reliability of the Tableflow project and the broader Confluent platform. In this position, you will concentrate on enhancing the multi-tenant, highly available compute infrastructure and the foundational components that manage table materialization and maintenance. Your leadership will span across critical initiatives, influencing engineering practices and product strategy while navigating through uncertainties and making impactful decisions. Your goal will be to ensure the availability and scalability of background storage tasks across all of Confluent Cloud. What You Will Do: Technical Strategy & Leadership: Develop and implement a robust technical strategy across vital systems, fostering long-term innovation for Tableflow's storage and metadata engines. Metadata Architecture & Lifecycle Management: Design and improve a high-performance metadata management system, ensuring quick updates and efficient query planning. Storage Engine Innovation: Create and execute forward-thinking strategies for large-scale table schematization, materialization, and compaction. Platform Engineering: Build and sustain a multi-tenant, highly reliable infrastructure for background compute tasks, ensuring the platform’s scalability and resilience. Architectural Excellence: Establish engineering standards and architectural frameworks that are embraced organization-wide. Cross-Functional Collaboration: Collaborate with executives, product management, and team leaders to ensure technical direction aligns with business goals. Mentorship & Culture: Guide senior engineers, nurturing the next generation of technical leaders and fostering a culture of engineering excellence. Open-Source & External Representation: Drive contributions to significant open-source projects and represent Confluent through technical discussions and thought leadership. What You Will Bring: Deep Expertise: Proven experience in leading the architecture and implementation of large-scale distributed storage systems. Distributed Systems Mastery: Extensive knowledge of principles like fault tolerance, consistency, scalability, and proficiency in cloud-native solutions. Strategic Influence: Skills to navigate complexities and forecast industry trends for future-facing system designs. Leadership Presence: Strong ability to influence executives and stakeholders, fostering collaboration across varied teams. Execution: Proven track record of translating high-level visions into meaningful technical solutions and successful delivery. What Gives You an Edge: Industry Leadership: Acknowledged thought leader through open-source contributions or published research. Advanced Domain Knowledge: Expertise in storage internals and large-scale data infrastructure suitable for mission-critical applications. Cloud Infrastructure: Extensive experience with public cloud environments (AWS, Azure, or GCP) including resource management and multi-tenancy. Ready to shape the future? Join us! Come As You Are Belonging is foundational here. We value diversity and the insights that arise from different perspectives. Together, we create an environment where everyone is encouraged to lead, grow, and challenge the status quo. We proudly maintain an equal opportunity workplace, ensuring that employment decisions are based solely on job-related criteria, unaffected by race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status, or any other classification protected by law.

Created: 2026-03-11