Apache Spark Committer
At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Apache Spark Committer at BairesDev As an Apache Spark Committer, you will be a key contributor to the upstream Spark codebase, focusing on the evolution of high-performance query engine internals. You will act as a steward for the open-source community, balancing enterprise-grade performance requirements with the architectural integrity of the Spark ecosystem.
What You'll Do
• Contribute high-quality code to core Spark components, specifically focusing on query planners and the Catalyst optimizer.
• Perform rigorous code reviews for community pull requests to ensure maintainability, documentation quality, and API stability.
• Design and implement advanced vectorized execution paths and columnar processing features to enhance engine throughput.
• Collaborate with the Apache Software Foundation and global maintainers to define the technical roadmap for Spark's distributed computing engine.
• Monitor project health by resolving critical bugs and identifying performance bottlenecks in large-scale data processing workflows.
• Mentor new contributors and participate in community governance, including voting on releases and major architectural proposals. What We Are Looking For
• 4+ years of experience in Software Engineering with a focus on systems programming or big data internals.
• Proven expertise in contributing to the Apache Spark codebase or other high-performance query engines.
• Advanced proficiency in Java or C++ and deep understanding of query engine internals like Spark Catalyst.
• Hands-on experience with columnar storage formats such as Parquet or Iceberg and execution engines.
• Strong background in designing query planners, optimizers, and vectorized execution paths.
• Advanced proficiency in English. How we do make your work (and your life) easier:
• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Join a global team where your unique talents can truly thrive and make a significant impact Apply now
What You'll Do
• Contribute high-quality code to core Spark components, specifically focusing on query planners and the Catalyst optimizer.
• Perform rigorous code reviews for community pull requests to ensure maintainability, documentation quality, and API stability.
• Design and implement advanced vectorized execution paths and columnar processing features to enhance engine throughput.
• Collaborate with the Apache Software Foundation and global maintainers to define the technical roadmap for Spark's distributed computing engine.
• Monitor project health by resolving critical bugs and identifying performance bottlenecks in large-scale data processing workflows.
• Mentor new contributors and participate in community governance, including voting on releases and major architectural proposals. What We Are Looking For
• 4+ years of experience in Software Engineering with a focus on systems programming or big data internals.
• Proven expertise in contributing to the Apache Spark codebase or other high-performance query engines.
• Advanced proficiency in Java or C++ and deep understanding of query engine internals like Spark Catalyst.
• Hands-on experience with columnar storage formats such as Parquet or Iceberg and execution engines.
• Strong background in designing query planners, optimizers, and vectorized execution paths.
• Advanced proficiency in English. How we do make your work (and your life) easier:
• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Join a global team where your unique talents can truly thrive and make a significant impact Apply now