Software Engineer (Big Data) at Quantcast in San Francisco, CA

Summary: Quantcast is a leading company in advertising technology that revolutionizes how it works through AI-powered solutions. They are seeking a Software Engineer to join their Big Data Services team, focusing on building and optimizing large-scale data processing systems to support data science and engineering teams. Responsibilities: - Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks - Debug and resolve issues in distributed environments, including data inconsistencies and job failures - Maintain and enhance the services that support the distributed storage and compute platform - Assist in deploying and maintaining production systems, including CI/CD workflows - Work to make our platform more elastic and fault-tolerant - Provide technical input into roadmaps for the team - Write clean, maintainable, and well-tested code Required Qualifications: - BS in computer science or equivalent experience - 1-3 years of professional software engineering experience (internships included) - You must be work-authorized in the United States without the need for employer sponsorship - This is a hybrid role based in our San Francisco. To ensure a manageable commute for in-office days, candidates must reside within a 60-mile radius of San Francisco, CA. No relocation candidates at this time - Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar - Familiarity with containerization tools (e.g., Docker and Kubernetes) - Proficient in Java and/or Python programming languages - Linux system administration/automation experience - Strong problem-solving and debugging skills - Organized, detail-oriented personality Preferred Qualifications: - Experience with workflow orchestration tools (e.g., Airflow) is a plus Required Skills: Apache Spark, Hadoop, Distributed systems, Containerization, Docker, Kubernetes, Workflow orchestration, Airflow, Java, Python, Linux system administration, Data processing frameworks Benefits: Performance bonus, Equity, Comprehensive benefits package