Deskripsi Pekerjaan
Are you ready to architect the infrastructure that powers one of the world's largest online ecosystems? Join the Data Platform team at ByteDance as a Big Data Engineer for the Libra platform. Libra is our large-scale, online, one-stop A/B testing platform, designed to accelerate data-driven decision-making across the organization.
In this role, you will be responsible for designing and implementing robust data pipelines that handle massive traffic volumes with low latency and high reliability. You will work in a collaborative environment where your code directly impacts the way we measure product success and optimize user experiences globally.
- Architect and maintain scalable data processing systems for A/B testing infrastructure.
- Optimize query performance and data storage strategies to support real-time experimentation.
- Collaborate closely with product managers, data scientists, and backend engineers to deliver high-quality features.
- Implement and monitor observability tools to ensure system health and data integrity.
- Contribute to the continuous improvement of the Libra platform's architecture and reliability.
Join us to build the future of data experimentation at a scale that few can match.
Tanggung Jawab
- Design, develop, and maintain large-scale ETL pipelines and data warehouses for the Libra platform.
- Optimize data processing jobs to ensure high throughput and low latency for online experiments.
- Build and maintain robust APIs and microservices to support frontend data visualization and reporting.
- Collaborate with cross-functional teams to define data requirements and experiment scopes.
- Implement automated testing and CI/CD practices to ensure code quality.
- Investigate and resolve complex technical issues in distributed systems and data architectures.
- Conduct code reviews and mentor junior engineers within the Data Platform team.
Kualifikasi
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- 5+ years of professional experience in software engineering or data engineering.
- Strong proficiency in programming languages such as Java, Scala, Python, or Go.
- Deep experience with Big Data frameworks (Spark, Hadoop, Flink, Kafka).
- Strong knowledge of SQL and NoSQL databases (e.g., MySQL, HBase, Cassandra).
- Familiarity with distributed systems, caching technologies, and message queues.
- Experience working with A/B testing platforms or experimentation frameworks is highly desirable.
- Excellent problem-solving skills and the ability to thrive in a fast-paced, agile environment.