Deskripsi Pekerjaan
Are you a hands-on engineer who prefers shipping high-impact data pipelines over drafting endless strategy decks? PIXELATE EVERYTHING is looking for a driven Data Engineer to join our team in Bandar Puteri Puchong. In this role, you will be the backbone of our data infrastructure, focusing on real-time streaming architectures that power our decision-making capabilities.
We value autonomy, technical craftsmanship, and the ability to solve complex problems at scale. You won't just be maintaining legacy systems; you will be building, optimizing, and deploying high-velocity pipelines that directly impact our product performance. If you are passionate about data engineering best practices and want to work in an environment where your code makes a tangible difference, we want to talk to you.
Tanggung Jawab
- Design, build, and maintain robust real-time data streaming pipelines.
- Collaborate with cross-functional teams to integrate disparate data sources into a unified data lake.
- Optimize existing ETL/ELT processes for performance, scalability, and reliability.
- Ensure data quality and integrity across the entire ingestion and transformation lifecycle.
- Proactively identify and resolve bottlenecks in data processing workflows.
- Document technical specifications and maintain clear architecture diagrams.
- Mentor junior team members on coding standards and distributed systems concepts.
Kualifikasi
- Bachelor’s degree in Computer Science, Data Engineering, or a related technical field.
- Proven experience (3+ years) in building and managing streaming data pipelines using technologies like Apache Kafka, Flink, or Spark Streaming.
- Strong proficiency in Python, Scala, or Java.
- Solid understanding of SQL and NoSQL database systems (e.g., PostgreSQL, MongoDB, Cassandra).
- Experience with cloud platforms (AWS, GCP, or Azure) and containerization tools like Docker/Kubernetes.
- Familiarity with CI/CD practices and version control (Git).
- Exceptional problem-solving skills and the ability to thrive in an autonomous, fast-paced environment.