Deskripsi Pekerjaan
Are you a passionate Data Engineer looking to leverage your expertise in monitoring and data streaming technologies? HTC Global Services is seeking a highly skilled and motivated Data Engineer to join our dynamic team in Jakarta Pusat. In this role, you will play a pivotal part in building robust data pipelines, optimizing real-time monitoring solutions, and ensuring data integrity across our enterprise architecture.
As part of our data engineering team, you will collaborate with cross-functional stakeholders to design and implement high-performance solutions using Grafana for observability and Kafka for distributed data streaming. If you thrive in fast-paced environments and have a strong foundation in SQL-based data management, we want to hear from you. This contract position offers a unique opportunity to work on cutting-edge projects and advance your career in a globally recognized IT services firm.
Tanggung Jawab
- Design, develop, and maintain high-throughput data pipelines using Apache Kafka.
- Implement and configure Grafana dashboards to monitor system health and data performance metrics.
- Develop and optimize complex SQL queries for data extraction, transformation, and loading (ETL) processes.
- Manage Kafka CDC (Change Data Capture) connectors to ensure seamless data integration.
- Troubleshoot data latency and system performance issues to ensure operational excellence.
- Collaborate with infrastructure and DevOps teams to ensure scalable and reliable data architecture.
- Document technical workflows and data mapping specifications for continuous improvement.
Kualifikasi
- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Minimum of 2-3 years of experience in data engineering, backend development, or system monitoring roles.
- Proficiency in Kafka architecture, including setting up topics, producers, and consumers.
- Hands-on experience with Grafana or similar monitoring and visualization tools.
- Advanced SQL skills (PostgreSQL, MySQL, or SQL Server) with a focus on query optimization.
- Experience with Change Data Capture (CDC) mechanisms in real-time environments.
- Strong analytical and problem-solving skills with an ability to work under tight project deadlines.
- Excellent communication skills with the ability to translate technical requirements into actionable solutions.