Deskripsi Pekerjaan
We are seeking a skilled Data Engineer with expertise in Debezium to join our dynamic team at Lawencon International. This role is pivotal in designing, developing, and maintaining robust ETL processes that power our data-driven decision-making infrastructure. You'll leverage Debezium's change data capture capabilities to enable real-time data synchronization across heterogeneous systems, ensuring seamless data flow from source to destination. The ideal candidate will architect scalable data pipelines, optimize data warehouse performance, and collaborate with cross-functional teams to translate business requirements into technical solutions. This position offers the opportunity to work with cutting-edge technologies in a collaborative environment focused on innovation and excellence.
Tanggung Jawab
- Design and implement scalable ETL/ELT pipelines using Debezium for real-time change data capture
- Develop data transformation workflows to ensure data quality and consistency
- Optimize data warehouse performance through efficient data modeling and indexing strategies
- Monitor and troubleshoot data pipeline issues using observability tools
- Collaborate with data scientists and analysts to understand data requirements
- Automate data validation and testing processes to maintain pipeline integrity
- Document data architecture and processes for knowledge sharing
Kualifikasi
- Bachelor's degree in Computer Science, Information Technology, or related field
- 3+ years of experience in data engineering or ETL development
- Proven expertise with Debezium and Apache Kafka for change data capture
- Strong proficiency in SQL and relational database management
- Experience with cloud data platforms (AWS, Azure, or GCP)
- Familiarity with data orchestration tools (Airflow, Luigi, or Prefect)
- Knowledge of Python, Java, or Scala for data processing
- Experience with containerization (Docker/Kubernetes) a plus