Deskripsi Pekerjaan
Vertere Global Solutions is seeking a talented Data Engineer to join our innovative team in Makati City. In this pivotal role, you will be responsible for designing, building, and maintaining robust data pipelines that drive business intelligence and decision-making. We are looking for a professional who is passionate about data architecture and possesses deep expertise in modern data engineering tools.
Your primary focus will be on leveraging dbt (data build tool) to transform and model data, utilizing Argo Workflows for complex orchestration, and managing containerized environments with Kubernetes. You will collaborate closely with cross-functional teams to ensure data quality, accuracy, and scalability, ultimately delivering high-value insights to stakeholders.
As a Data Engineer at Vertere, you will play a key role in optimizing our data infrastructure, ensuring high availability, and implementing best practices for data governance. If you are ready to tackle complex challenges and contribute to a growing data-driven organization, we want to hear from you.
Tanggung Jawab
- Design and Implement Data Pipelines: Architect and build scalable ETL/ELT pipelines using dbt, Python, and SQL to support data warehousing initiatives.
- Workflow Orchestration: Manage and optimize complex data workflows using Argo Workflows to ensure seamless data processing and job scheduling.
- Kubernetes Management: Deploy, manage, and scale data applications and containers using Kubernetes in a cloud-native environment.
- Data Modeling & Transformation: Develop clean, reliable data models and perform transformations to ensure data integrity and consistency.
- Performance Optimization: Monitor pipeline performance and troubleshoot issues to ensure low latency and high throughput for data delivery.
- Collaboration: Work alongside data analysts and scientists to understand requirements and deliver data solutions that meet business needs.
- Documentation: Maintain comprehensive documentation for data pipelines, workflows, and infrastructure configurations.
Kualifikasi
- Experience: 3+ years of experience as a Data Engineer or similar role, with a strong focus on pipeline development.
- Tool Proficiency: Proven experience with dbt, Argo Workflows, and Kubernetes.
- Programming: Strong proficiency in Python and SQL, including complex querying and scripting.
- Education: Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Cloud & Linux: Solid understanding of Linux systems and cloud platforms (AWS/GCP/Azure) is a plus.
- Problem Solving: Excellent analytical and problem-solving skills with a keen attention to detail.
- Communication: Strong verbal and written communication skills in English.