Deskripsi Pekerjaan
Are you ready to drive data innovation at the highest level? Lean Solutions Group is seeking a talented Senior Data Engineer to join our dynamic team in Makati City. As a Senior Data Engineer, you will play a pivotal role in architecting robust data pipelines and transforming raw data into actionable business intelligence. We are looking for someone who is passionate about scalability, efficiency, and solving complex data challenges. You will collaborate closely with cross-functional teams to design and implement data architectures that support our growing organization's strategic goals. If you have a strong background in data engineering and want to make a tangible impact on the data landscape, we want to hear from you.
Tanggung Jawab
- Design, build, and maintain scalable data pipelines and ETL processes to ensure seamless data flow.
- Collaborate with data scientists and business analysts to support complex data warehousing and BI initiatives.
- Optimize data storage solutions using SQL, NoSQL, and cloud-based data warehouses (e.g., Snowflake, BigQuery).
- Ensure high data quality, accuracy, and integrity across all systems through rigorous testing and validation.
- Implement and monitor real-time data streaming architectures for live analytics.
- Develop and optimize SQL queries and data models to improve query performance and reduce latency.
- Conduct root cause analysis to identify and resolve data discrepancies or system bottlenecks.
Kualifikasi
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Proven experience (5+ years) as a Senior Data Engineer or similar role.
- Strong proficiency in Python, SQL, and data modeling concepts.
- Experience with cloud platforms such as AWS, Google Cloud Platform (GCP), or Azure.
- Deep understanding of Big Data technologies including Apache Spark, Hadoop, or Kafka.
- Familiarity with data versioning tools (e.g., DVC) and CI/CD pipelines for data.
- Excellent problem-solving skills, attention to detail, and the ability to communicate complex technical concepts to non-technical stakeholders.