Deskripsi Pekerjaan
Join PERSOL as a Data Engineer (Databricks) and play a pivotal role in transforming how we leverage data to drive business decisions. In this position, you will be responsible for designing, building, and maintaining robust data infrastructure on AWS using Databricks and Informatica technologies.
You will work with large-scale data platforms, ensuring the seamless flow of data from various sources to data warehouses and data lakes. Your expertise will help create reliable, fast, and scalable data pipelines that enable our organization to make data-driven decisions quickly and efficiently.
If you are passionate about data engineering and have experience with cloud technologies, Databricks, and Informatica, we invite you to apply. This is an excellent opportunity to work with cutting-edge technologies and contribute to the digital transformation of our organization.
Tanggung Jawab
- Design, develop, and maintain large-scale data platforms on AWS using Databricks and Informatica
- Create and optimize data pipelines to ensure efficient and reliable data flow
- Collaborate with data scientists and analysts to understand data requirements
- Implement data quality checks and monitoring systems to ensure data integrity
- Optimize data storage and processing for performance and cost efficiency
- Stay updated with the latest data engineering technologies and best practices
- Document data architecture and processes for knowledge sharing
- Troubleshoot and resolve data pipeline issues in a timely manner
Kualifikasi
- Bachelor's degree in Computer Science, Information Technology, or related field
- 3+ years of experience in data engineering or similar roles
- Strong experience with AWS cloud services and data platforms
- Proficiency in Databricks and Informatica technologies
- Familiarity with SQL, Python, and other programming languages for data processing
- Experience with data warehousing concepts and ETL processes
- Knowledge of data modeling and database design principles
- Excellent problem-solving skills and attention to detail