Deskripsi Pekerjaan
AlpSoft Technologies Pte Ltd is seeking a highly skilled and motivated Data Engineer to join our dynamic team, focusing on a critical government project in Singapore. This is an exceptional opportunity to leverage your expertise in building robust, scalable data solutions that directly impact public sector initiatives.
As a Data Engineer on this pivotal project, you will be instrumental in designing, developing, and maintaining complex data pipelines. You will transform raw data into actionable insights, ensuring data quality and availability for various government applications. We're looking for someone with a strong background in Python and SQL, coupled with hands-on experience across the AWS ecosystem, particularly with Databricks for advanced analytics and processing, and a keen understanding of GIS technologies for geospatial data integration.
You will collaborate closely with data scientists, analysts, and project managers to understand data requirements and deliver high-performance data solutions. If you are passionate about data, enjoy tackling challenging problems, and are eager to contribute to meaningful national projects, AlpSoft Technologies offers a stimulating environment where your contributions will make a significant difference. Join us and shape the future of data-driven decision-making in Singapore's government sector.
Tanggung Jawab
- Design, develop, and maintain highly scalable and reliable data pipelines using Python and SQL.
- Implement efficient ETL/ELT processes on the AWS cloud platform to ingest, transform, and load diverse datasets.
- Utilize Databricks for large-scale data processing, analytics, and orchestrating machine learning workflows.
- Integrate and manage geospatial data (GIS) effectively, supporting location-based intelligence and analysis.
- Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and provide data solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle.
- Optimize existing data architecture for performance, cost-efficiency, and scalability.
- Troubleshoot and resolve data-related issues, ensuring minimal disruption to data services.
Kualifikasi
- Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
- Minimum 3 years of professional experience as a Data Engineer or in a similar role.
- Strong proficiency in Python for data manipulation, scripting, and application development.
- Expertise in SQL for data querying, management, and optimization.
- Proven hands-on experience with AWS cloud services related to data (e.g., S3, Glue, Redshift, Lambda, Kinesis).
- Demonstrable experience with Databricks for big data processing and analytical workloads.
- Familiarity with GIS technologies and concepts, including working with geospatial data.
- Experience working on government or public sector projects is a significant advantage.
- Excellent problem-solving skills, attention to detail, and ability to work effectively in a team-oriented environment.