Deskripsi Pekerjaan
Join Shopee's pioneering Data Infrastructure OLAP Team as a Senior Backend Engineer specializing in Milvus vector database technology. This critical role involves architecting, optimizing, and scaling our next-generation vector database infrastructure that powers Shopee's AI-driven services. You'll work at the intersection of distributed systems, machine learning, and high-performance data processing, ensuring our vector search capabilities meet the demands of millions of users. The position offers opportunities to contribute to open-source projects while solving complex challenges in data ingestion, low-latency querying, and system reliability. Collaborate with cross-functional teams to implement cutting-edge solutions that enhance product recommendations, search relevance, and personalization algorithms across Shopee's ecosystem.
Tanggung Jawab
- Design and implement high-performance vector database solutions using Milvus for large-scale AI applications
- Optimize system architecture for sub-millisecond query response times and high-throughput data ingestion
- Develop and maintain distributed data pipelines for real-time vector processing and storage
- Collaborate with ML teams to integrate vector search capabilities into production systems
- Implement robust monitoring, alerting, and auto-scaling mechanisms for database infrastructure
- Contribute to Milvus open-source community and evaluate emerging vector database technologies
- Lead troubleshooting and performance optimization for complex distributed systems
Kualifikasi
- Bachelor's degree in Computer Science/Engineering or equivalent with 5+ years backend development experience
- Expertise in C++ and/or Python with strong knowledge of distributed systems principles
- Proven experience with vector databases (Milvus, Pinecone, FAISS) or similar technologies
- Familiarity with OLAP databases, big data frameworks (Hadoop/Spark), and cloud infrastructure (AWS/GCP)
- Deep understanding of data structures, algorithms, and database internals
- Experience with performance profiling, debugging, and optimization of large-scale systems
- Strong problem-solving skills and ability to work effectively in agile environments