Senior Data Engineer [up to RM 20k]

Randstad has partnered with a software solutions company, building innovative and reliable solutions for their clientele. Your future employers are building a tech team who are capable of keeping up with the latest technologies and aligned in building great solutions

Key Responsibilities

• Architecture: Design fault-tolerant, petabyte-scale distributed data architectures and define company-wide data governance standards.
• Streaming: Build high-throughput, low-latency streaming pipelines using Apache Kafka and stateful Apache Flink applications.
• Data Warehousing: Integrate diverse data streams into a centralized Cloud Data Warehouse while optimizing query performance and storage costs.
• Development: Write clean, production-grade pipeline code using Python and manage end-to-end data lifecycle orchestration.
• Optimization: Troubleshoot bottlenecks in distributed systems, ensuring high availability, system uptime, and cost ef...