Data Engineer

Magic Crystal Limited-company-logo
Data Engineer
Magic Crystal Limited
Software Engineer
Yau Tsim Mong, Hong Kong
7 days ago
Full Time
Onsite
Information Technology and Services
Job Description
48 days ago

Job Descriptions:

  • Define the architecture of the Measurable AI Analytics platform.

  • Build a robust and scalable data foundation, from logging to streaming pipelines, data filtering, and email parsing.

  • Implement our data stack using modern technologies such as Apache Spark, Kafka, HDFS, and Cassandra.

  • Optimize our data pipelines and establish best practices for table schemas, data models, and data storage.

  • Build efficient solutions on top of AWS and Azure using Python, Scala, and Go.

Requirements:

  • Minimum of 1 year of experience in building backend systems.

  • BSc in Computer Science, Electronic Engineering, Mathematics, or a related field.

  • Solid knowledge of Golang, Python, or Java.

  • Solid knowledge of MySQL or MongoDB.

  • Experience working with popular cloud solutions such as AWS, Azure, or GCP.

  • Knowledge of Docker and Kubernetes.

  • Enthusiasm for working with high-volume heterogeneous data and distributed systems.

Bonus Points:

  • Experience working on and deploying large-scale systems.

  • Experience with Hadoop, Cassandra, Kafka, MongoDB, Redis, or MySQL.

  • Server-side shell scripting experience.

Share to
More jobs like this
Starnet Ai Limited-company-logo
Data Engineer
Starnet Ai Limited
Central and Western, Hong Kong
Fase Technology Group Ltd.-company-logo
Data Engineer(Summer Internship)
Fase Technology Group Ltd.
Central and Western, Hong Kong
Innocorn Technology Limited-company-logo
Software Engineer
Innocorn Technology Limited
Wan Chai, Hong Kong
Retail Full Technology Company Limited-company-logo
AI Engineer
Retail Full Technology Company Limited
Central and Western, Hong Kong
Logistics And Supply Chain Multitech R&D Centre Limited-company-logo
Programmer(Data Science)
Logistics And Supply Chain Multitech R&D Centre Limited
Central and Western, Hong Kong
Buyandship Limited-company-logo
Data Engineer
Buyandship Limited
Sham Shui Po, Hong Kong