Data Engineer

Magic Crystal Limited-company-logo
Data Engineer
Magic Crystal Limited
Software Engineer
Yau Tsim Mong, Hong Kong
7 days ago
Full Time
Onsite
Information Technology and Services
Job Description
148 days ago

Job Descriptions:

  • Define the architecture of the Measurable AI Analytics platform.

  • Build a robust and scalable data foundation, from logging to streaming pipelines, data filtering, and email parsing.

  • Implement our data stack using modern technologies such as Apache Spark, Kafka, HDFS, and Cassandra.

  • Optimize our data pipelines and establish best practices for table schemas, data models, and data storage.

  • Build efficient solutions on top of AWS and Azure using Python, Scala, and Go.

Requirements:

  • Minimum of 1 year of experience in building backend systems.

  • BSc in Computer Science, Electronic Engineering, Mathematics, or a related field.

  • Solid knowledge of Golang, Python, or Java.

  • Solid knowledge of MySQL or MongoDB.

  • Experience working with popular cloud solutions such as AWS, Azure, or GCP.

  • Knowledge of Docker and Kubernetes.

  • Enthusiasm for working with high-volume heterogeneous data and distributed systems.

Bonus Points:

  • Experience working on and deploying large-scale systems.

  • Experience with Hadoop, Cassandra, Kafka, MongoDB, Redis, or MySQL.

  • Server-side shell scripting experience.

Share to
More jobs like this
Innocorn Technology Limited-company-logo
Software Engineer
Innocorn Technology Limited
Wan Chai, Hong Kong
YAICHI-company-logo
Backend Software Engineer
YAICHI
Eastern, Hong Kong
OmniWe Limited-company-logo
JavaScript Backend Developer
OmniWe Limited
Tsuen Wan, Hong Kong
JFE Consulting Limited-company-logo
Artificial Intelligence (AI) & Machine Learning Architect (HKD 60K-70K)
JFE Consulting Limited
Central and Western, Hong Kong