Data Engineer / Senior Data Engineer

What You'll Deliver:

• Build/Maintain/Optimize robust ETL jobs and high-throughput pipelines for both streaming and batch data processing.
• Help to conquer complex engineering problems encountered within the data science and analytics domain.
• Develop and productionize data-driven product applications and API services in close collaboration with data scientists and analysts.
• Design and manage data schemas and structures across various database systems to ensure performance and integrity.
• Utilize and maintain modern orchestration tools (like Airflow) to manage complex data workflows.
• Implement containerization (Kubernetes) for deploying and scaling data services reliably.
• Promote and implement DataOps and foundational MLOps practices for automated deployment and monitoring of data services.
• Ensure data quality, governance, and security across all managed pipelines and platforms.
• Participate in code reviews and advocate for engineering best practices.
• Troubleshoot and resolve performance issues within the data platform and pipelines.

Who You Are:

• Proven professional experience as a Data Engineer or a similar role focused on data infrastructure.
• Expert-level proficiency in SQL and deep experience working with various databases (relational, NoSQL).
• Strong programming background and proficiency exclusively in Python.
• Hands-on experience with workflow orchestration tools, specifically Apache Airflow.
• Familiarity with containerization and orchestration technologies like Kubernetes.
• Experience in designing, implementing, and optimizing large-scale ETL pipelines (batch and streaming).
• Excellent communication skills in English and Cantonese (written and verbal), with the ability to collaborate effectively in a team environment in Hong Kong.
• Strong problem-solving, debugging, and analytical skills.
• Ability to write clean, maintainable, and well-documented code.