Data Engineer

Qupital Limited
刊登於 2024-04-03

不指定
0年工作經驗

職位描述

Responsibilities:

  • Design, build, and maintain efficient data pipelines to move and transform data from various sources to our data warehouse.
  • Develop and maintain ETL processes to ensure high-quality and reliable data for analysis.
  • Collaborate with data scientists and analysts to understand data requirements and implement solutions to support their work.
  • Optimize and tune data pipelines for performance and reliability.
  • Work closely with the Engineering team to ensure the scalability and reliability of our data infrastructure.
  • Stay up-to-date with the latest trends and technologies in data engineering and recommend best practices to improve our data processes.


Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in Python and experience with SQL.
  • Experience building and maintaining data pipelines using tools like Apache Airflow, Apache Spark, or similar technologies.
  • Knowledge of data warehousing concepts and experience with related technologies such as Amazon Redshift, Google BigQuery, or Snowflake.
  • Familiarity with big data technologies such as Hadoop, Hive, or Spark.
  • Experience working in an Agile environment and using version control systems like Git.
  • Excellent problem-solving and communication skills.
  • Experience with AWS services such as S3, EC2, Redshift, or EMR is a plus.

All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.


工作種類
工作地區 不指定
教育程度
學士
技能 Python / 溝通能力
受僱形式 全職
行業 資訊科技 / 電子商務

有關招聘公司
Qupital Limited
We are currently looking for an Analyst, Credit Administration to join our credit team. Great working culture and attractive remuneration are provided.