Data Engineer
Qupital Limited
刊登於 2024-04-03
不指定
0年工作經驗
職位亮點
職位描述
Responsibilities:
- Design, build, and maintain efficient data pipelines to move and transform data from various sources to our data warehouse.
- Develop and maintain ETL processes to ensure high-quality and reliable data for analysis.
- Collaborate with data scientists and analysts to understand data requirements and implement solutions to support their work.
- Optimize and tune data pipelines for performance and reliability.
- Work closely with the Engineering team to ensure the scalability and reliability of our data infrastructure.
- Stay up-to-date with the latest trends and technologies in data engineering and recommend best practices to improve our data processes.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or similar role.
- Strong programming skills in Python and experience with SQL.
- Experience building and maintaining data pipelines using tools like Apache Airflow, Apache Spark, or similar technologies.
- Knowledge of data warehousing concepts and experience with related technologies such as Amazon Redshift, Google BigQuery, or Snowflake.
- Familiarity with big data technologies such as Hadoop, Hive, or Spark.
- Experience working in an Agile environment and using version control systems like Git.
- Excellent problem-solving and communication skills.
- Experience with AWS services such as S3, EC2, Redshift, or EMR is a plus.
All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.
工作種類 | |
工作地區 | 不指定 |
教育程度 |
學士
|
技能 | Python / 溝通能力 |
受僱形式 | 全職 |
行業 | 資訊科技 / 電子商務 |
有關招聘公司
Qupital Limited
We are currently looking for an Analyst, Credit Administration to join our credit team. Great working culture and attractive remuneration are provided.