Mô tả công việc
- Design, build, and maintain robust and scalable data integration pipelines (batch and streaming).
- Ensure data quality, integrity, and consistency across the organization.
- Collaborate with other team members to improve and optimize the data platform infrastructure.
- Implement and enforce data engineering best practices and standards.
- Mentor junior data engineers and contribute to knowledge sharing within the team.
- Troubleshoot and resolve data pipeline or infrastructure issues.
- Be a part of data driven initiative projects, communicate effectively with stakeholders across technical and business teams.
Yêu cầu
- Bachelor's degree in Computer Science, Data Science, or a relevant field.
- 4+ years of experience in data engineering.
- Proficient in building and optimizing ETL/ELT pipelines and designing data models.
- Strong experience with big data tools (Hadoop, Spark, Flink, Kafka, Airflow) and cloud platforms (AWS, GCP).
- Strong experience with SQL and relational databases (MySQL, PostgreSQL) and NoSQL databases.
- Solid programming skills in Python, Scala, Java or Golang.
- Knowledge of real-time data streaming and event-driven architectures.
- Strong experience with CI/CD tools and version control systems like Git.
- Experience with Kubernetes and on-prem systems is a plus.
- Good problem-solving, organizational, and communication skills.
#J-18808-Ljbffr