Data Engineer
- לוד
- משרה קבועה
- משרה מלאה
- Ingest, process, and analyse large-scale datasets
- Work closely with Data Scientists to understand the data and generate insights
- Design and develop critical data pipelines in both Cloud and On-Prem environments
- At least 3 years of experience as a Data Engineer
- At least 3 years of experience with Python
- At least 3 years of experience with Object-Oriented Programming (OOP) languages
- Hands-on experience with Spark for Big Data processing
- Bachelor's degree in computer science, Engineering, Mathematics, or Statistics
- Experience working with Docker, Linux, CI/CD tools, and Kubernetes
- Experience with Data Pipeline tools such as Airflow or Kubeflow
- Understanding of Machine Learning concepts and processes
- At least 2 years of hands-on experience with AWS services (Athena, Glue, Step Function, EMR, Redshift, RDS)
- Deep understanding of designing, developing, and optimizing complex data solutions
- Experience working with different data partitions (Parquet, Avro, HDF5, Delta Lake)
- Familiarity with GenAI solutions and Prompt Engineering
- Initiative, independence, and strong team spirit
- Fast learning ability and strong analytical thinking
- Ability to work under pressure, high level of responsibility, and strong commitment
Mploy