Data Engineer/Data Engineer Team Lead
- ירושלים
- משרה קבועה
- משרה מלאה
Willingness to work in a high-pace environment: proactive, adaptable, and focused on delivering results
Ability to act under pressure and navigate complex scenarios with clear decision-making and leadership
Ability to guide and mentor engineers
Strong familiarity with agile methodologies (e.g., Scrum or Kanban), including sprint planning, retrospectives, backlog management, and continuous improvement
Excellent collaboration skills, with the ability to work cross-functionally with product managers, engineers, DevOps, and CS team
architecture and system design, with a focus on scalability, maintainability and monitoring
Practical experience designing, developing, and maintaining distributed real-time and batch processing pipelines using tools like Kafka, Spark, Airflow and Apache Storm, along with a strong understanding of the operational aspects of running these pipelines in production
Hands-on experience working with cloud platforms (such as Azure, AWS), leveraging managed servicesדרישות:Principal Data Engineer5+ years of experience as a data engineer, with a focus on Python.
Proven experience with Apache Spark in production environments.
Strong experience in distributed backend systems , including pub-sub technologies using Python.
Deep understanding of AWS services such as S3, Lambda, EC2, EMR.
Solid understanding of data modeling, ETL processes, and data pipeline architecture.
Experience with containerization tools like Docker and orchestration tools like Kubernetes - an advantage.
Experience with front-end development using React.js - an advantage.
Previous work in data-centric startups - an advantage.
Familiarity with DevOps tools and practices (e.g. IaC, monitoring, automation) - an advantage.היקף משרה: משרה מלאהקוד משרה: JB-00562
ג'ובנט