Data and AI Engineer
- תל אביב
- זמנית
- משרה מלאה
- Design and develop robust, scalable data pipelines for batch and real-time processing
- across multiple sources and formats
- Build internal Python packages and REST APIs to support data science and ML
- teams
- Lead the implementation of CI/CD pipelines and automated monitoring processes
- Integrate structured and unstructured data sources, both relational and NoSQL
- Collaborate cross-functionally to deliver reusable infrastructure and ensure smooth
- deployment to production
- Contribute to the integration of cutting-edge AI/ML tools and APIs (e.g., AWS Bedrock ,OpenAI, HuggingFace)
- 6+ years of developing experience with Python
- 4+ years of experience with Git/Gitlab and Jenkins
- 3+ years of Rest API development including fast API
- 2+ years of working experience with containers, Kubernetes, openShift
- 3+ years of coding with SQL and query optimization in MS-SQL/MySQL/Postgres etc.
- 2+ years of working experience with NoSQL database such as Hbase, mongoDB or Cassandra.
- 2+ year experience with Hadoop ecosystem components: HDFS, Hive, Spark
- Kafka or other messaging queues - advantage
- 2+ years of experience with Shell scripts - advantage
- 2-5 years of experience in applied AI/ML or AI solution integration.
- Experience with AWS services and AI services - s3 , aws bedrock , aws transcribe
- Experience using OpenAI / Azure OpenAI / HuggingFace APIs
Mploy