Data Engineer
- אזור המרכז
- משרה קבועה
- משרה מלאה
- Pipeline Development: Design, build, and optimize complex, scalable, and robust data pipelines to ingest data from multiple sources into our data warehouse and feature store.
- Data Transformation & Normalization: Work with both structured and unstructured data to unify, normalize, and aggregate datasets, ensuring validity, accuracy, consistency, and readiness for analysis and model development.
- ML Preprocessing Pipeline: Collaborate with data scientists to create sophisticated preprocessing pipelines, handling the nuances of feature engineering, and preparing data for machine learning models.
- Data Quality & Integrity: Implement advanced data validation techniques beyond simple checks, focusing on detecting and addressing anomalies, data drift, and ensuring data integrity across various sources.
- Strong Business Understanding: Bring a business intelligence mindset to understand the context and significance of each data point, working closely with BI stakeholders to translate business needs into technical solutions.
- Collaboration: Collaborate effectively with data scientists, analysts, and business stakeholders to ensure alignment on data requirements, quality standards, and project goals.
- B.Sc degree in Computer Science or a related technical field or equivalent practical experience
- 3+ years of experience in a data engineering role
- Coding experience with Python
- Experience with SQL databases
- Experience with data modeling, data warehousing, and building ELT/ETL pipelines
- Experience with AWS cloud and infrastructure as code
- Experience building data pipelines with big data frameworks such as Spark, Hadoop, etc.
- Experience working with BI teams, business context and implications
- Experience working closely with data scientists / on a data science projects
- Technologically diverse background and ability/willingness to learn quickly
- רקע בכתיבת sql server ברמה טובה מאד! ...
Mploy