Data Engineer
- רמת גן
- משרה קבועה
- משרה מלאה
- Core Services: AWS Lambda (serverless ETL functions, event-driven processing), Step Functions (workflow orchestration, state management), SQS (message queuing, decoupled architectures, dead letter queues), S3 (data lake design, partitioning strategies, lifecycle management), Glue (data catalog, ETL development, schema evolution, data lineage), CloudWatch (monitoring), RDS(warehousing)
- Graph Databases: Relationship modeling, query optimization, integration with analytical workflows with Neptune
- Relational Databases: Advanced SQL optimization, indexing strategies, query performance analysis
- Python: Advanced proficiency with AWS SDK (boto3), pandas/numpy, data validation frameworks
- PySpark: Distributed processing, performance tuning, EMR integration, memory optimization
- SQL and OpenCypher: Complex analytical queries, window functions, performance tuning across multiple engines
- Pipeline Architecture: End-to-end design, dependency management, fault tolerance, scalability patterns
- Project Leadership: Drive complex data initiatives from requirements gathering through production deployment
- Stakeholder Engagement: Translate business requirements into technical solutions, manage expectations
- Knowledge Sharing: Actively mentor team members, conduct technical reviews, contribute to best practices
- Sprint Methodology: Thrive in iterative development cycles, participate actively in agile ceremonies
- Performance Optimization: Identify bottlenecks, optimize resource utilization, reduce processing costs
- Quality Ownership: Take personal responsibility for solution reliability, performance, and data accuracy
- Business Understanding: Demonstrate genuine curiosity about different business domains and their data challenges
- Proactive Improvement: Identify optimization opportunities and drive implementation without being asked
- Results Focus: Commit to measurable outcomes and follow through on deliverables consistently
- 4+ years hands-on data engineering experience with cloud-native solutions
- 2+ years production AWS experience building scalable data pipelines
- Proven track record of end-to-end project delivery in collaborative environments
- Experience with high-volume data processing (TB+ datasets, real-time streaming)
Mploy