Senior Software Engineer - AI Benchmarking

רעננה
משרה קבועה
משרה מלאה

לפני 11 ימים

The Senior Software Engineer is responsible for designing, developing, and maintaining the large-scale software systems that power Red Hat's model benchmarking and validation workflows. Unlike a Machine Learning Engineer, whose primary focus is on model performance, accuracy evaluation, and ML experimentation, the Senior Software Engineer's focus is on building robust, scalable, and maintainable infrastructure that enables those evaluations to run efficiently at scale.This role combines deep expertise in distributed systems, automation, and cloud-native architecture with a strong command of modern engineering tools and frameworks used across the industry. The engineer is expected to design, implement, and contribute to open-source tools that integrate seamlessly with the AI benchmarking ecosystem, while staying at the forefront of emerging technologies and best practices.A core aspect of this position is developing a generic, highly scalable benchmarking platform designed to set the industry standard for AI model benchmarking. This requires exceptional software engineering quality, architectural foresight, and the ability to build systems that are flexible enough to support diverse use cases while remaining highly reliable and efficient in production environments.What You Will Do

Platform Architecture & Development: Lead the design and implementation of a modular, extensible, and cloud-native benchmarking platform capable of supporting large-scale AI model evaluations across diverse workloads and hardware.
Scalable Infrastructure: Build distributed systems optimized for high-throughput and low-latency execution of benchmarks, ensuring the platform can scale seamlessly to meet growing demands.
Open-Source Leadership: Design and contribute to open-source benchmarking and validation tools, fostering community adoption and influencing industry benchmarking standards.
Integration with AI Tooling: Develop robust APIs, services, and orchestration layers to connect the benchmarking platform with inference engines and downstream consumers such as AI Hub and observability platforms.
Workflow Automation: Implement advanced automation for scheduling, executing, and monitoring benchmarks using Kubernetes, OpenShift, and Argo Workflows.
Data Systems & APIs: Build reliable data pipelines for benchmark result ingestion, storage, querying, and integration with decision-support tools.
Performance & Reliability Engineering: Proactively identify and resolve system bottlenecks, optimize for resource efficiency, and ensure high availability.
Engineering Excellence: Apply industry-leading development practices, including automated testing, CI/CD, and rigorous code review, to maintain exceptional software quality.
Ecosystem Awareness: Maintain deep knowledge of the AI infrastructure and benchmarking ecosystem, tracking emerging frameworks, standards, and best practices to guide platform evolution.

What You Will Bring

Proficiency in Python for backend development, API integration, and data processing.
Hands-on experience with Kubernetes (Deployments, Services, Ingress).
Ability to create and maintain Helm charts.
Strong understanding of Docker for building and managing containers.
Experience with CI/CD pipelines (GitHub Actions or Jenkins).
Proficiency with Argo CD for workflow orchestration and GitOps.
Familiarity with model serving frameworks such as vLLM, TGI, or LMDeploy.
Experience with cloud platforms (AWS or GCP)
Knowledge of monitoring tools such as Prometheus, Grafana, or Streamlit.
Experience working with PostgreSQL and an ORM such as SQLAlchemy.

Nice to Have

Experience with Go for tooling and infrastructure development.
Familiarity with Argo Workflows for pipeline orchestration.
Experience with OpenShift or RHOAI.
Direct hands-on experience with cloud GPUs.
Knowledge of rollout event monitoring and advanced observability practices.
Familiarity with artifact and code security scanning tools (e.g., Trivy, Grype).
Experience with LLM benchmarking frameworks such as GuideLLM.

**About Red Hat** is the world's leading provider of enterprise software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to office-flex, to fully remote, depending on the requirements of their role. Red Hatters are encouraged to bring their best ideas, no matter their title or tenure. We're a leader in open source because of our open and inclusive environment. We hire creative, passionate people ready to contribute their ideas, help solve complex problems, and make an impact.**Inclusion at Red Hat**Red Hat's culture is built on the open source principles of transparency, collaboration, and inclusion, where the best ideas can come from anywhere and anyone. When this is realized, it empowers people from different backgrounds, perspectives, and experiences to come together to share ideas, challenge the status quo, and drive innovation. Our aspiration is that everyone experiences this culture with equal opportunity and access, and that all voices are not only heard but also celebrated. We hope you will join our celebration, and we welcome and encourage applicants from all the beautiful dimensions that compose our global village.**Equal Opportunity Policy (EEO)**Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.Red Hat does not seek or accept unsolicited resumes or CVs from recruitment agencies. We are not responsible for, and will not pay, any fees, commissions, or any other payment related to unsolicited resumes or CVs except as required in a written contract between Red Hat and the recruitment agency or party requesting payment of a fee.Red Hat supports individuals with disabilities and provides reasonable accommodations to job applicants. If you need assistance completing our online job application, email |** לפנייה למשרה יש להגיש מועמדות **|. General inquiries, such as those regarding the status of a job application, will not receive a reply.⚠הגש מועמדות באתר החברהמשרות דומות שיכולות לעניין אותך13/08/2025רעננהsenior devops team leadwe're looking for a hands-on technology leader to guide a small, highly skilled devops team, manage global-scale infrastructu...07/08/2025תל אביב, 13.91 ק"מ ממיקומךScala BiodesignSenior Software Engineer positionScala is developing an advanced computational platform for protein design to meet the rising demand for pro...24/07/2025תל אביב, 13.91 ק"מ ממיקומךPlus500™Web Software EngineerTel AvivDescriptionWhat to Expect - The RoleWe are looking for a highly motivated Web engineer spec...20/07/2025תל אביב, 13.91 ק"מ ממיקומךOptibusWe're seeking a skilled and experienced Team Lead Full Stack to guide our Ops Long-term Team. This role is ideal for someone with 7+ years of expe...09/08/2025תל אביב, 13.91 ק"מ ממיקומךGO4iTWe're looking for a Senior Software Engineer to join our growing R&D team.In this role, you will play a critical part in designing, building, an...19/07/2025רעננהNVIDIANVIDIA is seeking an exceptional Senior K8s Software Engineer to help design and build our next-generation cloud platforms. We're looking for a de...17/08/2025נתניה, 15.3 ק"מ ממיקומךחברת סליקה ופתרונות תשלומים לארגונים ועסקיםנוסח באנגלית מופיע למטה בשרשורמנהל/ת צוות שירות עסקי ושימור לקוחותCustomer Service & Retention Team Leader (B2B Clients)**נתניה | משרה מ...25/07/2025תל אביב, 13.91 ק"מ ממיקומךMend.io**Mend.io is seeking an innovative and experienced Senior Software Developer to join our Mend AI team. This team is pioneering a new wave of appli...08/08/2025תל אביב, 13.91 ק"מ ממיקומךStealth StartupWe're Hiring: Senior Backend Developer | Python • Infrastructure • LLM Agents • GamingA fast-growing AI-driven startup working with some of ...קצת עלינוMploy הוא לוח דרושים מבוסס AI, שנועד לסייע למחפשי עבודה ולמעסיקים כאחד, תוך יצירת פלטפורמה חדשנית, איכותית המובילה את שוק העבודה בישראל.אנו מאגדים משרות עדכניות מאלפי מקורות בארץ, ומנגישים אותן ביעילות באמצעות סוכן AI חכם שמתאים משרות רלוונטיות למועמדים ומאפשר הגשת מועמדות בלחיצת כפתור.הפלטפורמה שלנו מציעה התאמות משרות מבוססות בינה מלאכותית עם אחוז התאמה אישי, קבוצות WhatsApp ייעודיות לפי תחום, ואפליקציה מתקדמת שמאפשרת חיפוש ושליחת קורות חיים מכל מקום ובכל זמן.Mploy אצלכם בוואטסאפ✨ רוצים להתעדכן בכל המשרות הכי שוות ישר לנייד?הצטרפו לקבוצות הוואטסאפ שלנו וקבלו את כל ההצעות המתאימות - בלי לחפש, ובלי לפספס. מחכים לכם! 📱😊

Mploy

הגש מועמדות