logo inner

Software Engineer, Infrastructure Data Plane

AnyscaleSan Francisco, California, United StatesHybrid, Onsite
This job is no longer open
About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.Anyscale is based in San Francisco, CA.

Employees are required to come in office 3x a week.

About the role


Anyscale is looking for a Software Engineer to join the Infrastructure Data Plane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Data Plane team, we build the scalable, secure, and robust backbone to realize this vision. We are seeking a talented Software Engineer with a strong background in data plane development and expertise in container technologies.

As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing data plane solutions that power our cutting-edge products. You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.

As part of your role, you will


  • Design and develop components to manage Ray applications and auxiliary containers running on the data plane
  • Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
  • Implement and maintain accelerator support
  • Manage and optimize storage, networking, and security aspects of the data plane
  • Handle dependencies and container image management
  • Participate in code reviews, design discussions, and architecture planning sessions
  • Provide on-call support and collaborate with customer and field teams to troubleshoot data plane issues
  • Work with a team of leading distributed systems and machine learning experts

We'd love to hear from you if you have


  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Hands-on experience building high-performance distributed systems at scale
  • Proficiency in Go and Python
  • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
  • Comprehensive understanding of network protocols and associated tools
  • Ability to work independently and collaboratively in a fast-paced environment
  • Customer-focused mindset with excellent communication skills
  • Bonus
  • Master's degree in Computer Science or related technical field
  • Contributions to open-source projects in dataplane or container technologies
  • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and SpanishApply for this job

This job is no longer open

Life at Anyscale

We are building the future of software development.
Thrive Here & What We Value1. Datadriven approach to compensation2. Transparent and consistent compensation structure3. Equity and benefits offerings (stock options, healthcare plans, 401k retirement plan, wellness stipend, education stipend)4. Paid parental leave5. Flexible time off6. EVerify company7. Commute reimbursement8. Equal Opportunity Employer9. Support for employee wellbeing (healthcare premiums covered at 99%)10. Emphasis on worklife balance (in-office meals covered)
Your tracker settings

We use cookies and similar methods to recognize visitors and remember their preferences. We also use them to measure ad campaign effectiveness, target ads and analyze site traffic. To learn more about these methods, including how to disable them, view our Cookie Policy or Privacy Policy.

By tapping `Accept`, you consent to the use of these methods by us and third parties. You can always change your tracker preferences by visiting our Cookie Policy.

logo innerThatStartupJob
Discover the best startup and their job positions, all in one place.
Copyright © 2024