Research Engineer, Reinforcement Learning

Target start date: Immediately. Relocation provided.

We are at the forefront of developing advanced humanoid robots designed for household use. Our mission is to create an abundant supply of labor via safe, intelligent humanoids. As we transition from R&D to full-scale manufacturing, we seek an experienced Research Engineer, Reinforcement Learning. We are currently seeking a highly skilled and motivated Research Engineer to join our team. Research Engineers in reinforcement learning are generalists who develop reinforcement learning algorithms for humanoid locomotion and manipulation policies. A typical day involves prototyping reinforcement learning algorithms or building distributed infrastructure for training and simulation. You will own the RL policies and train in both sim and real to bring capabilities to NEO. You will integrate and distill RL policies and data into foundation model training. You will work closely with other AI team members and also develop independently.

Why this job is exciting

• Your role on the team will be to build RL algorithms in simulation and real and integrate RL into the overall learning picture

• You will work across the AI stack and solve gaps in model training and inference

• We aim to (1) double the number of tasks the robot can perform and (2) half the error rate on existing tasks, quarter over quarter

• The team works closely together to prioritize direction and scale up a single approach to a production-ready system

Responsibilities

• Day to day: build RL algorithms to bring generalized capabilities to NEO

• Work with our robot operations team to scale up our datasets and model capabilities

Must-Haves

• Bachelor’s degree in Computer Science or equivalent

• 3+ years of professional, full-time experience on robot learning

• Experience with physical simulators (Pybullet, IssacSim, Mujoco, etc.) and training RL policies in simulation

• Ability to rapidly prototype ideas in code in an independent manner

• Published research in top ML conferences (NeurIPS, CoRL, RSS, ICML, etc.)

Nice-to-Haves

• Experience with GPU simulation

• Have built large programming projects on your own for fun (e.g. open source projects)

• Training large-scale ML models such as visual foundation models, large language models, pixel-level generative models

• Have implemented highly performant software

We offer a total compensation package including base salary from US$105,000 to US$250,000 annually, with generous stock options and other benefits.

We seek the world's most talented individuals with a passion for inventing and building a more prosperous future. At 1X you'll get to own real projects and be rewarded for your achievements and output. We hire, recognize and reward based on merit. 

Typical interview process

• Introductions - interviews to learn more about you and talk about 1X and the role

  • Interview with a member of the Talent Acquisition team

  • Hiring manager / senior team member / technical interview

• Team interviews - technical interviews and deep-dives with team members. May include a take home challenge, presentation or problem-solving exercise

  • Technical deep-dive conversation with a team member

  • Onsite interviews with team members

• Final stages - you move to the final round

  • Expectation management with the hiring manager

  • We will conduct reference checks

  • Job offer conversation

Depending on the role and your background, additional interviews may be added.

You are also welcome to request additional conversations with anyone you would like to meet, but didn’t get to meet during the interview process.

Not sure if this is you?

If you’re excited about this role, but you’re not sure if you qualify, apply anyway! You may be just the right candidate for this or other roles.

Location
We believe the best work is done when collaborating and therefore require in-person presence in our office locations.

Sunnyvale, CA

We are in the heart of the SiIlicon Valley in a commuter-friendly location with plenty of parking, access to 101 or 280. If you prefer public transportation, Orange Line (VTA) light rail station is across the street. Living in the Bay Area, you will have access to many activities available in its proximity from surfing in Half Moon Bay to skiing at Tahoe, wine tasting in Napa, hiking on the many trails or other sports activities on the many tennis courts, golf courses, etc..

If you are relocating to Sunnyvale, we offer a comprehensive relocation package to support you and handle the logistics of your move.

A value driven team

These are the ideas that express our team’s culture and how we work:

Be Nice

Collaboration is our driving force. Our team creates an open, trusting environment where everyone can be their most creative.

Stay Smart

A world-changing team needs the brightest minds in every discipline. This is where people come to work, learn, and grow to their full potential.

Make History

Everything we do gets us closer to one ambitious vision: Creating an Abundant Supply of Labor using Safe, Intelligent Humanoids. We believe what we build today will impact generations.

1X is an inclusive and equal-opportunity employer that values diversity. We consider all qualified applicants regardless of race, religion, gender, age, sexual orientation, disability, or any other protected class. If you have a disability or special need that requires accommodation, please don't hesitate to let us know during the interview process. We will do our best to accommodate your needs.

We're excited to have you on board!