Research Engineer -- Vision

About this roleYou will be a core contributor on Zyphra’s Vision Team building the next generation of vision-language models which can understand natural scenes with a focus on web, desktop, and mobile UIs. You will be deeply involved in the entire model training process from data gathering and processing to designing novel architectures and training methodologies. You will work across:Large-scale vision encoder and vision language training runsPerformance optimization of our training stackImage and video dataset collection, processing, and evaluationArchitecture and training methodology ablations and improvementsWhile deep expertise in all areas isn't required, you should be enthusiastic about learning each aspect as needed to drive our models forward. We also strongly look for velocity over position. However, having deep expertise in at least one of the above is helpful to begin contributing immediately.RequirementsStrong research taste and intuition. The ability to work through a research project from conception to execution to write-up.Strong implementation and prototyping ability – can take an idea from conception to experimentation extremely quickly.The ability to work well and cooperate with others in a high-paced research setting.Good to haveExperience with training and evaluating vision language modelsExperience with creating and collecting large scale machine learning datasets, especially in the visual modalityExperience with training vision encoders using contrastive learning or other methodsExperience with supervised finetuning and preference learning methods as well as reinforcement learning methodsA good intuitive ability to understand model behaviours and correct them through iterative terest in grappling in detail with data and spending significant time involved in data engineering and synthetic data generationPostgraduate degree in scientific subject (Computer Science, Mathematics, Physics, Machine Learning, etc)Previously published machine learning research in well-respected venuesHighly proficient with Pytorch and PythonAre excited and able to rapidly learn new fields and implement new ideasExcellent communication and collaboration skills and can work effectively on both research and engineering implementation at scale.CultureOur research methodology is to make grounded, methodical steps toward ambitious goals. Both deep research and engineering excellence are equally valuedWe strongly value new and crazy ideas and are very willing to bet big on new ideasWe move as quickly as we can; we aim to make the bar to impact as low as possibleWe all enjoy what we do and love discussing AIBenefits and PerksMedical, dental, vision and FSA plansCompetitive salary, equity and 401(k)Relocation and immigration support on a case-by-case basisOn-site meals prepared by a dedicated culinary team; Thursday Happy HoursGeneral requirementsWilling to be in-person in our office in Palo AltoUS authorization to work. We will consider O1 visa sponsorship for the right candidate #J-18808-Ljbffr

Created: 2025-09-17