Research Engineer, Human Understanding

Stack

Responsibilities

• ▹Advance multimodal human representations and understanding: research and implement novel models across visual, audio, and textual data
• ▹Conduct applied research from hypothesis to deployment
• ▹Drive substantial technical projects from ideation and design through implementation and evaluation
• ▹Contribute to scalable research infrastructure for multimodal human understanding models and datasets
• ▹Design and execute strategies for tuning and adapting VLMs and other foundation models

Requirements

• ▹PhD in Computer Science, Machine Learning, or related technical field with 3+ years of relevant experience
• ▹Experience developing machine learning models, such as audio and speech-visual models
• ▹Experience working with and tuning large-scale vision language models
• ▹Strong Python programming skills and experience with a major deep learning framework (e.g. JAX)
• ▹Experience conducting independent research, including experimental design, implementation, and analysis

Nice to have

• ▹Experience with Generative AI techniques and architectures
• ▹Familiarity with Reinforcement Learning or alignment methods
• ▹Publications in top-tier AI/ML conferences (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV)
• ▹Experience with multimodal learning, integrating vision, audio, and text data
• ▹Understanding of privacy-preserving machine learning or responsible AI practices

Soft skills

What we offer

• ▹Bonus and equity
• ▹US base salary range: $174,000-$252,000 (plus bonus, equity, benefits)

About the company

Google DeepMind's Frontier AI unit builds systems that enable natural, safe human-AI interaction and robust, resilient systems to detect and prevent misuse like deepfakes and impersonation, in service of the mission toward AGI.