Staff Research Software Engineer, Google Research

About the role

About the job

Google Research Singapore is the very latest addition to the Google Research presence around the globe. This is an incredible opportunity to be advancing the frontier of AI capabilities in Singapore. The team delivers research on algorithmic efficiency, and inference acceleration, directly impacting how next-generation AI models will be deployed to billions of people.

In this role, you will sit at the heart of advancing fundamental capabilities of Artificial Intelligence (AI) to drive significant benefits to humanity. You will have the chance to help build a team from the ground up. You will be pioneering AI research in Singapore, focusing on enabling the most performant, ultra-efficient and capable Generative AI Models. You will be making pioneering breakthroughs towards Computational Efficiency for serving and deployment of large-scale Generative AI Models (e.g., Large Language Models (LLMs), Diffusion Models, Generative Videos). You will be a technical leader of a small and agile team, in an extremely fast-paced environment in close collaboration with other teams at Google.****

Responsibilities

• Design and implement novel algorithms that optimize the inference stack for LLMs to ensure the highest througput and lowest latency for billions of users including sampling techniques, speculative decoding advancements, model compression, knowledge distillation and quantization strategies.
• Work on development and optimization of the low-level software that runs AI models efficiently. Implement and optimize custom kernels for inference, focusing on improving latency, throughput, and memory usage, across different hardware and model architectures.
• Co-design algorithms that exploit the unique architectectural advantages of custom hardware and accelerators. Collaborate with hardware architects on next-generation systems and use a deep understanding of both model architecture and hardware to inform algorithm selection.
• Amplify impact and influence the research ecosystem through publications and scientific dissemination.

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.