CV for this role
Rewrite your CV for what FriendliAI asks for
This job is free to read. A CV tailored to it comes with Weekly and Monthly.
Pay comparison
Market pay for software developers in United States
Per year, across all employers in this occupation. This figure is not from FriendliAI.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics, May 2025.
Job description preview
From FriendliAI’s original posting
ABOUT THE JOB We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing GPU kernels and supporting infrastructure for next-generation generative and agentic AI workloads. Your work will directly power the most latency-critical and compute-intensive systems deployed by our customers. We are looking for an exceptional engineer with a strong foundation in GPU programming and compiler infrastructure. The ideal candidate enjoys pushing performance boundaries and has experience supporting production-scale machine learning applications. KEY RESPONSIBILITIES - Design and optimize custom GPU kernels for AI (e.g., transformer and diffusion) workloads - Contribute to the development of FriendliAI’s kernel compiler, memory planner, runtime, and other core components. - Collaborate with cloud and infrastructure engineers to ensure end-to-end inference performance - Analyze performance bottlenecks across the software and hardware stack, and implement targeted optimizations - Drive support for new model architectures and tensor compute patterns -…
Open full posting on FriendliAI’s siteSimilar roles on Seoulstart
- Software Development Engineer, Agentic AIAmazon · Seattle, Washington, USA · 2 days ago
- Lead AI/ML Software EngineerRaft · Remote (United States) · 2 days ago
- Lead Software Engineer, AI Email Applications, Artificial Intelligence (AI) RequNext Step Systems · Remote (United States) · 2 days ago
- Android Software Engineer, Artificial Intelligence (AI) Required, Work From HomeParallel Partners · Remote (United States) · 2 days ago