CV for this role
Rewrite your CV for what NEAR AI asks for
This job is free to read. A CV tailored to it comes with Weekly and Monthly.
Pay comparison
Market pay for software developers in United States
Per year, across all employers in this occupation. This figure is not from NEAR AI.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics, May 2025.
Job description preview
From NEAR AI’s original posting
Locations: San Francisco or Remote About The Role The NEAR AI team is building decentralized and confidential machine learning infrastructure to enable user-owned AI. Our mission is to build highly scalable and efficient infrastructure for open-source AI at a global scale. We are specifically seeking an expert in high-performance LLM serving systems and inference optimization. In this role, you will push the boundaries of how large language models are served. What You'll Be Doing • Architect and maintain production high-traffic LLM serving systems. • Optimize throughput, latency, and cost for leading open-source LLMs. What We're Looking For • Strong hands-on experience in LLM inference, with expertise debugging and optimizing major inference engines such as SGLang, vLLM, or TensorRT. • Deep knowledge of state-of-the-art GPU architectures, and effectively exploit them using PyTorch, Triton, CuTe, CUDA, etc. • Proven track record in designing and maintaining end-to-end high-traffic LLM serving systems. • Strong problem-solving skills and ability to communicate technical ideas clearly. We'd Love If You Have • Experience with Trusted Execution Environments (TEE). • Active contributor…
Open full posting on NEAR AI’s siteSimilar roles on Seoulstart
- Senior/Principal Local LLM & Generative AI Platform EngineerParallel Wireless · Remote (United States) · 1 day ago
- LLM Application Engineer, Artificial Intelligence (AI) Required, Work From HomeGinas Tech Jobs · Remote (United States) · 1 day ago
- LLM Engineer (Large Language Model Engineer)Nestifytech Solutions Private Limited · Remote (United States) · 1 day ago
- Intern AI Engineer, Early-Career – LLM Context & Data Layer (Healthcare)Cotiviti · Remote (United States) · 1 day ago