1,205 llm engineer jobs at 552 companies in New York City, NY
Senior AI/LLM Engineer
United States or Canada or San Francisco or New York City or Seattle or Ann Arbor
$148k-$192k/yr RemoteFull Time
5+ YOE5+ years of software engineering experience, including 2+ years building AI-powered user-facing features; strong Python skills; experience with LLMs, RAG, secure AI, CI/CD, testing, and deployment.
Python, RAGAS, LangSmith, CI/CD, RAG, LLM
LLM Post-Training Engineer Graduate (Research & Product) - 2027 Start
San Jose or Los Angeles or Singapore or New York City or London or Dublin or Paris or Berlin or Dubai or Jakarta or Seoul or Tokyo
$128k-$317k/yr OnsiteFull Time
Completing or recently completed a master's in computer science, machine learning, or related field; strong Python, PyTorch or JAX skills; Transformer and LLM training knowledge.
Python, PyTorch, JAX, DeepSpeed, Megatron-LM
Principal Software Engineer - LLM Optimization
Jersey City or London
$204k-$285k/yr OnsiteFull Time
7+ YOEFormal software engineering training or certification and 7+ years of experience, with hands-on LLM inference, GPU infrastructure, quantization, benchmarking, cloud systems, and agentic AI development expertise.
vLLM, TensorRT-LLM, SGLang, LLM-D, FP8, INT8, INT4, GPTQ, AWQ, AWS, EKS, GuideLLM, DCGM, NVML, XID
Senior Machine Learning Engineer – NLP/LLM
Brooklyn or Frisco or Toronto or Ann Arbor or Eagan
$110k-$235k/yr HybridFull Time
3+ YOEMaster's degree in ML, CS, Statistics or related quantitative field; 3+ years professional ML engineering experience; hands-on production ML deployment; Python; PyTorch or TensorFlow; experience with NLP and LLM architectures.
Python, PyTorch, TensorFlow
Machine Learning Data Engineer (LLM & Generative AI)
New York City, New York, United States
RemoteFull Time
5+ YOEBachelor's or Master's in Computer Science, Data Science, Engineering or related field; 5+ years in Data Engineering, ML Engineering or MLOps; expert Python and SQL; experience with LLM APIs, open-source models, orchestration frameworks, synthetic data generation, workflow orchestration, GCP, and distributed data processing.
Python, SQL, OpenAI, Anthropic, Hugging Face, Llama, LangChain, LlamaIndex, AutoGen, GCP, Pinecone, Milvus, Weaviate, Qdrant, RAGAS, TruLens, DeepEval, Kafka, Flink, Kinesis
Research Engineer
New York, New York, United States
$200k-$400k/yr OnsiteFull Time
4+ YOE4+ years applied ML/research engineering experience, production ML and agent/LLM work, proficiency in Python and Typescript, evaluation pipeline experience, strong statistical and problem-solving skills.
Python, Typescript, LLM
GRC Engineer
New York City, New York, United States
$188k-$221k/yr OnsiteFull Time
5+ YOE5+ years across software/automation engineering and security compliance, production-grade scripting (Python), GRC domain fluency (SOC 2/ISO 27001), clear technical writing, and experience building LLM/agent workflows.
Python, OSCAL, Terraform, CI/CD, APIs, LLM
Solutions Engineer, AI
New York, New York, United States
HybridFull Time
3+ YOE3+ years in solutions/forward-deployed/consulting engineering; LLM/AI prompt design, memory/knowledge retrieval, evaluation and deployment; stakeholder management and product collaboration; strong communication and judgment.
LLM
Forward Deployed Engineer
New York City, New York, United States
$90k-$160k/yr HybridFull Time
2+ YOERequires 2–5+ years of engineering or technical deployment experience, customer-facing delivery, complex project scoping, and hands-on LLM or generative-model systems experience. Python and AI tools are preferred.
Python, Claude Code, Codex, OpenCode, LLM, SOC, DPAs
Forward Deployed Engineer
Foster City or New York City
$180k-$300k/yr HybridFull Time
5+ YOE5+ years of software engineering experience building production software; strong programming, production LLM application, complex system architecture, technical communication, customer collaboration, and independent project delivery skills.
LLM, APIs, SSO, SaaS, cloud infrastructure, databases, authentication
Forward Deployed Engineer
New York City, New York, United States
$175k-$215k/yr OnsiteFull Time
4+ YOE4+ years software engineering or client-facing technical role; strong technical skills with code, LLMs, evals; exceptional communication; organized and process-oriented; in-person in NYC five days a week; travel to customer sites across the US.
LLM
Forward Deployed Engineer - Strategic Account
New York City or Brooklyn
$150k-$240k/yr OnsiteFull Time
3+ YOERequires 3–5+ years building and operating production systems, full-stack engineering, messy integrations, hands-on LLM systems experience, customer-facing communication, and entrepreneurial initiative.
Salesforce, DealCloud, Microsoft SharePoint, LLM
Senior Staff Security Engineer, AI Security
New York City or San Francisco
$224k-$300k/yr HybridFull Time
10+ YOE10+ years of Security Engineering experience, AI/ML security exposure, expertise in LLM and agentic AI risks, cloud, CI/CD, containers, Kubernetes, IAM, API security, and threat modeling.
AWS, GCP, Azure, Kubernetes, IAM, STRIDE, MITRE ATLAS, OWASP LLM Top 10, MCP, LLM, RAG
AI Engineer
Chicago or San Francisco or New York City
$180k-$220k/yr HybridFull Time
Production service experience with API design, data contracts, authorization, observability, LLM agent systems, strictly typed codebases, safety properties, clear technical writing, and startup or high-growth experience.
LLM, MCP, Anthropic SDK, Avro, Protobuf, Peloton, Fetch, OneMedical, Headspace
Forward Deployed Engineer
London or New York City
£70k-£90k/yr OnsiteFull Time
Experience delivering LLM projects, LLM API integration, prompt engineering, solutions design, cloud integrations, and Python coding; strong customer-facing and communication skills.
V7 Go, Python, GPT, Claude, Gemini, LLM API
Founding Senior Product Engineer
New York City, New York, United States
HybridFull Time
Proven track record shipping end-to-end features, fluency with AI/LLM tools, strong technical judgment, customer-facing communication, and independent problem-solving.
Trello, LLM
Principal Engineer
New York City, New York, United States
$200k-$230k/yr OnsiteFull Time
12+ YOE12+ years in software engineering, including 3+ years at Staff or Principal scope; distributed systems, LLM-backed systems, cloud infrastructure, CI/CD, and mentorship experience; bachelor's degree or equivalent practical experience.
Kafka, Pub/Sub, TypeScript, Golang, CI/CD
GTM Engineer
New York City, New York, United States
$140k-$200k/yr OnsiteFull Time
1+ YOERequires 1–7 years in software, GTM, or growth engineering; strong SQL and Python; experience with data pipelines, APIs, reliable workflows, AI agents, LLMs, and GTM systems.
SQL, Python, HubSpot, Clay, Gong, Apollo, Orum, Lemlist, Zapier, Granola, Claude, Codex, Snowflake, BigQuery, dbt, Airflow, Looker, Hex
Senior AI / Machine Learning Engineer — Fraud Detection
San Jose or Austin or Seattle or New York City or Washington or Chicago
$152k-$265k/yr HybridFull Time
8+ YOERequires 8+ years operating production ML systems, Python, SQL, PyTorch, ML deployment and monitoring experience, LLM or AI agent experience, strong engineering skills, and a bachelor's degree or equivalent experience.
Python, SQL, PyTorch, LLM, AI agents, Adobe Acrobat Studio, Adobe Express, Adobe Firefly, Creative Cloud, Adobe Experience Platform, Adobe Experience Manager, GenStudio
Explore Jobs
Expand Your Job Search
Top Cities Near New York for Llm Engineer
- Llm Engineer jobs in Brooklyn, NY
- Llm Engineer jobs in Queens, NY
- Llm Engineer jobs in Manhattan, NY
- Llm Engineer jobs in The Bronx, NY
- Llm Engineer jobs in Staten Island, NY
- Llm Engineer jobs in Newark, NJ
- Llm Engineer jobs in Jersey City, NJ
- Llm Engineer jobs in Yonkers, NY
- Llm Engineer jobs in Paterson, NJ
- Llm Engineer jobs in Elizabeth, NJ
- Llm Engineer jobs in Stamford, CT
- Llm Engineer jobs in Edison, NJ
- Llm Engineer jobs in Norwalk, CT
- Llm Engineer jobs in Greenburgh, NY
- Llm Engineer jobs in Clifton, NJ
- Llm Engineer jobs in New Rochelle, NY
- Llm Engineer jobs in Passaic, NJ
- Llm Engineer jobs in Union City, NJ
- Llm Engineer jobs in Mount Vernon, NY
- Llm Engineer jobs in Bayonne, NJ