21 model serving engineer jobs at 19 companies in Queens, NY
Software Engineer, Model Lifecycle and Signals
New York or San Francisco +1 more
OnsiteFull Time
Exceptional engineering track record; experience building evaluation, measurement, or model serving systems; fluency with data; strong taste and curiosity about model behavior.
Distributed Systems Engineer 5 - Core Ad Serving Platform
New York City or Seattle or Los Angeles or Los Gatos
$388k-$619k/yr OnsiteFull Time
7+ YOE7+ years experience with at least 4+ years in Ads domain, expertise building and operating large-scale distributed systems, ad-server components, API and data model design, SLO-driven development, and incident response.
Staff, MLOps Engineer
New York City or San Francisco or United States
$220k-$280k/yr RemoteFull Time
4+ YOEMinimum 4+ years MLOps or ML/platform engineering; expertise with low-latency model serving, Python and PyTorch; cloud (AWS/GCP/Azure), Docker, Kubernetes, MLflow; strong distributed systems and pipeline experience.
Python, PyTorch, AWS, GCP, Azure, Docker, Kubernetes, MLflow, Rust, vLLM, Triton
Anti-Fraud Engineer (NYC / MIA)
New York City or Miami
$185k-$220k/yr HybridFull Time
5+ YOE5+ years building production systems, including 3+ years in fraud, risk, or trust and safety; production rules or model-serving ownership; programming, SQL, fraud metrics, and AI tool expertise; bachelor's degree or equivalent.
TypeScript, SQL, AI, KYC, KYB, 3DS, SCA, BSA, OFAC, PSD2, MiCA, DORA, SOC 2
Senior Staff Machine Learning Engineer
Brooklyn or United States
$245k-$319k/yr RemoteFull Time
10+ YOE10+ years in ML and AI; expertise in large-scale model training and serving, productionizing models, data and ML frameworks, ambiguous technical problems, cross-functional delivery, and engineering mentorship.
Apache Spark, Apache Beam, Apache Hadoop, TensorFlow, PyTorch, Scikit-learn
Machine Learning Engineer
Chicago or New York City or Redwood City
HybridFull Time
5+ YOE5+ years building and operating production ML systems; strong Python, SQL, MLOps, cloud, distributed computing, model serving, observability, and platform engineering expertise. STEM degree preferred.
Python, Go, Rust, SQL, Terraform, GCP, Kubernetes, Prometheus, Grafana, Docker, Airflow, Istio, Spark, Ray, Dask, BigQuery, Spanner, Datadog, Claude Code, Cursor, CI/CD, gRPC
Analytics Engineer
Stockholm or Boston or New York
HybridFull Time
Requires strong SQL, analytical data modeling, ELT/ETL, cloud warehouse, Python, dashboard, BI, communication, and self-serve analytics experience.
SQL, dbt, SQLMesh, Snowflake, BigQuery, Redshift, Databricks, Python, Hex, Lovable
Staff Backend Engineer, Customer Value Optimization
Toronto or New York City
$150k-$160k/yr HybridFull Time
7+ YOE7+ years of backend engineering experience, strong Python foundation, production ML model serving or platform experience, and expertise in distributed systems, APIs, and microservices architecture.
Python, ML frameworks, APIs, MLOps
Senior Engineer, ML Engineering (Databricks)
New York or Chicago or Boston or Toronto or London
$130k-$147k/yr HybridFull Time
Experience operationalizing production ML/AI on Databricks, MLflow, Databricks Model Serving; strong Python, Spark, SQL; CI/CD and monitoring for model performance, safety, and governance.
Databricks, Databricks Workflows, Delta Lake, Delta Live Tables, Asset Bundles, Unity Catalog, Genie Code, MonteCarlo, Fiddler, MLflow, Databricks Model Serving, Python, Spark, SQL, Jenkins, shell, Yarn, AWS, chatGPT, Claude, Copilot
Senior Machine Learning System Engineer
United States or Seattle or San Francisco or Austin or New York City
$149k-$235k/yr RemoteFull Time
Senior ML systems engineer with experience designing scalable search serving infrastructure, building production ML models, and applying FinOps principles; on-call and incident response required.
Triton, PyTorch, Jira, Confluence, Rovo
Senior Software Engineer, Dermatology Inference
Brooklyn, New York, United States
$180k-$325k/yr HybridFull Time
5+ YOE5+ years software engineering with ML/CV model training and shipping; strong Python and deep learning (PyTorch); fine-tuning (LoRA); evaluation rigor; production serving; dataset workflows; relational databases; TypeScript comfort; patient safety focus.
Next.js, TanStack Start, React, Fastify, tRPC, Prisma, PostgreSQL, Inngest, Mastra, OpenAI, Anthropic, Vertex, Cloudflare, Turborepo, Doppler, AWS, GCP, Posthog, Motherduck, DuckDB, dbt, dlt, Prefect, BigQuery, PyTorch, LoRA
AI Engineer, Platform and Data
New York City or Dallas
$160k-$220k/yr OnsiteFull Time
6+ YOEBachelor's degree in Computer Science, Data Science, Information Systems or related field; 6+ years in backend, data, or ML infrastructure engineering; experience with LLM orchestration, agent frameworks, or model serving; based in NYC metro area and able to work on-site.
Research Engineer, Audio and Speech
San Francisco or New York City
$200k-$400k/yr OnsiteFull Time
2+ YOE2+ years in speech, audio ML, multimodal ML, or production ML; Python and PyTorch proficiency; experience with speech models, streaming agents, low-latency inference, production serving, evaluation, and research-to-production delivery.
Python, PyTorch
Staff+ Software Engineer, Account Abuse (Machine Learning)
San Francisco or New York City
$320k-$485k/yr HybridFull Time
Proficiency in Python and SQL; experience training and deploying ML models; experience building data pipelines with Spark or Beam and Airflow; understanding of point-in-time correctness and training/serving skew; strong communication skills.
Python, SQL, Spark, Beam, Airflow, Chronon, Feast, Tecton, Flink, Kafka Streams, Claude
Senior AI/ML Engineer
United States or Boston or New York City
RemoteFull Time
5+ YOE5-10 years experience; information retrieval infrastructure, applied ML for ranking/recommendations, NLP/LLM application, low-latency serving, specialized search evaluation, hands-on foundation model experience, graceful failure design, AI coding agents.
OpenSearch, PostgreSQL, Spark, EMR, Glue, Snowflake, dbt, TypeScript, Node.js, GraphQL, Nx, PNPM, Keycloak, Okta, Jenkins, GitOps, AWS, Grafana, Elasticsearch, Vespa, pgvector, Pinecone, Weaviate
Introspection Probe Research Engineer, Development and Infrastructure, Gemini Security, DeepMind
Mountain View or New York City or San Francisco
$174k-$252k/yr OnsiteFull Time
Bachelor's degree in computer science or related field; experience with large-scale LLM training and serving infrastructure; experience training and deploying security or safety classifiers for large AI models.
Senior Developer Relations Manager - Dynamo AI Inference
Santa Clara or New York City or Seattle
$184k-$357k/yr OnsiteFull Time
8+ YOEDegree in Computer Science, Engineering, or related field or equivalent experience; 8+ years technology industry experience including 4+ years in AI/ML infrastructure, model serving, or distributed systems; experience leading developer or partner programs; practical AI inference deployment experience; familiarity with vLLM, SGLang, TensorRT-LLM, Dy...
vLLM, SGLang, Mooncake, llm-d, TensorRT-LLM, Dynamo, Kubernetes
Member of Technical Staff — Inference
New York City, New York, United States
OnsiteFull Time
Experience building and operating ML services or performance-sensitive distributed systems; strong Python; hands-on inference engine or production model-serving experience; ability to investigate performance bottlenecks and own reliability.
Python
Operations Solutions Manager
Los Angeles or Atlanta or Chicago or Dallas or New York City
$100k-$115k/yr OnsiteFull Time
5+ YOE5+ years warehouse operations experience with process/industrial engineering fundamentals; experience building cost-to-serve models; strong WMS/ERP knowledge; cross-functional experience; strong communication; comfort with ambiguity; willingness to travel 50%.
WMS, ERP
Explore Jobs
Expand Your Job Search
Top Cities Near Queens for Model Serving Engineer
- Model Serving Engineer jobs in New York, NY
- Model Serving Engineer jobs in Brooklyn, NY
- Model Serving Engineer jobs in Manhattan, NY
- Model Serving Engineer jobs in The Bronx, NY
- Model Serving Engineer jobs in Staten Island, NY
- Model Serving Engineer jobs in Newark, NJ
- Model Serving Engineer jobs in Jersey City, NJ
- Model Serving Engineer jobs in Yonkers, NY
- Model Serving Engineer jobs in Paterson, NJ
- Model Serving Engineer jobs in Bridgeport, CT
- Model Serving Engineer jobs in Elizabeth, NJ
- Model Serving Engineer jobs in Stamford, CT
- Model Serving Engineer jobs in Edison, NJ
- Model Serving Engineer jobs in Norwalk, CT
- Model Serving Engineer jobs in Greenburgh, NY
- Model Serving Engineer jobs in Clifton, NJ
- Model Serving Engineer jobs in New Rochelle, NY
- Model Serving Engineer jobs in Passaic, NJ
- Model Serving Engineer jobs in Union City, NJ
- Model Serving Engineer jobs in Mount Vernon, NY