68 streaming data engineer jobs at 59 companies in Berkeley, CA

1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco or New York City
HybridFull Time
Beast Industries
Beast Industries: Privately held creator-led holding producing digital entertainment, snacks, software, and consumer brands for global audiences.
3+ YOE3+ years building and operating high-volume production data pipelines, with streaming and batch experience, event instrumentation, schema design, data quality, event-driven architectures, and major cloud data stacks.
AWS, GCP, Databricks, Snowflake
1w
Save
Mark Applied
Hide
Senior Data Engineer (Data Platform)
El Segundo or Austin or Washington or San Francisco
$80k-$210k/yr OnsiteFull Time
Gallatin AI
Gallatin AI: Defense technology providing AI-powered logistics decision-support software to military and allied defense organizations.
8+ YOE8+ years data engineering experience; production experience with open table formats (Iceberg/Delta/Hudi), distributed query engines (Trino/Presto/Spark SQL), streaming/batch pipelines (Kafka/NiFi/Debezium/Spark), Python, SQL, Kubernetes, Docker, AWS data services; ability to obtain security clearance.
Apache Iceberg, Delta, Hudi, Trino, Presto, Spark SQL, Kafka, NiFi, Debezium, Spark, Python, SQL, Airflow, Dagster, Argo Workflows, TypeScript, Vue, React, Kubernetes, Docker, AWS S3, AWS Glue, AWS Aurora, Azure, Nessie, Polaris, OpenLineage, DataHub, lakeFS, Palantir Foundry
3mo
Save
Mark Applied
Hide
Staff Data Engineer
San Francisco, California, United States
$200k-$260k/yr HybridFull Time
Metriport
Metriport: Open-source healthcare data infrastructure providing APIs that help digital health organizations access and exchange patient data.
8+ YOE8+ years building and operating large-scale data platforms; experience with ingestion, storage, processing, warehousing, streaming, and leadership; strong software engineering and mentorship skills.
Spark, Parquet, Iceberg, Delta, S3, Snowflake, BigQuery, Redshift, dbt, Airflow, Dagster, Kafka, Kinesis, TypeScript, Python, Node.js, AWS, ECS, Lambda, SQS, SNS, Batch, CDK, PostgreSQL, Aurora, DynamoDB, FHIR, Athena, SageMaker, FHIR, HIE, IHE, EHR/EMR, NPI, TEFCA, ADT, HL7, HEDIS, RAF, SNOMED, LOINC, ICD-10
2mo
Save
Mark Applied
Hide
Senior Data Engineer
San Francisco or United States or Europe
$130k-$170k/yr HybridFull Time
Taskrabbit
Taskrabbit: IKEA-owned digital marketplace connecting people who need household services with skilled independent Taskers.
Experience with ELT pipelines, dbt, Airflow, Fivetran, cloud data warehouses, data modeling, SQL, and a programming language. Requires regular AI coding assistant use and familiarity with BI, semantic-layer, and streaming tools.
dbt, Airflow, Snowflake, Fivetran, BigQuery, Redshift, SQL, Python, Java, Scala, GitHub Copilot, Cursor, Claude Code, Looker, Mode, Tableau, Kafka, Kinesis
1mo
Save
Mark Applied
Hide
Data Platform Engineer
San Francisco or New York City or London
$130k-$500k/yr OnsiteFull Time
Mercor
Mercor: AI-powered talent marketplace connecting contractors with global organizations.
Hands-on Snowflake administration, data governance and access control at scale, vendor tooling ownership, production migrations, strong SQL and Python, infrastructure fluency, and CDC or streaming pipeline experience.
Snowflake, Fivetran, Airflow, Hex, Astronomer, SQL, Python, Debezium, Kafka, Snowpipe Streaming
2w
Save
Mark Applied
Hide
Software Engineer, Streaming Platform
San Francisco, California, United States
$155k-$190k/yr HybridFull Time
Sentry
Sentry: Private application-performance monitoring and error-tracking software for developers and software teams.
2+ YOE2-3+ years software engineering experience with distributed systems, data infrastructure, or real-time streaming; proficiency in Python, Rust, Go, or Java; experience with Kubernetes, AWS, or GCP.
Kafka, Python, Rust, Go, Java, Kubernetes, AWS, GCP, Flink, Spark Streaming
1mo
Save
Mark Applied
Hide
Data Engineer
San Francisco, California, United States
$158k-$231k/yr HybridFull Time
Eli Lilly and Company
Eli Lilly and CompanyNYSE: LLY: Uniting caring with discovery to make life better.
5+ YOEBachelor's degree in Computer Science, Data Science, Engineering, Mathematics or related field; 5+ years data engineering experience; strong Python, SQL, distributed processing (Spark, Ray, Dask), pipeline orchestration (Airflow, Dagster), cloud (AWS, Azure), CI/CD, Git, streaming (Kafka, MQTT, AMQP).
Python, SQL, Postgres, Spark, Ray, Dask, Airflow, Dagster, AWS, Azure, Kafka, MQTT, AMQP, RDKit, InChI, HELM, Git, CI/CD, Parquet, Zarr, Arrow
1mo
Save
Mark Applied
Hide
Senior Data Engineer
Brisbane, California, United States
$180k-$200k/yr OnsiteFull Time
Mytra
Mytra: Private robotics helping warehouse-dependent organizations move and store materials with software-defined automation.
5+ YOE5+ years building production backend or data infrastructure; production programming in Go, Python, Rust, Java, or C++; streaming systems, databases, CI/CD, monitoring, schemas, and data pipelines; BS/MS in Computer Science or equivalent.
Go, Python, Rust, Java, C++, NATS, JetStream, Kafka, Pulsar, ClickHouse, Parquet, Iceberg, GCP, GCS, BigQuery, BigLake, Kubernetes, Prometheus, Grafana, CI/CD
3w
Save
Mark Applied
Hide
Senior Data Platform Engineer
Boston or San Francisco or Vancouver
$125k-$205k/yr OnsiteFull Time
Later
Later: Private influencer marketing and social media management serving brands, agencies, and creators.
6+ YOE6+ years in data, backend, or platform engineering; strong Python, SQL, dbt; GCP and BigQuery experience; infrastructure as code, CI/CD, orchestration; batch and streaming architectures; security and data governance knowledge.
GCP, BigQuery, AWS, dbt, Fivetran, Kubernetes, Python, SQL
2mo
Save
Mark Applied
Hide
Distinguished Engineer - Distinguished Engineer, Data Foundation
Mountain View, California, United States +1 more
$273k-$370k/yr HybridFull Time
Intuit
IntuitNASDAQ: INTU: A global financial technology platform powering prosperity.
15+ YOE15+ years building large-scale data platforms; expertise in distributed systems, streaming, cloud data services, semantic layers, AI infrastructure, data governance, and company-wide technical strategy.
Apache Spark, Apache Kafka, Apache Pulsar, AWS, GCP, GenOS, RAG, LLM, GDPR, CCPA, RFC, ADR
3mo
Save
Mark Applied
Hide
ML Infra Engineer (Data Systems)
San Francisco, California, United States
OnsiteFull Time
Physical Intelligence
Physical Intelligence: AI robotics developing foundation models and learning algorithms for robots and physically actuated devices.
Strong software engineering fundamentals with experience building distributed systems, large-scale data pipelines, object storage and batch/streaming systems; ownership mindset and performance focus.
ClickHouse, Ray, Flink, Spark
3mo
Save
Mark Applied
Hide
Member of Technical Staff - Data Platform
New York City or San Francisco or London
OnsiteFull Time
Reflection AI
Reflection AI: Private AI research lab building open foundation models and agentic software for enterprise, government, and regulated-industry users.
Experienced data engineer with production-grade pipeline experience for large-scale batch and streaming workloads; strong debugging, cost/performance optimization, and data quality/governance skills.
Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake, Great Expectations
3mo
Save
Mark Applied
Hide
Member of Technical Staff — Data Ingestion & Quality
San Francisco, California, United States
OnsiteFull Time
Causal Labs
Causal Labs: Private AI research building physics foundation models for weather prediction and control for businesses and governments.
Experience building large-scale data pipelines and QA systems, familiarity with streaming and batch ingestion, vendor collaboration, and strong problem-solving and domain learning skills.
Apache Spark, Ray, Beam
1mo
Save
Mark Applied
Hide
Senior Engineer - Data Infrastructure
San Jose or Austin
$131k-$213k/yr HybridFull Time
PayPal
PayPalNASDAQ: PYPL: Global digital payment platform for consumers and businesses.
3+ YOE3+ years software development experience, Bachelor's degree in computer science or related field, experience with AWS data pipelines, infrastructure as code (Terraform, CloudFormation), programming (Python, Java), and streaming solutions (Kafka, SQS).
AWS SQS, Apache Kafka, Terraform, AWS CloudFormation, Python, Java, AWS Lambda, AWS S3, AWS DMS, AWS EKS, Apache Spark, AWS Glue, SQL, NoSQL
2d
Save
Mark Applied
Hide
Data Engineering Manager – AI & Data Modernization
Chicago or Milwaukee or Dallas or Columbus or Kirkland or Cincinnati or New York City or Cleveland or Oklahoma City or Austin or Albany or St. Petersburg or Hartford or Pittsburgh or St. Louis or Miami or Sacramento or Raleigh or Minneapolis or Mountain View or Scottsdale or San Francisco or Morristown or Denver or Boston or Philadelphia or Des Moines or Overland Park or Los Angeles or Charlotte or Walnut Creek or Carmel or Seattle or Houston or Arlington or Atlanta or Orlando or Redmond or Bentonville or Beaverton or Nashville or Detroit or San Diego
HybridFull Time
Accenture
AccentureNYSE: ACN: Global professional services delivering 360° value.
5+ YOE5+ years data engineering, 1-2 years AI/LLM data work, 5+ years Python/SQL, streaming and orchestration tools, Bachelor's degree or equivalent, work authorization without sponsorship.
Python, SQL, Kafka, Airflow, Delta, Iceberg
Job Posting
2d
Save
Mark Applied
Hide
Senior Software Engineer - Streaming Infrastructure
San Mateo, California, United States
$190k-$250k/yr HybridFull Time
Skydio
Skydio: American autonomous-drone manufacturer serving public safety, government, utility, and enterprise customers.
5+ YOE5+ years in SRE, platform engineering, DevOps or equivalent; experience operating production Kubernetes clusters, AWS, and continuous deployment; strong cloud networking and distributed systems knowledge; U.S. person status required for export-controlled data access.
Kubernetes, AWS, Go, Python, C++, WebRTC, RTP/RTCP, ICE/STUN/TURN, LiveKit
3w
Save
Mark Applied
Hide
Staff Data Infrastructure Engineer
New York City or San Francisco
$247k-$339k/yr HybridFull Time
Faire
Faire: Private wholesale marketplace connecting independent retailers with brands and makers worldwide.
Deep experience building and running data infrastructure at scale, including CDC and streaming ingestion via Kafka, lakehouse architectures on Iceberg/S3, Spark, Databricks, Snowflake, Airflow, Fivetran, strong SQL and Python plus one of Kotlin/Java/Scala/Go, AWS with Terraform, and data governance.
CockroachDB, MySQL, Fivetran, Kafka, Spark, Airflow, Snowflake, Databricks, Iceberg, S3, Anomalo, Monte Carlo, Python, Kotlin, Java, Scala, Go, AWS, Terraform, Kubernetes, Scylla, DynamoDB, SQL
1mo
Save
Mark Applied
Hide
Senior Software Engineer, Data
San Francisco or United States or Canada or South America
$165k-$221k/yr RemoteFull Time
Doximity
DoximityNYSE: DOCS: U.S. digital platform connecting physicians and healthcare professionals with clinical and collaboration tools.
5+ YOEAt least 5 years of data engineering or similar experience; expert Python and fluent SQL skills; experience architecting data pipelines, automated testing, asynchronous systems, APIs, streaming, and ML/AI deployment.
Python, SQL, GitHub, APIs
5d
Save
Mark Applied
Hide
SVP - Data Engineering, Data Science & Analytics
Los Angeles or San Francisco
$450k-$500k/yr HybridFull Time
AXS
AXS: Global ticketing and marketing technology serving fans, venues, sports teams, festivals, and live-event organizers.
15+ YOE8+ Mgmt15+ years in high-growth technology, 8+ years leading data organizations; experience with data warehousing (Snowflake, Redshift, BigQuery), orchestration (Airflow, dbt), streaming (Kafka, Kinesis), cloud (AWS), BI (Tableau, Looker, Power BI); proven executive leadership.
Snowflake, Redshift, BigQuery, Airflow, dbt, Kafka, Kinesis, AWS, Tableau, Looker, Power BI
1mo
Save
Mark Applied
Hide
Staff Software Engineer, Data Warehouse
Mountain View or Los Angeles or New York City or San Francisco
$210k-$275k/yr HybridFull Time
Commure
Commure: AI-native healthcare technology providing revenue-cycle, clinical-workflow, and ambient-AI software to health systems and providers.
6+ YOERequires 6+ years of software engineering experience building or operating data platforms, expertise across CDC, streaming, data lakes, query engines, dbt, SQL, schema design, and production infrastructure.
Debezium, StarRocks, dbt, Kafka, Redpanda, Apache Iceberg, Delta Lake, Apache Hudi, Parquet, Apache Airflow, Dagster, Cube, DataHub, OpenMetadata, Amundsen, ClickHouse, Trino, Snowflake, Databricks, Terraform, Pulumi, Kubernetes, AWS, GCP, Azure, SQL