Applied Scientist / Research Engineer Speech AI

GTN Technical Staffing

San Francisco, CA(remote)

Apply

JOB DETAILS

SKILLS

Analysis Skills, Artificial Intelligence (AI), Audio Streaming, Benchmarking, Communication Skills, Computer Science, Cost Modeling, Data Modeling, Data Sets, Design Evaluation, Electrical Engineering, Experiment Design, Large-Scale Systems, Machine Learning, Machine Tool, Memory Hardware, Metrics, Modeling Languages, Open Source, Patents, Performance Management, Product Documentation, Production Systems, Productivity Management, Prototyping, Publications, Quality Management, Quality Metrics, Realtime Communications, Research Laboratory, Research Skills, Scientific Research, Speech Recognition, Speech Technology, Startup, Team Player, Testing, United States Citizen, Use Cases, User Interface/Experience (UI/UX), Voice Applications, Voice Products, Workflow Analysis

LOCATION

San Francisco, CA

POSTED

30+ days ago

Applied Scientist / Research Engineer —Speech AI

HIGHLIGHTS

Location: San Francisco, CA OR REMOTE
Position Type: Direct Hire
Salary: Based on Experience
Residency Status: US Citizen or Green Card Holder Only

We are looking for a senior technical contributor to help develop the next generation of real-time speech and conversational AI systems. This person will work across applied research, model development, training infrastructure, evaluation, and production deployment.

The role is ideal for someone who has deep experience with modern machine learning for audio, speech, and language, and who enjoys moving beyond prototypes into systems that must perform reliably in live environments. You will work closely with engineering and product teams to improve model quality, speed, reliability, and scalability for speech-driven user experiences.

This is a hands-on position. You should be comfortable experimenting with new model architectures, training and evaluating large models, improving inference performance, and translating research results into production-ready capabilities.

Responsibilities

Develop High-Quality Speech Generation Systems

Build and improve machine learning models for natural, expressive speech generation.
Work on controllability, speaker consistency, pacing, tone, and conversational timing.
Explore model architectures that improve output quality while keeping latency low.
Improve performance for real-time use cases where responsiveness and reliability matter.
Partner with infrastructure and product teams to move successful approaches into production.

Improve Speech Understanding and Recognition

Train, adapt, and evaluate models that convert speech into accurate, usable text.
Improve recognition quality across varied speakers, accents, noisy conditions, phone-quality audio, interruptions, and mixed-language conversations.
Use large-scale audio data, weak labels, self-supervised methods, and targeted fine-tuning strategies.
Improve downstream usefulness of transcripts for conversation analysis, structured output, and intent understanding.

Advance Audio Representation and Compression Methods

Research and implement model components that represent speech efficiently and preserve perceptual quality.
Explore learned audio representations that support generation, recognition, and efficient deployment.
Evaluate different approaches for balancing quality, speed, compute cost, and scalability.
Build systems that can support both experimentation and production use.

Build Training and Evaluation Workflows

Create reliable pipelines for collecting, cleaning, processing, and evaluating speech data.
Design evaluation methods that combine automated metrics, model diagnostics, and human quality review.
Support large-scale training jobs across modern accelerator infrastructure.
Improve throughput, reproducibility, monitoring, and cost efficiency of model development workflows.

Run Rigorous Experiments

Design controlled experiments to test model, data, and training improvements.
Compare approaches using clear benchmarks and production-relevant quality measures.
Move quickly from hypothesis to implementation, measurement, and iteration.
Communicate results clearly to research, engineering, and product stakeholders.

What We’re Looking For

Machine Learning Depth

Strong background in modern machine learning, especially speech, audio, language, generative modeling, multimodal systems, or large-scale model training.
Ability to implement new model ideas efficiently and evaluate them with technical rigor.
Strong understanding of current techniques used in speech and language systems.

Speech and Audio Experience

Practical experience building or improving systems for speech generation, speech recognition, audio modeling, or related areas.
Experience working with large and varied audio datasets.
Strong judgment around speech quality, naturalness, latency, robustness, and user-facing model behavior.
Familiarity with real-world audio issues such as background noise, channel quality, interruptions, speaker variation, and conversational dynamics.

Production Awareness

Experience training, deploying, or serving large models on modern compute infrastructure.
Understanding of practical inference constraints, including latency, memory use, throughput, quantization, and serving efficiency.
Comfort working with systems that need to operate reliably in live, low-latency environments.

Experimental Discipline

Experience designing benchmarks, ablation studies, data experiments, and quality evaluations.
Ability to use both offline metrics and live product signals to guide model decisions.
Strong technical judgment when deciding which ideas are worth scaling and which should be abandoned.

Ownership and Execution

Comfortable working in a fast-moving technical environment with ambiguous problems.
Able to own projects from early exploration through deployment.
Strong collaboration skills across research, engineering, infrastructure, and product.
High standards for model quality, reliability, and operational performance.

Ideal Background

The strongest candidate will have experience building speech or audio AI systems that are both technically advanced and practical to deploy. You should be motivated by improving natural conversation, real-time responsiveness, model robustness, and scalable production performance.

You may come from a research lab, AI startup, speech technology company, communications platform, infrastructure team, or another environment where speech models were trained, evaluated, deployed, and improved at scale.

Nice to Have

Experience with distributed training for large models.
Publications, patents, or open-source work in speech, audio, language, or machine learning.
Experience with real-time communication, streaming audio, contact-center technology, or other latency-sensitive speech products.
PhD in Machine Learning, Computer Science, Electrical Engineering, Artificial Intelligence, or a related field;equivalent research or industry impact is also acceptable.

Benefits

Competitive health, dental, and vision coverage.
Equity participation.
Access to modern compute, tooling, and research resources.
Opportunity to work on advanced speech AI systems used in production environments.

"We are GTN –The Go To Network"

Applied Scientist / Research Engineer Speech AI

GTN Technical Staffing

San Francisco, CA(remote)

About the Company

GTN Technical Staffing

Similar Job Searches