Senior System Software Engineer, Speech AI

Work on cutting-edge GPU-accelerated AI systems deployed at scale

Tackle challenging problems in real-time streaming audio processing and low-latency inference

Troubleshoot and resolve complex issues across ASR, TTS, ALM, and S2S pipelines

Model Integration: Work alongside Model researchers to transition ASR, TTS and S2S models from research to production readiness.

Develop Core Speech Services : Build and enhance C++ & python backend implementations for ASR, TTS, and S2S pipelines, leveraging CUDA for GPU acceleration

Optimize Inference Performance: Improve streaming latency and throughput through advanced batching strategies, encoder caching, and multi-threaded pipeline optimizations

Feature Development: Add new capabilities such as advanced voice activity detection, speaker diarization, decoder implementations (CTC, WFST, Flashlight), and text post-processing

Client Libraries: Contribute to Python and C++ client SDKs and CLI tools for easy service integration

Assist with API integration, SDK usage, model deployment, and performance optimization

Provide advanced technical guidance to customers implementing speech technology solutions

Masters or BE/BTech in Computer Science, computer architecture, or related field

6+ years of experience

Excellent C++ & Python programming and software design skills, including debugging, performance analysis, and test design.

Experience with inference pipelines for LLM, Speech Recognition & Speech Synthesis

Solid understanding of modern model architectures (Transformers, CNNs, RNNs)

Excellent debugging abilities spanning multiple software (storage systems, kernels and containers)