Software Development Engineer, AI Runtime

We are looking for a passionate and experienced Software Development Engineer to help us build and scale the next generation of AI runtime infrastructure for Alexa. You will design and implement Tier-1 distributed systems that orchestrate expert agent executions, manage LLM inference pipelines, and ensure reliable, low-latency delivery across Alexa-enabled devices globally.

What you'll do

• Design and implement Tier-1 distributed systems that orchestrate expert agent executions
• Manage LLM inference pipelines
• Ensure reliable, low-latency delivery across Alexa-enabled devices globally

Tap what's true for you. Your answers are saved for every other job too.

Put these words in your resume and practise these questions before the interview.

Technical

1. How do you design a low-latency distributed system for AI runtime workloads?
2. What are the main bottlenecks when managing LLM inference pipelines at scale?
3. How do you ensure high availability and reliability for Tier-1 services?

Scenario

1. What would you do if an LLM inference pipeline experienced a sudden spike in latency affecting Alexa devices?
2. How would you troubleshoot a distributed system failure during peak traffic execution?

HR

1. Can you describe a challenging technical project you worked on and how you resolved bottlenecks?
2. How do you prioritize features and system reliability in a fast-paced environment?

About Amazon

1. How does Amazon's approach to scaling Alexa infrastructure differ from traditional cloud application deployments?

Practice questions written from the job listing, not this company's real interview questions.

Applied here? Tell the next person what happened. It's anonymous and takes one tap.