Software Engineer

Role Overview

Leadership Responsibilities

• Manage daily tasks, mentor engineers, review code and AI behavior, provide feedback, and track quarterly goals.
• Support training and recruitment activities and provide status updates to senior leadership.
• Collaborate with product, domain, and engineering teams on scalable AI-driven solutions.
• Perform root cause analysis for issues involving model behavior, hallucinations, and retrieval quality.

Software Development Responsibilities

• Develop AI-native software and plan model selection, prompt and agent design, and data or retrieval architecture.
• Build automated tests and evaluation harnesses for accuracy, regression, and hallucination checks.
• Troubleshoot software and model-behavior problems and maintain production software.
• Apply secure coding practices, including prompt-injection defense, privacy, PII handling, and responsible-AI safeguards.
• Use managed AI/ML services and monitor model performance and drift in production.

Communication Responsibilities

• Communicate effectively with internal and external customers, team members, management, and clients.
• Explain AI capabilities, limitations, and trade-offs to technical and non-technical stakeholders.
• Identify opportunities to improve business software processes through AI and automation.

Qualifications

• 3–5 years of practical Java experience.
• 1–2 years of prompt engineering and prompt or agent scripting experience.
• 1–2 years integrating third-party AI/ML services and platform APIs.
• Proficiency in Python, Java, and JavaScript, with strong Python skills for ML and AI.
• Experience with APIs, cloud computing, managed AI services, LLM orchestration, retrieval frameworks, and vector databases.
• Experience with Agile and Scrum, Spring Boot or similar frameworks, and AI evaluation harnesses.
• Bachelor's degree in computer science or a related field.

Technical Skills

• Relevant technologies include AWS Bedrock, SageMaker, Azure OpenAI, Google Vertex AI, Kubernetes, and containerization.
• Relevant frameworks and stores include LangChain, LlamaIndex, Pinecone, Weaviate, and pgvector.
• The role involves Java, Python, JavaScript, REST and streaming APIs, JSON, SQL, and NoSQL or vector stores.

Work Personas

• ServiceNow assigns flexible, remote, or required-in-office work personas based on the nature of the work and assigned location.
• The listed Hyderabad work location is associated with an onsite workplace classification in the source metadata.

About ServiceNow