AI Software Development Engineer in Test (SDET)

About Hitachi Vantara

Hitachi Vantara is a global leader in data infrastructure and solutions, empowering sectors ranging from banking to entertainment with innovative data-driven technologies. Known for high-performance, resilient systems, we enable businesses to automate processes, innovate, and create exceptional customer experiences worldwide. Join us in shaping future advancements that positively impact society and industries at large.

Position Summary

We are seeking a seasoned AI Software Development Engineer in Test (SDET) to join our Global Quality Assurance team based in Kolkata, India. In this role, you will architect and implement comprehensive testing strategies specifically for AI-powered and machine learning-driven systems, including large language models (LLMs) and intelligent automation workflows. Your collaboration with cross-functional teams will ensure the reliability, safety, and quality of AI features throughout their lifecycle.

Key Responsibilities

• Architect and conduct validation tests for AI/ML features spanning internal models, embedded components, and integrated AI services.
• Evaluate the quality of model inferences, including response behaviors, performance metrics, safety measures, and robustness across varied scenarios.
• Confirm the integrity of data pipelines by verifying data schemas, payloads, and contracts feeding into AI models and downstream systems.
• Perform thorough end-to-end testing of AI-driven workflows across internal systems, orchestration platforms, and user applications.
• Develop tools to simulate AI behaviors, automate testing workflows, generate test data sets, and facilitate continuous validation processes.
• Identify atypical cases, potential failure modes, drift indicators, and quality gaps in AI-driven functionalities.
• Conduct security and responsible AI compliance checks to ensure adherence to privacy, fairness, and ethical guidelines.
• Collaborate with product, engineering, and data science teams to diagnose issues, verify corrections, and enhance readiness for AI features.
• Maintain comprehensive documentation detailing test plans, expected AI behaviors, evaluation metrics, and validation methodologies.
• Continuously propose advancements to AI reliability, monitoring capabilities, and test coverage throughout the development lifecycle.

Candidate Profile and Requirements

• 7 to 10+ years’ experience in software testing or SDET roles, including at least 2 years working specifically with AI/ML systems.
• Advanced proficiency in Python for test code development, data validation, and building evaluation tools.
• Solid understanding of storage technologies such as block storage, S3-compatible object storage, Network File Systems (NFS), and distributed file systems.
• Familiarity with Hitachi products like VSP 360 and Ops Center is advantageous.
• Hands-on experience with AI/ML frameworks and platforms including PyTorch, TensorFlow, Scikit-learn, Hugging Face, and cloud AI services like Microsoft Azure AI, AWS AI/ML, or Google Vertex AI.
• Strong grasp of AI/ML fundamentals such as model inference behaviors, evaluation metrics, prompt/response quality, and considerations of drift, bias, and fairness.
• Proven experience testing large language model (LLM)-based systems and ML-enhanced features.
• Knowledge of MLOps tools and pipelines like MLflow, Kubeflow, SageMaker, or Vertex AI workflows.
• Expertise in QA methodologies, software development lifecycle (SDLC), and agile best practices.
• Experience working in Linux/UNIX environments and familiarity with containerized workflows using Docker.
• Excellent communication skills with a demonstrated ability to work effectively in worldwide, cross-functional teams.

Preferred Certifications

• Microsoft Certified: Azure AI Engineer Associate
• AWS Certified Machine Learning – Specialty
• Google Professional Machine Learning Engineer
• NVIDIA Deep Learning Institute certifications, including LLMs, generative AI, and computer vision tracks
• TensorFlow Developer Certificate
• Hugging Face NLP/LLM Certifications
• ISTQB Certified Tester specialized in AI Testing
• Certified Kubernetes Administrator (CKA) or Certified Kubernetes Application Developer (CKAD)

Work Culture and Benefits

Hitachi Vantara prides itself on fostering an inclusive environment that respects diversity and enables all employees to perform at their best. We offer industry-leading benefits and support for overall health and wellbeing, including flexible working arrangements tailored to roles and locations. Our culture promotes collaboration, autonomy, and continual learning to drive innovation together. We are an equal opportunity employer committed to fair hiring practices and accommodations during recruitment to ensure candidate success.