Principal Software Engineer

Cadence Design Systems
Bengaluru
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Analytical","Problem-solving","Communication","Cross-functional collaboration","Data-driven mindset"]

Design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. Build unit, integration, and end-to-end test suites covering functional, regression, performance, and safety needs, including non-deterministic outputs, hallucinations, and multi-step agent behavior. Create evaluation systems (golden datasets, benchmarking), integrate automated testing into CI/CD, and add observability/telemetry to support traceability, monitoring, and audit readiness.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cadence Design Systems
Cadence Design Systems
5 hours ago

Principal Software Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live
Reposted: similar role first listed 8 months ago

Job Summary

Design and scale automated validation frameworks for AI/ML models, LLM-based applications, and agentic systems. Build unit, integration, and end-to-end test suites covering functional, regression, performance, and safety needs, including non-deterministic outputs, hallucinations, and multi-step agent behavior. Create evaluation systems (golden datasets, benchmarking), integrate automated testing into CI/CD, and add observability/telemetry to support traceability, monitoring, and audit readiness.
Location: Bengaluru
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build and maintain AI test automation frameworks for pre-qualification and continuous validation of models and agent workflows.
  • •Develop comprehensive unit, integration, and end-to-end test suites spanning functional, regression, performance, and safety testing.
  • •Validate AI system behavior for non-deterministic LLM outputs, including hallucinations, edge cases, and multi-step agent decision-making.
  • •Design evaluation systems using golden datasets and benchmarking pipelines for accuracy, latency, reliability; implement prompt/agent regression testing.
  • •Automate testing in CI/CD pipelines and implement observability/telemetry to enable traceability, monitoring, and audit readiness, collaborating with ML, MLOps, Product, and Security teams.

Key Requirements

  • •7+ years in QA, SDET, or test automation engineering, including building and scaling automation frameworks.
  • •Hands-on test automation for AI/ML and LLM-based applications, including RAG pipelines and agentic workflows.
  • •Experience with non-deterministic testing approaches and evaluation methods such as LLM-as-a-judge, with metrics like BLEU/ROUGE and semantic similarity.
  • •Proficiency integrating automated test suites into CI/CD for model updates, prompt changes, and tool integrations.
  • •Experience supporting AI safety testing (adversarial testing, bias/fairness validation, jailbreak detection) and audit/compliance readiness.
Experience:7+ yearsAI/MLLLM applicationsAgentic systemsTest automationCI/CD
Education:Bachelor's
Skills:AnalyticalProblem-solvingCommunicationCross-functional collaborationData-driven mindset
Certifications:ISTQBAWSAzureGCP
Tech Stack:PythonBashTypeScriptGoPyTestPlaywrightSeleniumCypressGitHub ActionsJenkinsGitLab CIAWSAzureGCPDockerKubernetesOpenAIAnthropicBedrockPinecone

Company Brief

Cadence Design Systems
Provides electronic design automation (EDA) software, IP, and services for semiconductor and systems companies to design, verify, and implement integrated circuits, systems-on-chip, and electronic systems across industries including communications, automotive, and consumer electronics.
Industry: Developer Tools
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Jose, United States
Founded: 1988
Glassdoor
Glassdoor: 3.9
WebsiteLinkedInGlassdoor