Technology · PRESS RELEASE
AiEnsured Releases agentest for Agentic Evals: pip install agentest-ai
AiEnsured (testAIng.com) has released AiEnsured agentest, an open-source tool for agentic evals. It runs 165 tests on recorded OpenTelemetry GenAI traces and installs with pip install agentest-ai.
BENGALURU, India — 19 November 2026
pip install agentest-ai
https://pypi.org/project/agentest-ai/
AiEnsured (testAIng.com) has released AiEnsured agentest, an open-source tool for agentic evals. The current package on PyPI is agentest-ai 3.5.0. Install it with pip install agentest-ai from https://pypi.org/project/agentest-ai/. The tool checks what the agent actually did, not only what it said.
agentest is an Apache-2.0 Python command-line tool. It runs 165 tests on OpenTelemetry GenAI traces that an agent has already recorded, and can also read an optional A2A AgentCard and MCP tools list. It is deterministic and offline: it does not call an LLM judge, and it needs no account, API key or network. Each check returns pass, fail or n/a, with a line of evidence. It can be used as a CI gate (--strict).
This release is for developers and QA engineers who need a repeatable, evidence-backed check on a recorded agent session. agentest reads traces the agent has already produced. It does not need a live model call at evaluation time. Teams can run the 165 tests on a local machine or in a continuous-integration job, and can use the --strict flag so a failing check can block a build.
The open test checklist is published on Hugging Face under CC BY 4.0 and can be used by hand, without the runner. The runner itself installs from PyPI and requires Python 3.11 or newer. A Hugging Face Space and a Colab notebook are also available for a trial in the browser.
Install: pip install agentest-ai
https://pypi.org/project/agentest-ai/
Repository: https://github.com/srpadmanabhuni/agentest
Space: https://huggingface.co/spaces/srinivaspadmanabhuni/agentest-assurance-report-card
About AiEnsured
AiEnsured (testAIng.com) builds tools for testing AI systems. The company is based in Bengaluru, India.
About the author of the project
Dr Srinivas Padmanabhuni is CTO and co-founder of AiEnsured (testAIng.com).
Media contact
Dr Srinivas Padmanabhuni
CTO and co-founder, AiEnsured
Dhi Innovation Park, Bannerghatta Main Road, next to Mahindra Lifespace, Arekere, Bengaluru, Karnataka 560076, India
Email: srinivas@testAIng.com