Back to Registry

code.python.lint_ruff

HARD

Verifies that agent-generated Python code passes ruff lint checks with configurable violation thresholds.

Scorecard

Determinismdeterministic
Evidence Qualityhard-state
Intended Useeval-and-train
Gating RequiredNo
Permissions
fs:write_tmp
exec:ruff

Test Fixtures

9 total
TypeCount
Positive3
Negative3
Adversarial3

Metadata

Version0.1.0
Domaincode
Task Typelint_verification
Contributorvr.dev
Sourcecode-quality

Use in SDK

# CLI
vr verify --verifier code.python.lint_ruff --ground-truth '{"order_id": "ORD-42"}'

# Python
from vrdev import verify
result = verify("code.python.lint_ruff", ground_truth={"order_id": "ORD-42"})

# API
curl -X POST https://api.vr.dev/v1/verify \
  -H "X-API-Key: vr_live_..." \
  -d '{"verifier": "code.python.lint_ruff", "ground_truth": {"order_id": "ORD-42"}}'
Verifier Registry | vr.dev