Features and Options

This document outlines the key CLI commands you can use to explore available tactics, datasets, plugins, and providers in the dtx interface.

Note: If you are using Docker, you can simply replace dtx with ddtx.

Tactics

List all available tactics that can be applied for model evaluation or adversarial testing.

dtx tactics list

Each tactic includes:

Name — the identifier used in test plans.
Description — explains how the tactic manipulates prompts or attacks models.

Example tactic:

flip_attack: Flips characters or words in a prompt to bypass filters while remaining interpretable to the model.

Explore curated prompt datasets for evaluating language models.

dtx datasets list

Datasets include themes such as:

Example datasets:

List all available plugins used for evaluating model outputs across different risk categories.

dtx plugins list

Plugins cover evaluation domains such as:

Plugin format:

<category>:<subcategory>:<specific check>

Example:

Use providers to generate completions or integrate with various LLM systems.

Currently, the providers command supports the generate subcommand.

Check available options:

dtx providers generate --help

You can use this to:

Command	Description
`dtx tactics list`	List all available adversarial tactics
`dtx datasets list`	Explore prompt datasets for testing
`dtx plugins list`	List plugins for output evaluation
`dtx providers generate --help`	Get help on generating completions with providers

For Docker users, simply replace dtx with ddtx in the above commands.