Skip to content

Toxicity judge pipeline doc#19

Open
PALBIBEK wants to merge 3 commits intomainfrom
add-toxicity-judge-example
Open

Toxicity judge pipeline doc#19
PALBIBEK wants to merge 3 commits intomainfrom
add-toxicity-judge-example

Conversation

@PALBIBEK
Copy link
Collaborator

@PALBIBEK PALBIBEK commented Jan 9, 2026

No description provided.

- Prompt Registration: "register-and-refine/examples/intent-classification-pipeline-registration/prompt.md"
- Pipeline Registration: "register-and-refine/examples/intent-classification-pipeline-registration/pipeline.md"
- Language Translation Pipeline Example:
- Pipeline Registration: "register-and-refine/examples/language-translation-pipeline-registration/pipeline.md"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing the previous pipeline ?

- "technology/self-hosting/configurations/*"
- Hardening - Security: "technology/self-hosting/hardening.md"
- Scaling:
- "technology/self-hosting/scaling/*"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New line added ?

```markdown
You are a precise text classifier. Score each message across 7 toxicity categories using a 0-4 scale.

CATEGORIES & SCALES:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prompt is not same as one in the AI-Sandbox ?

}

# Step 4: Return scores with context
return {"output": response, "context": None}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In free-form pipeline you need not worry about the context part .. it can be removed

```python
# Test Case 1: Clean message
user_message = "Thank you for your feedback!"
# Expected: All scores 0
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove expected score ... If user's don't get the same ..they can complain

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants