Some ideas to improve the capabilities #22
Description
I’ve started experimenting with this, and overall I’m very impressed. It’s fast, easy to set up, and works reliably. Thank you for building this! ❤️
One limitation I’ve noticed is that the pull_request event isn’t currently supported. For example, in cases like ampproject/amphtml#38599, the workflow doesn’t run, which makes it less effective against spam PRs. Most of the spam PRs we see in Express and AMP involve modifying random files and adding spam content in the PR body or title.
Run github/ai-moderator@v1
....
Nothing to do for event pull_request.
Other observations and suggestions
- Issues: The first message/description is correctly tagged but not hidden (example, logs). Actually the GH UI does not allow it either
- PR comments and issue comments: Moderation works great here, including the hide capability (PR comment example, issue comment example).
- It would be very helpful to have the option to automatically close or lock PRs and issues flagged as AI-generated, to cover all cases.
- An option to override or sanitize PR/issue titles would also be a valuable addition.
For reference, here are my current settings.
Also I noticed one execution that was extremely slow but sucessfully (20m), it was the first execution I did 🤔
