Skip to content

BotBlockDetector: add additional services and enable by default - #778

Merged
ato merged 2 commits into
masterfrom
ato/botblock-detector2
Oct 6, 2026
Merged

ato merged 2 commits into
masterfrom
ato/botblock-detector2

Conversation

@ato

@ato ato commented Oct 2, 2026

Copy link
Copy Markdown
Collaborator
  • add aws-waf, kasada, lua-anti-ddos, perimeterx
  • enable in default profiles
  • add BotBlockDetectorTool for manual testing

@ato
ato merged commit 0ca9e5d into master Oct 6, 2026
8 checks passed
@ato
ato deleted the ato/botblock-detector2 branch October 6, 2026 02:20
@Querela

Querela commented Oct 8, 2026

Copy link
Copy Markdown
Contributor

Nice. Maybe a comment on how to run the tool would be good. I was able to get it to work on my command line with:

# in the "heritrix3" root folder
# unsure whether a "mvn clean package install" is required for all dependencies to be there
mvn exec:java -Dexec.mainClass=org.archive.modules.processor.BotBlockDetectorTool -Dexec.classpathScope=test -f modules/pom.xml -Dexec.args='https://google.com/' -q
# tells it to run the main class in the "test" scope/folder, with the "pom.xml" file in "modules/"; with quiet/silent maven output

It might sometimes fail with some PKIX certificate issue but that is unrelated.

(certificate_unknown) PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants