On: mCaptcha: Open-source proof-of-work captcha for we...

[nikvaes]

Did you also look at the false positives, e.g., how many non-spam content was filtered by Akismet?

[dimmke → nikvaes]

Of course. It would be bonkers not to. It just doesn't send a notification if the submission is flagged as spam and puts it in a separate folder. So I have the ability to look at every submission.

I put the system into effect on August 1st. There have not been any false positives. There was even a submission to the form that was clearly a B2B sales pitch, but because it was an actual person submitting the form and not an automated system it went into the "real" entries list (I think this is reasonable. Any business is going to have to field B2B sales solicitations)

I put together a few rows in a spreadsheet of legitimate submissions (with info blocked out): https://imgur.com/a/stxja1Z

Here's an example of one flagged as spam by Akismet that was submitted about an hour ago: https://imgur.com/a/PmN3t80

Overall, removing reCAPTCHA has increased the total amount of submissions to the form, but the amount of submissions actually being seen by a real person who then has to waste time reading it, identifying that it's spam and discarding it has dropped to 0.

[dontupvoteme → dimmke]

I wonder if it would be a decent approach to scale CAPTCHA tests based on how likely an LLM thinks a post is spam.

People who WRITE LIKE THIS might just end up ACCIDENTALLY BEING FILTERED and using click as an imperative is a complete red flag.

I think you could probably filter a number of these out with just regular NLP approaches/models even.