Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
bflesch
7 months ago
|
parent
|
context
|
favorite
| on:
OpenAI's ChatGPT Agent casually clicks through "I ...
idk why people just don't do reverse DNS lookup, check if "dialup" is part of the hostname, and allowlist that traffic. Everbody who doesn't have reverse dns hostname coming from an ISP should be blocked or at least tarpitted by default.
Easily solves 99% of the web scraping problems.
layer8
7 months ago
[–]
Scrapers already do fall back to home user botnets when they are being blocked.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Easily solves 99% of the web scraping problems.