Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
|
sidnarsipur's comments
login
sidnarsipur
44 days ago
|
parent
|
context
[–]
| on:
Fix your robots.txt or your site disappears from G...
I've made a nice tool (
https://botblock-puce.vercel.app/
) to generate custom robots.txt easily if anyone is interested.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
