DewyGolfBot

DewyGolfBot is the web crawler for Dewy Golf, a golf app. It visits public golf course websites to find publicly posted scorecards and course layout maps, so golfers can see accurate hole information.

How to recognize it

It identifies itself with this User-Agent:

DewyGolfBot/1.0 (+https://dewygolf.com/bot)

What it fetches

• Public web pages, images and PDFs on golf course websites.
• It never submits forms and never logs in.
• It does not collect personal data.

How it behaves

• It obeys robots.txt: a User-agent: DewyGolfBot group if you have one, otherwise your User-agent: * group.
• It honors Crawl-delay.
• It keeps concurrency low on each site.
• It fetches only a small number of pages from each site.

Blocking or limiting it

To block DewyGolfBot from your whole site, add this to your robots.txt:

User-agent: DewyGolfBot
Disallow: /

To slow it down or keep it out of part of your site:

User-agent: DewyGolfBot
Crawl-delay: 10
Disallow: /members/

Opting out or removal

Email [email protected] with your website address and we'll stop crawling it and remove what we collected from it. You can also reach us through our contact page.