
![]() |

We don't mind if you use curl or httrack or whatever to download the PRD. (Heck, we can't really stop you without turning off the entire website anyway.) But I'd ask that you be sure that you make sure your crawler isn't set to download the entire website. Or if you do, be sure it is using a standard bot user agent rather than impersonating a regular browser.

Papa-DRB |

Absolutely agree! I use httrack and point at the PRD only.
I once made the mistake of trying to download jryest's SRD site, and man it has a lot of images, etc. Killed the download after 30 minutes...
-- david
Papa.DRB
Gary Teter wrote:
We don't mind if you use curl or httrack or whatever to download the PRD. (Heck, we can't really stop you without turning off the entire website anyway.) But I'd ask that you be sure that you make sure your crawler isn't set to download the entire website. Or if you do, be sure it is using a standard bot user agent rather than impersonating a regular browser.