Samy |
1 person marked this as a favorite. |
...because it's much easier at other times?
It's your right, of course, to do things the most difficult way. But don't be surprised if people wonder why someone would want to give themselves a lot of additional grief.
Look, I share your concerns about the unreliability of download services. I have issues with paying real money to services like Steam (computer games) or Comixology (comics) because their servers could be gone tomorrow and I would have nothing left.
But I am telling you, and everyone else -- Paizo has been here for a decade. They are not some fly-by-night operation. And they are not going to go bankrupt and disappear two weeks after getting a half a million dollar cash infusion. The files WILL BE HERE two weeks from now. Guaranteed. I know it's difficult to put trust on companies. But if you try in this specific case, you will be rewarded.
Warvair |
Another post in my series of questionable advice offered on circumstantial evidence and my own experiences so... purely biased guesswork.
Just recently, I was able to download 2 more PDFs after having no luck for hours (just clicking the same download link periodically). Both files downloaded at a good clip too! (guessing something like 100 MB/5 mins?). But now I'm back in "page refresh" land.
This along with many folks talking about being able to download a few files (2-3) and then running into issues makes me think we all would have a more productive experience by just taking a break for a few hours if you're having no luck downloading, especially if you just downloaded a couple files. One reasonable theory here is that each account is allotted a limited amount of storage for downloads and you need to wait for your previous downloads to timeout (as mentioned above, timeout varies with load but tends to be a few hours).
However, there are the posts that seem to indicate some folks have never been able to download anything. I'm not sure what to say, that hasn't been my experience.
emmers |
Look, I share your concerns about the unreliability of download services. I have issues with paying real money to services like Steam (computer games) or Comixology (comics) because their servers could be gone tomorrow and I would have nothing left.
But I am telling you, and everyone else -- Paizo has been here for a decade. They are not some fly-by-night operation. And they are not going to go bankrupt and disappear two weeks after getting a half a million dollar cash infusion. The files WILL BE HERE two weeks from now. Guaranteed. I know it's difficult to put trust on companies. But if you try in this specific case, you will be rewarded.
You have issues giving money to Steam because you worry that their servers could be gone tomorrow, but not to Paizo because they've been around a decade?
You know that Steam has been around a dozen years, and would have been able to handle 30k new subscribers without blinking?
I'm not saying that I'm worried about Paizo, despite the issues I've experienced as a new customer. I'm happy to admit that in some areas Paizo has done much better than I would expect Steam to do when faced with a similar situation (namely interaction with customers). I'm just saying that Steam may not have been the best example to use in this case.
Euan |
The new server which I heard went online yesterday or this morning, seems to have done the trick.
Thank you Paizo!
Sure, it would have been nice to have fixed before the problem occurred, but who'd have known the Humble Bundle would be so popular?
Thanks for not trying to ride it out and coming up with a solution. My downloads, while not as quick as they were a couple weeks ago, are at least happening now in a timely fashion, and my Play By Post games are quick and stable.
Thank you.
Samy |
You have issues giving money to Steam because you worry that their servers could be gone tomorrow, but not to Paizo because they've been around a decade?
I didn't say I don't have issues buying Paizo PDFs. All I'm saying is that if you chose to do it, you have nothing to worry about. Like Steam, they've been in the business forever, and they just got a major cash infusion, so they *are going to be here* two weeks from now.
Chemlak |
1 person marked this as a favorite. |
Just did a test.
Earlier today I was able to download the Strategy Guide and the Hell's Rebels Player's Guide, so I took what I learned and tried to be at least a bit scientific about it.
At about 22.55 GMT, selected a book (Hell's Rebels Book 1) to download.
I set a timer for 30 minutes.
About 20 minutes in, I re-logged into My Downloads, but did nothing.
At the end of the 30 minutes I clicked link to start download.
Download message "Your Download should start in 5 seconds" message appeared.
Download timed out (Chrome).
Copy/pasted download address from Chrome into Microsoft Edge.
Got "Hmm, we can't reach this page" for remote3.paizo.com.
Refreshed that page in Edge.
Download started. Currently 49% complete (at current download speed, it'll complete roughly 1 hour after I started).
Cort Odekirk Technology Manager |
3 people marked this as a favorite. |
Things should be better now, needed to tweak some things in the new infrastructure. Just as an interesting FYI, over 1 terabyte of data generated in bit less than 12 hours. If printed (both sides) on standard paper, the stack would be 10 miles high.
And then fall over and destroy the servers, so we're not going to do that *here*.....
Nametag |
Well, I've reached the first hurdle. I've received the URL for my download link.
I can't actually reach that server yet though... so I'm hoping that download link sticks around long enough for me to actually download it. But this is progress at least. (And heck yea I was excited when I saw the download link!)
Cort Odekirk Technology Manager |
Nametag |
1 person marked this as a favorite. |
It's giving me time out errors, not DNS errors. (Though Chrome IS particularly bad about DNS stuff, admittedly.) Edge took a while to connect, but it claims to have. Now I just need to wait 40 minutes to make sure it worked. Thanks!
You guys there ARE doing a good job trying to handle this insane load. Kudos to everyone there, and again, congratulations on the success of this charity event even thus far. It's amazing to see that the average is higher than the high book tier. It's amazing not only how many people have been in, but how much they're going in for.
Lissa Guillet System Administrator |
Yeah I think Chrome has a max connect below other browsers. There are basically two things that switching to a different browser can do for you and one of them is getting a higher timeout for connecting to the web servers that are handing those files out. Edge seems to be doing pretty well and firefox has been fairly great as well.
paschott |
1 person marked this as a favorite. |
Been trying to download _anything_ since my purchase - always get either a personalizing message or logged out. I have no idea what's going on once logged out (as a user - I've read the status updates in the other thread). I do know I have yet to see a download link.
From my time working in SaaS dev, I really hope you're giving some high priority to refactoring your queue method. We had a similar issue and had to:
* Create a "processed" queue where items moved once done
* Move all completed work there (actually renamed the old table, created a new one as the "queue", populating w/ the non-processed stuff)
* Tweak the queuing process to check to see if something is already in the "to process" queue - if so, don't requeue it. (and make sure the proper indexes were created to facilitate this)
From what I could tell, none of that was done, but really should be or you'll keep requeuing items that are already in queue. Even having someone de-dupe the "to process" queue could help quite a bit and if you can create a scheduled task to do that every ### minutes, you can keep the queue relatively clean.
However, that still leaves the "I have no idea what's going on" problem for the users. If my personalized download is still processing, I should know that across logins. I should even be able to get some idea of where I am in the queue (even if with a rough estimate). I'd also argue that some priority might be given to your non-Humble customers, but that might already be in place. :)
I appreciate that you're trying to address this with faster/bigger hardware and that it came as a big surprise. I just hope that you're also trying to future-proof this so there won't be a "next time" like this one.
Guess I'll try IE to see if that gives me different results from Firefox. Maybe I'll see a download link as it's been about 20-30 minutes since I last tried to personalize something.
------
Edit: Finally got the Beginner Box file downloaded when I used IE to access the downloads page. Odd that I never seemed to get anything in Firefox, but also a good sign that my personalized file was actually queued and processed at some point. :)
baconcow |
Cannot download the Advanced Player's Guide or Bestiary, no matter the method or browser. Many others eventually downloaded, though. Over the last several days, it keeps personalizing, without providing the actual download. Something tells me the system set up at Paizo is very inefficient and not working as intended.
Nutcase Entertainment |
I have no idea why this is, but I am getting downloads to work with the new Microsoft Edge browser in Windows 10 on the very same files that are not downloading using either Chrome or Firefox.
Windows 10 doesn't like 3rd party applications/programs, and Chrome isn't as user friendly as most people seem to think.
@ IT, maybe you should add some extra instructions on the download page, and the warning about Chrome.
Cibo |
Hello Paizo,
First off, thanks for this Humble Bundle deal. Lots of goodies in the package to start my Pathfinder adventures.
I have been trying to download the PDFs all day today. I have only managed to get 3 PDFs downloaded. My biggest issue is that after being personalized, a prompt saying my download will begin in 5 seconds.
As I mentioned before I have had a handful of successes but at this moment the connection times out and the webpage says that the webpage is not available.
Is this an individual issue or a server one?
NerdOfTheYear |
1 person marked this as a favorite. |
As a rocket scientist with 20 years of experience, I would like to offer Paizo some friendly advice by telling them that they really should use a system with a vibration-isolated IMU. Otherwise, you're going to get some undesirable secondary harmonics.
-Skeld
This isn't rocket science...
On the other hand, as a tax lawyer with 2 years experience I strongly recommend that Paizo utilise complex trust structures to route the humble bundle money through the cayman islands, followed by luxembourg, lithuanian, mongolia and finally the moon. [/tongue-in-cheek]
Joana |
1 person marked this as a favorite. |
As I mentioned before I have had a handful of successes but at this moment the connection times out and the webpage says that the webpage is not available.
Is this an individual issue or a server one?
Sounds like the Chrome issue. Try copy/pasting the link of the timed-out page into a back-up browser. (Firefox and IE, of all things, have shown particular success.)
As I understand it, your PDF has personalized, but the browser is giving up on the process before a secure link is established. I had the same thing happen in Chrome but successfully got the download with two tries in IE.
Cibo |
Cibo wrote:As I mentioned before I have had a handful of successes but at this moment the connection times out and the webpage says that the webpage is not available.
Is this an individual issue or a server one?
Sounds like the Chrome issue. Try copy/pasting the link of the timed-out page into a back-up browser. (Firefox and IE, of all things, have shown particular success.)
As I understand it, your PDF has personalized, but the browser is giving up on the process before a secure link is established. I had the same thing happen in Chrome but successfully got the download with two tries in IE.
Thanks!
The4TimeTravelers |
1 person marked this as a favorite. |
It is in fact a Chrome issue for me. I have been attempting to download in Chrome for days and have had no success until I read this post and retried my download in IE. IE seems to have a longer default timing out period while waiting to establishing secure connections. Thanks Joana & Cibo for the info.
Carrion Crow |
This is fun. It was kinda like gambling on Chrome for a bit, sometimes working out, sometimes crashing, but then it all went to crap entirely. Now it's just a straight up stubbornness contest with Firefox since anything shoved through it goes at about 5 percent of normal speed.
Silly machine, it doesn't realize that I used to sit through dial-up.
I can do this standing on my head.
Hmm. Cleared out my Chrome cache again, now it's working properly, and with proper speed.
Skeld |
Skeld wrote:As a rocket scientist with 20 years of experience, I would like to offer Paizo some friendly advice by telling them that they really should use a system with a vibration-isolated IMU. Otherwise, you're going to get some undesirable secondary harmonics.
-Skeld
This isn't rocket science...
On the other hand, as a tax lawyer with 2 years experience I strongly recommend that Paizo utilise complex trust structures to route the humble bundle money through the cayman islands, followed by luxembourg, lithuanian, mongolia and finally the moon. [/tongue-in-cheek]
As it turns out, most things aren't rocket science. Sometimes, rocket science isn't even rocket science. Although, it can get confusing, what with all the maths and power point.
-Skeld
Farseeker |
Heya! The other day we did find an issue that was blocking downloads, which is now fixed.
Currently, we are experiencing higher-than-usual traffic, which is causing the My Downloads page to work *really* hard and it's taking the service longer to churn through requests. I would recommend giving your download a few minutes to finish personalizing, or come back later on to attempt to download.
Tried that multiple times three days in a row now. I guess I'll try really early in the morning see if that helps.
emmers |
I have a question. I've read multiple times people talking about 117 files from Humble Bundle.
I have
( 1) Beginner Box
( 1) Guild Guide
( 2) Map Folios
( 6) Hell's Rebels
( 4) Inner Sea Campaign Setting
( 1) Player Companion Inner Sea Primer
(23) Season 6 Scenarios
( 1) Season 7 Scenario
(44) Base files (Core Rulebook, Bestiary, etc)
Doing the math, that only brings me to 83. I've redeemed all the keys (and I paid for the physical box, so I should have all the keys available as well), am I missing 34 files somewhere, or is the count of 117 off?
Dave Talbert |
2 people marked this as a favorite. |
Been trying to download for three days, a couple of times a day, with no luck at all. Considering how good my Humble Bundle experience typically is, I've been pretty disappointed this time. Why not sell these ones DRM-free, if watermarking is the issue? I have no intention of hosting or pirating, but this seems to be a textbook case of DRM interfering with nice paying customers ... and I'd be surprised if pirated PDFs of all of this stuff weren't available on torrent sites. Isn't this doing exactly the opposite of what it's supposed to be doing?
KNHaw |
8 people marked this as a favorite. |
TL;DR: There is a simple workaround that can greatly improve your chances of getting your files, but you will will have to download the free Firefox browser if you are using Chrome or IE.
If you're past the personalization problems but facing timeout issues (i.e. you can get to the "Your download should begin..." page but not get your file), I've found a workaround for the Firefox browser. Specifically, in Firefox open the URL "about:config" You will be asked if you want to proceed ("This might void your warranty!"). Don't let the warning scare you, as we won't be messing around with anything dangerous. Click "I'll be careful, I promise!"
You will now reach a configuration page for Firefox . Type "network.http.connection-timeout" into the "Search" box. This is the period of time that your browser will wait for a new webpage or (as is the case here) a download. By default, it will be "90" for 90 seconds. Right click on it and select "modify." I chose a full hour (3600 seconds) but feel free to play with the value.
You will now have that long to download a file that has already been personalized, so if the server's slow you won't get a hangup. Open up a new tab and log in and attempt a normal download of your PDF. When you get to the "Your download should begin..." page, just click on the "If it doesn't, please click here" link (because, let's face it, this isn't going to happen in the promised five seconds). Now go off and do something constructive. Within a few minutes (i.e. longer than the normal 90 second timeout) your download should begin.
By default, Firefox will ask you if you want to open or save the file - I suggest saving it just to keep things simple and open it later. Do this as soon as you can, though, as the download doesn't begin until you make the choice (another good reason not to wander too far away). At any time during the download, click on the downward green arrow in the right upper corner to see the status of ongoing downloads.
Finally, I would suggest you change network.http.connection-timeout back to the default value when done, as leaving it on this setting will make your browser wait a very long time before letting you know if you try to connect to some other website with connectivity problems.
If you don't have Firefox, you can download it for free at https://www.mozilla.org/en-US/firefox/new/.
Note that in my researches, it appears that Chrome does *not* support changing a connection timeout, even though users have been requesting it for over 6 years. This is a downer to me, as I usually use Chrome.
There appears to be a way to do this in Internet Explorer (see https://support.microsoft.com/en-us/kb/813827) but since it involves modifying Windows registry values, I do not recommend it unless you are an experienced user and have some sort of love affair with Internet Explorer.
Good luck!
UPDATE: I just started a download of Ultimate Combat and it took 2 minutes before the Firefox save menu came up. If I'd been using the default 90 second value or Chrome, it would have been a failure. Instead, it is merrily downloading (5 minutes remaining!) as I type this sentence.
UPDATE2; I have downloaded 5 files in the past hour using this technique. Previously, I had only gotten 2 files over the course of 4 days.
knightnday |
The 117 might be a reference to the individual chapter files for some of the books. I have not downloaded the books in that manner, so it is just speculation.
@Dave Talbert: While you might not be planning on hosting or pirating, that doesn't mean that everyone else is on the up and up. Paizo has been putting up a fight against digital pirates for years -- and from what I understand giving some of them fits -- so it is in their best interest not to release the books without watermarks. Sure, there are probably cleaned copies out there, but turning off the watermarks on however many thousand copies of the books is just asking for trouble.
barentsoya |
How so, if there are already cleaned copies out there?
But that's not really my issue. I think it was Gabe Newell that said that piracy is mostly a service problem. Judging by the nine hundred messages here, it looks like a lot of people aren't being served. I'd be interested to know what Paizo mgmt thinks about that.
Anguish |
4 people marked this as a favorite. |
HINTS FOR THE PERSONALIZER - based on my experience over the last decade.
- Don't Go Away - the process times out if you don't click the link every minute or so
- Personalized Files Are Temporary - the system will remove your personalized file after a few hours regardless of if you download it, requiring a new personalize
- Multiple Personalizes Won't Help - don't use multiple browsers or tabs to try to personalize more at once; this will only harm performance
- Bigger Files Take Longer - the more pages a PDF has, the longer it takes to personalize so expect rules books to take longer
- Think Of Steam - You can always come back and download your files later, even years later
- Some Of Humble Bundle Is Available FREE in HTML - You can visit the Pathfinder Reference Document where the key rules for all the major books are in hypertext
No the new hardware is not picking up the slack like you said it would - nor is any "improvements" in the programming that you may have done.
This is my least-helpful response: the improvements have had effect. They're just not enough. When this started, the entire site was verging on dead. The forum and store frequently wouldn't load at all, or would only load partial pages. Today, the download system is the only part of the system that shows significant stress. Yes, absolutely, that's the most important part for most of you, but the fact that we can post to have this discussion does have value.
And no the files don't stay in the queue after the response of "Personalizing" comes up because when I try again later - maybe 10 minutes, maybe 4 hours - it still wants to "personalize" the files again.
Here's a non-intuitive fact. The personalizer isn't permanent.
Basically, when you personalize a PDF, the system takes a master copy of the file and edits the PDF to apply your customer information etc to each page. Obviously larger files take longer for this to happen, but once this is complete, the file is placed in a temporary holding area. I don't know how long this temp file lasts, but I'm pretty sure it's only a few hours.
This is a necessity as storing unique copies of everyone's files forever is impractical. If you need to download a file two days in a row, you need to personalize it each day. This normally doesn't matter because it normally only takes 3-5 seconds, except on days when massively popular books are released, when it might take the full 10 seconds.
What this means is you pretty much must sit around prodding the system. If you go away, your temp file will likely expire even if the personalize succeeds.
So I attribute the 3 files that I did get downloaded as flukes of the system.
Yes, they're most likely flukes based on a set of factors including personalizer demand at the moment, the persistence of your clicking the "click here after 10 seconds" link, and the size of the files in question.
Its a shame that Paizo can't see past their own nose and allow other sites involved in etrade (like rpgnow and drivethru rpg) sell their files.
Not cool. Paizo is absolutely aware of the issue. That doesn't mean that there is a perfect solution to it that can be implemented before the problem resolves itself.
This is a problem of numbers. We're talking about a potential customer-demand well in excess of a million PDF personalize operations. Even when high-demand new books are released, odds are very good that the system needs to process maybe 10,000 personalize requests that day. We're looking at in the general realm of 100x the peak demand ever required.
That still sucks. I absolutely, positively don't disagree. But RPGNow and DriveThruRPG would very, very likely have similar issues if they experienced 100x their peak demand.
Now, people keep pointing the finger, and - again - I understand the frustration. But what happened here is that the 48-hour demand for the Humble Bundle was nearly four times the demand for the historic most popular book bundle ever. HB said "one time we sold 10,000 bundles". That's a number the system should have been able to handle over the two weeks of the offer. But instead there were something shy of 40,000 bundles sold in fourty eight hours. Instead of about 700 bundles a day, it was nearly 20,000 bundles. 30x the predicted performance of the best selling ever.
I'm just posting this to try to help manage expectations. Something happened here that nobody would have predicted. And everyone's suffering because of it.
But you WILL get your PDFs. Paizo's download area is forever. Even if it takes a week to cope with the absurd back-log, you WILL get your product.
Please imagine this as a sale where the seller ran out of stock on a product because of 30x more customers than anyone predicted might want the thing. More WILL be made, and you WILL get yours. Unfortunately, it's on back-order, and it will take a while for the factory to make some more.
Xyxox |
2 people marked this as a favorite. |
I have now successfully downloaded the entire Humble Bundle, including all formats for each product.
I accomplished this in IE by first queuing about a dozen files for personalization, then going back and downloading. I've found that five files in the download queue usually resulted in timeouts on the sixth download, so I started waiting for a download to complete before starting the next download, all the while keeping 5 downloads in the queue. By simply being patient and taking the time, I was able to queue personalization and downloading dynamically, which took about 6 hours for every file in the Humble Bundle.
YMMV.
Joana |
I am having trouble downloading PDFs that I need for a convention that I am helping organize. Any advice rather than trying another five times for a single file? I keep on getting timed out.
If it's timing out after going to the "Your download should begin in 5 seconds" page, try this.
I've had luck in getting files in IE and Firefox when Chrome keeps timing out on me.
As noted here, Firefox will allow you to reset the amount of time it waits for a connection before giving up, which worked for me.
KNHaw |
I am having trouble downloading PDFs that I need for a convention that I am helping organize. Any advice rather than trying another five times for a single file?
See my post about the Firefox workaround above. If you give it a shot, please message me with any improvements I can add to make my instructions clearer.
The4TimeTravelers |
2 people marked this as a favorite. |
USE IE... believe me Chrome is a pain with this download process. Err_Time-Out
I have been trying with Chrome since day one and finally caved back to using IE thanks to this forum. 30 minutes later I have all of my $1 pledge PDF and free gifts.
I will finally consider my $25 pledge upgrade. :)
USE IE TO DOWNLOAD - NOT CHROME
Chaderick the Penguin |
3 people marked this as a favorite. |
Just finished downloading the last of my files.
HUGE thank you to the Paizo team for your sleepless hours and hard work. I am consistently amazed by your professionalism in the face of a minority of customers who, in any situation, take justifiable frustration and turn it into maddening entitlement. Thank you, as always, for being who you are, and giving us a thriving, diverse, and thoroughly enjoyable hobby.
As a side note, while I was "personalizing," I was shopping Noble Knight Games. Just (finally) landed the whole Council of Thieves series at a price that matches what I usually see for just the first volume. When the dust from the Humble Bundle clears, I'll be back to pick up the pdf's for that Adventure Path, too...and the last three parts of Hell's Rebels.
I suppose that makes me a lifer...
Thanks again!!!
Joana |
Yay for reports of success starting to outnumber reports of failure! :D
Tech team, you might want to make a note about the timing-out problem and how to solve it in Chris's consolidated Updates thread.
Nutcase Entertainment |
How so, if there are already cleaned copies out there?
But that's not really my issue. I think it was Gabe Newell that said that piracy is mostly a service problem. Judging by the nine hundred messages here, it looks like a lot of people aren't being served. I'd be interested to know what Paizo mgmt thinks about that.
Would probably be less than half the posts if most people didn't just TL;DR it.
And I think some are just buying stuff for the images.
Captain Olivia Quinn |
1 person marked this as a favorite. |
Gorbacz wrote:Feh. I must be a filthy 'Murican because I much prefer bourbon over Scotch.Liz Courts wrote:Pah, bourbon. Single malt Scotch from Islay is where the life is at.Pray-zos go to our IT staff.
I hear accepted offerings like small batch bourbon go over well.
Pfft!
Release the Kraken!