Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 ... 5 6 [7] 8

Author Topic: DFFD Hosting Change  (Read 23640 times)

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #90 on: January 12, 2015, 11:17:51 pm »

Is there anything that DFFD users (primarily modders) can do to ease the transition?  Maybe it would help to refrain from updating anything 24 or 48 hours prior to the move, that way there is no huge rush to grab everything at the last moment.  Only view/download and comments would need to be updated based on the last day's usage.

Does the dffd.wimbli.com domain go dark after the 15th, or can it redirect to the new site?
When the time comes, if need be, I can lock uploads with a note on the page indicating the reason.

The domain name will either point directly to the new server with no change, or more likely it will be made to redirect seamlessly to the new domain (preserving page links).
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #91 on: January 13, 2015, 09:22:23 pm »

Just an update, the new server is mostly set up now. There's only a little bit of configuration left to do. It is however looking it's going to take several days to get all of the uploads transferred to the new server. I'm starting with the most recently updated files and having it work back from there.

So, once the switch has been made to use the new server, a lot of older files are going to be unavailable for a few days until the transfer of uploads is complete.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

PeridexisErrant

  • Bay Watcher
  • Dai stihó, Hrasht.
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #92 on: January 14, 2015, 06:30:54 am »

The deadline is the 15th. Of course, I do have ~146 GB of files that will need to be uploaded once a new server is set up, and that will probably take a couple of days at least.

Having just over 3 days of logs now, here's the data:
Average Bandwidth per Day    71.44 GB

There haven't been any major pack releases or anything of the sort in the past 3 days, so this is probably a good example of the low end of bandwidth to expect (a bit over 2 TB bandwidth per month). As mentioned before, when the more popular packs are posted and when major new releases of DF come out, the bandwidth will probably be substantially higher.
Just an update, the new server is mostly set up now. There's only a little bit of configuration left to do. It is however looking it's going to take several days to get all of the uploads transferred to the new server. I'm starting with the most recently updated files and having it work back from there.

I just found this topic, and if there's anything I can do let me know - for now I'll continue as usual.

The Starter Pack contributes ~680 * 80MB per day, or a little more than two-thirds (56/76 GB) of all DFFD bandwidth by these numbers.  At ~$10/month donations to me don't cover anything at all, and it's unclear if Dropbox Pro offers 20 or 200 GB/day; if it's the latter I could go to that.  FWIW, I've watched the numbers a couple of times and my big release spikes are less than double the mean rate for the first ~48 hours, and while 40.01 was more popular the download was smaller.
Logged
I maintain the DF Starter Pack - over a million downloads and still counting!
 Donations here.

Thief^

  • Bay Watcher
  • Official crazy person
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #93 on: January 14, 2015, 06:57:16 am »

$10/month is plenty to host something like that, digitalocean.com offers a $10/month plan with 2 TB of bandwidth. Disk space isn't enough for hosting the entire DFFD, but for a small set of high-bandwidth files something like this is perfect.
Logged
Dwarven blood types are not A, B, AB, O but Ale, Wine, Beer, Rum, Whisky and so forth.
It's not an embark so much as seven dwarves having a simultaneous strange mood and going off to build an artifact fortress that menaces with spikes of awesome and hanging rings of death.

PeridexisErrant

  • Bay Watcher
  • Dai stihó, Hrasht.
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #94 on: January 14, 2015, 07:59:00 am »

$10/month is plenty to host something like that, digitalocean.com offers a $10/month plan with 2 TB of bandwidth. Disk space isn't enough for hosting the entire DFFD, but for a small set of high-bandwidth files something like this is perfect.

Perfect, that is, if I had the skills to run a website off a server  :P
Which I don't  :'(

I'll keep it in mind as a backup if all else fails though!
Logged
I maintain the DF Starter Pack - over a million downloads and still counting!
 Donations here.

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #95 on: January 15, 2015, 07:06:03 pm »

There are still a few thousand files to go being transferred, but I've gotten the old host to extend their deadline to the 19th. The files should be done transferring in the next day or two.

I'll make the switch to the new server once all of the files are transferred, so it should end up being a seamless transition after all.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Change
« Reply #96 on: January 17, 2015, 11:02:07 am »

All right, the transfer is done! The domain name has also been updated from dffd.wimbli.com to dffd.bay12games.com. All old links to dffd.wimbli.com file listings will still work, they'll just be seamlessly redirected to the correct page on the new domain. You should still consider updating old links just in case.
Downloads should also be a lot faster, but we'll see how it goes once there are several people downloading at a time.

EDIT:
Needless to say, if you run into any problems, let me know.
« Last Edit: January 17, 2015, 11:16:58 am by Janus »
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Button

  • Bay Watcher
  • Plants Specialist
    • View Profile
Re: DFFD Hosting Change
« Reply #97 on: January 19, 2015, 09:47:09 pm »

Incidentally, dffd.wimbli.com is now considered by my work's blocking software as an "Adult" site. dffd.bay12games.com works fine, though.

Yes, the wimbli address was accessible on my work computer before.

(Shut up, my personal computer is a desktop, so when I want to sit in front of a fire and sip hot cocoa and play Dwarf Fortress I have to do it on my work computer.)
Logged
I used to work on Modest Mod and Plant Fixes.

Always assume I'm not seriously back

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Change
« Reply #98 on: January 19, 2015, 09:51:39 pm »

Incidentally, dffd.wimbli.com is now considered by my work's blocking software as an "Adult" site. dffd.bay12games.com works fine, though.

Yes, the wimbli address was accessible on my work computer before.

(Shut up, my personal computer is a desktop, so when I want to sit in front of a fire and sip hot cocoa and play Dwarf Fortress I have to do it on my work computer.)

That's definitely odd. The only thing any dffd.wimbli.com link will respond with is an "HTTP 301 Moved Permanently" redirect leading to the appropriate page on the new dffd.bay12games.com domain. I admit, that might be pretty hardcore to some people, but still... :P
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Dirst

  • Bay Watcher
  • [EASILY_DISTRA
    • View Profile
Re: DFFD Hosting Change
« Reply #99 on: January 20, 2015, 11:03:46 am »

Incidentally, dffd.wimbli.com is now considered by my work's blocking software as an "Adult" site. dffd.bay12games.com works fine, though.

Yes, the wimbli address was accessible on my work computer before.

(Shut up, my personal computer is a desktop, so when I want to sit in front of a fire and sip hot cocoa and play Dwarf Fortress I have to do it on my work computer.)

That's definitely odd. The only thing any dffd.wimbli.com link will respond with is an "HTTP 301 Moved Permanently" redirect leading to the appropriate page on the new dffd.bay12games.com domain. I admit, that might be pretty hardcore to some people, but still... :P
It's because Button was modding in all the naughty bits on plants ;)

Someone up-thread complained that there was objectionable content buried on dffd.wimbli.com, and a spider could have found that.  Corporate blocking software doesn't really suffer any consequences for false positives.  Nice to know the spider found the problem just in time for the whole site to move somewhere else.
Logged
Just got back, updating:
(0.42 & 0.43) The Earth Strikes Back! v2.15 - Pay attention...  It's a mine!  It's-a not yours!
(0.42 & 0.43) Appearance Tweaks v1.03 - Tease those hippies about their pointy ears.
(0.42 & 0.43) Accessibility Utility v1.04 - Console tools to navigate the map

Meph

  • Bay Watcher
    • View Profile
    • worldbicyclist
Re: DFFD Hosting Change
« Reply #100 on: January 20, 2015, 02:23:54 pm »

I had the bay12 forums blocked as "adult" now and then, when using internet at some places.
Logged
::: ☼Meph Tileset☼☼Map Tileset☼- 32x graphic sets with TWBT :::
::: ☼MASTERWORK DF☼ - A comprehensive mod pack now on Patreon - 250.000+ downloads and counting :::
::: WorldBicyclist.com - Follow my bike tours around the world - 148 countries visited :::

Button

  • Bay Watcher
  • Plants Specialist
    • View Profile
Re: DFFD Hosting Change
« Reply #101 on: January 20, 2015, 02:56:29 pm »

It's because Button was modding in all the naughty bits on plants ;)

 :-X Shhh, don't let them know! I wouldn't be able to bear the stigma!
Logged
I used to work on Modest Mod and Plant Fixes.

Always assume I'm not seriously back

DeDeRon

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Change
« Reply #102 on: January 20, 2015, 04:40:10 pm »

i'd really like to see at least the main stuff (df, dfhack, dt, starter packs) to be available as torrents. now that things have settled this would make even more sense. can we establish some sort of "torrent culture" to lower the traffic for the dffd server?

lethosor

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Change
« Reply #103 on: January 20, 2015, 04:48:19 pm »

DFHack isn't hosted on DFFD any more: https://github.com/dfhack/dfhack/releases/
Logged
DFHack - Dwarf Manipulator (Lua) - DF Wiki talk

There was a typo in the siegers' campfire code. When the fires went out, so did the game.

Dirst

  • Bay Watcher
  • [EASILY_DISTRA
    • View Profile
Re: DFFD Hosting Change
« Reply #104 on: January 20, 2015, 05:33:19 pm »

DFHack isn't hosted on DFFD any more: https://github.com/dfhack/dfhack/releases/
It is still embedded in the starter packs, though.  The top-three downloads on DFFD are starter packs, followed by Masterwork which is itself kind of a specialized starter pack.  They're also the largest general-interest files.

So, it makes sense to try to offload some of that downloading from Bay12.  Whether that's with mirrors or torrents or an Akamai-style content delivery system, it's a conversation worth having.
Logged
Just got back, updating:
(0.42 & 0.43) The Earth Strikes Back! v2.15 - Pay attention...  It's a mine!  It's-a not yours!
(0.42 & 0.43) Appearance Tweaks v1.03 - Tease those hippies about their pointy ears.
(0.42 & 0.43) Accessibility Utility v1.04 - Console tools to navigate the map
Pages: 1 ... 5 6 [7] 8