Bay 12 Games Forum

Please login or register.

Login with username, password and session length
Advanced search  
Pages: 1 ... 4 5 [6] 7 8

Author Topic: DFFD Hosting Change  (Read 23604 times)

dorf

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #75 on: January 09, 2015, 07:06:24 am »

EDIT2: Is there a javascript bittorrent client? Then people wouldn't even need torrent software.
Opera has a bittorent client built-in, other browsers have various add-ons available (some are written in JS if that counts).

BitLet is a online Java Applet which lets you download torrents to your computer.

Logged

Iamblichos

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #76 on: January 09, 2015, 03:16:55 pm »

I just found this... I agree with everyone who says that the title should be a lot more eye-catching.

@Janus: is the objection of the ISP monetary (you need to pay for hosting) or compliance-based (i.e., you are forbidden from doing this)?

If there's a fee that can be paid to keep it up in its current configuration, I would be willing to foot the bill for a month or two to implement a proper long-term solution.  I'm not made of money by any stretch, but I can dump a few hundred dollars into a resource that is so useful for the community.

Moving the files should be done once there is a plan, not all in a rush; otherwise the lack of planning on the front end often makes a much larger mess to clean up on the back.
Logged
I'm new to succession forts in general, yes, but do all forts designed by multiple overseers inevitably degenerate into a body-filled labyrinth of chaos and despair like this? Or is this just a Battlefailed thing?

There isn't much middle ground between killed-by-dragon and never-seen-by-dragon.

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #77 on: January 09, 2015, 09:03:32 pm »

@Janus: is the objection of the ISP monetary (you need to pay for hosting) or compliance-based (i.e., you are forbidden from doing this)?
As per the first post, it's due to a policy change with my host which no longer allows file hosting sites.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Nokao

  • Bay Watcher
  • [NEED ALCOHOL TO GET THROUGH THE WORKING DAY]
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #78 on: January 10, 2015, 05:21:45 am »

@Janus: is the objection of the ISP monetary (you need to pay for hosting) or compliance-based (i.e., you are forbidden from doing this)?
As per the first post, it's due to a policy change with my host which no longer allows file hosting sites.

So it's not that we can pay more, we just have to find another place, right ?

Can you write again how many time we have left ?

I want to clarify that my point is:
I don't have a hosting in USA,
but for my Europen customers it's good if I replicate their websites in USA,
so I would like to open a server in USA (I had 1 in GoDaddy but I closed it in 2010),
and this "DFFD" hosting is an occasion for me to make a new professional server,
and put DFFD inside it for free, + offer a new service for my customers.

puke

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #79 on: January 10, 2015, 06:45:58 am »

Just some more ideas for you here, and I understand that you don't have the metrics to know this now, but just entertain this possibility:

If Nokano can take a portion of the bandwidth - say that of the European and Scandinavian users (or possibly even all EMEA) - then we could do a little global load balancing to split the traffic load.

Keeping in mind that the server and storage is very low cost, and the real issue is paying for the downstream bandwidth.   This would cost more overall as you can not take advantage of an economy of scale to get a single lower rate, but it does let you easily divide the cost between people that can individually subsidize a portion of it.

Again, I'd suggest using Amazon's GLB service.  You could keep the cost down by using long cache times on the name records.  You guys might have other ideas about competitive products, also.
Logged

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #80 on: January 10, 2015, 09:58:00 am »

The deadline is the 15th. Of course, I do have ~146 GB of files that will need to be uploaded once a new server is set up, and that will probably take a couple of days at least.

Having just over 3 days of logs now, here's the data:
Average Bandwidth per Day    71.44 GB

There haven't been any major pack releases or anything of the sort in the past 3 days, so this is probably a good example of the low end of bandwidth to expect (a bit over 2 TB bandwidth per month). As mentioned before, when the more popular packs are posted and when major new releases of DF come out, the bandwidth will probably be substantially higher.

Still, the Linode 8 GB plan ($80/month) might be able to cover it with the 8 TB bandwidth provided. The storage space of 192 GB would be a bit limiting since the currently uploaded files themselves are just shy of 150 GB and that will of course grow over time, and that doesn't include the OS and software and space for log files and such. That could be upgraded to the 16 GB plan later, though that will apparently result in several hours of downtime with the storage size involved.

The Linode 16 GB plan would be comparable in price to the dedicated server I mentioned, at $160 vs. $169. So, here's a feature comparison. It would have more memory (16 GB vs 4 GB) and possibly more powerful CPU allocation than the dedicated server, though those aren't really that important for a file hosting site like this. It would have 384 GB of SSD storage vs. the 1TB RAID 1 (mirrored) setup on the dedicated server; much faster and higher file I/O with the SSD, which is very nice, though less storage space and no data redundancy as a safety net. It would be limited to 16 TB bandwidth where the dedicated server is unlimited, though the site isn't that likely to reach 16 TB in a month. It also has 2000 Mbps outgoing bandwidth (not sure if shared, probably so) vs. 1000 Mbps (dedicated) on the dedicated server.
So... a bit of a toss up between the two, with the 16 GB Linode plan probably being a bit better.

I'll make sure Toady knows about the latest info here.
« Last Edit: January 10, 2015, 10:00:03 am by Janus »
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Nokao

  • Bay Watcher
  • [NEED ALCOHOL TO GET THROUGH THE WORKING DAY]
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #81 on: January 10, 2015, 12:28:06 pm »

Janus, can I reach you in skype or any other chat software for a few details ?

ArmokGoB

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #82 on: January 11, 2015, 10:27:16 am »

Is making your own server out of the question?
Logged
Cyclopes, prepare to meet your demise at the metaphorical hands of my cushion ruby cabochons.

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #83 on: January 11, 2015, 04:11:31 pm »

I've heard from Toady and it looks like he's planning to host the site, so that's taken care of.
Thanks for the offer, Nokao, it was very kind of you.  :)

Is making your own server out of the question?
Hosted from your home? Your ISP would not take kindly to that.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

smirk

  • Bay Watcher
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #84 on: January 11, 2015, 04:54:22 pm »

I've heard from Toady and it looks like he's planning to host the site, so that's taken care of.
Excellent! Will the site stay substantially the same, or are you planning any changes aside from the move? The torrenting option sounded like a good idea, assuming it's not too complicated to implement.
Logged
When i think of toady i think of a toad hopping arround on a keyboard
also
he should stay out of the light it will dry out his skin
his moist amphibian skin
.

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #85 on: January 11, 2015, 09:45:02 pm »

I've heard from Toady and it looks like he's planning to host the site, so that's taken care of.
Excellent! Will the site stay substantially the same, or are you planning any changes aside from the move? The torrenting option sounded like a good idea, assuming it's not too complicated to implement.
Policies on accepted uploads will probably be changed a little to be in line with the forum here. I will be looking into the possibility of generating directly seeded torrents for each upload, though from looking into that possibility several years back it was rather complicated. Maybe it's gotten easier since then. I'm also not convinced it will be all that useful; many people would still go straight for the direct download, and the torrents are only helpful when a decent number of people not only use them but keep seeding them afterward.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Meph

  • Bay Watcher
    • View Profile
    • worldbicyclist
Re: DFFD Hosting Dilemma
« Reply #86 on: January 12, 2015, 07:10:27 am »

Torrents are faster though. I know that the people always went for my fast server, not dffd. When I made an update that was both on dropbox (fast) and dffd (slower), the people used my dropbox until it got blocked (after 10gb traffic), then started using the dffd link.
Logged
::: ☼Meph Tileset☼☼Map Tileset☼- 32x graphic sets with TWBT :::
::: ☼MASTERWORK DF☼ - A comprehensive mod pack now on Patreon - 250.000+ downloads and counting :::
::: WorldBicyclist.com - Follow my bike tours around the world - 148 countries visited :::

Nokao

  • Bay Watcher
  • [NEED ALCOHOL TO GET THROUGH THE WORKING DAY]
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #87 on: January 12, 2015, 07:25:55 am »

I've heard from Toady and it looks like he's planning to host the site, so that's taken care of.
Thanks for the offer, Nokao, it was very kind of you.  :)

It was a pleasure, DF future developement is very important for me.
Even if I don't approve 100% of Toady One choices.

I will make a good donation to Toady One now,
cause I proposed to help and I didn't yet.

If you need other technical help as hosting or webmaster just write me,
like -I don't know- updating software or moderating old DFFD stuff, or forums, etc.

Bye :)

Janus

  • Bay Watcher
  • huffi muffi guffi
    • View Profile
    • Dwarf Fortress File Depot
Re: DFFD Hosting Dilemma
« Reply #88 on: January 12, 2015, 07:43:52 am »

Torrents are faster though. I know that the people always went for my fast server, not dffd. When I made an update that was both on dropbox (fast) and dffd (slower), the people used my dropbox until it got blocked (after 10gb traffic), then started using the dffd link.
The new server will have much faster download speeds, as mentioned.
Logged
Tomas asked Dolgan, "What place is this?"
The dwarf puffed on his pipe. "It is a glory hole, laddie. When my people mined this area, we fashioned many such areas."
     - Raymond E. Feist, Magician: Apprentice  (Riftwar Saga)

Dirst

  • Bay Watcher
  • [EASILY_DISTRA
    • View Profile
Re: DFFD Hosting Dilemma
« Reply #89 on: January 12, 2015, 11:54:32 am »

Is there anything that DFFD users (primarily modders) can do to ease the transition?  Maybe it would help to refrain from updating anything 24 or 48 hours prior to the move, that way there is no huge rush to grab everything at the last moment.  Only view/download and comments would need to be updated based on the last day's usage.

Does the dffd.wimbli.com domain go dark after the 15th, or can it redirect to the new site?
Logged
Just got back, updating:
(0.42 & 0.43) The Earth Strikes Back! v2.15 - Pay attention...  It's a mine!  It's-a not yours!
(0.42 & 0.43) Appearance Tweaks v1.03 - Tease those hippies about their pointy ears.
(0.42 & 0.43) Accessibility Utility v1.04 - Console tools to navigate the map
Pages: 1 ... 4 5 [6] 7 8