Error on www.doom9.org ?

[Syntech]

Hi!

hmm ..
Anyone else get to the 'Welcome Site/User Administrator'
when trying to load the mainpage 'www.doom9.org' ?

Strange....

[coona]

Similar here - I was redirected to https://www.doom9.org but is it funcional again :).

[Syntech]

hmmm ....

Not working for me :(

being redirected to : https://www.doom9.org:19638/webhost/rollout

Well, maybe they are working on it :)

[coona]

That was exactly my case but now there is another redirection :):

www.doom9.org:443

But I was able to access main page only 5-10 minutes ago. Strange :confused:.

EDITED 15:40

www.doom9.net seems to work.

[Syntech]

same with .net

... https://www.doom9.org:19638/webhost/rollout

:(

[cypher_soundz]

yup i had the same problem , same with the forum, kept coming up with an error :confused: .
What happend?
Regards
Cyph

[Soulhunter]

Had similar errors while trying to access the forum ! :confused:

Only the last 2 or 3 days IIRC... :(

Bye

[Doom9]

seems there's a power problem at the location of the forum server. As for the main page, you guys could actually help me. I had one of my mirrors shut down only two weeks ago, and got a replacement almost instantly, only then the guy decided that he wants an ad to keep hosting me. Since I don't like ads, especially not ones that I signed off on (and where money would go into my pocket rather than somebody elses), and I was late to reply to the ad for hosting proposition so the other party must've made up their mind first. I had no notice or anything. So, one less server.
Now, I don't really like to talk about this, but the donations are way not enough to cover the hosting costs, so what I have is a few nice people who instead of making a donation, offer hosting. Now, what they are offering is very precious because it keeps this site alive. I'm already spending most of my free time doing this, and I use the donation money to cover hosting cost for the mailserver, startup translated doom9 mirrors, dns hosting and domain registrations, and I frankly cannot afford to pay for 800-1000GB/month. So, if there is anyone out there who has a server (it doesn't have to be fast as we're only talking about static html content, RAID and all the other nifty server stuff isn't that important and my DNS takes care if a server goes down for a while), and doesn't have a problem with say 200-250GB traffic a month (the round robin between the servers isn't perfect), I'd really appreciate it. Keep in mind, it is thanks to a handful of people that the site still exists in the same form today, as it started out 3.5 years ago.
I know I could outsource downloads but that just makes the site so much less attractive.. I've always wanted to offer a small software archive but containing the software you really need, and since this soft is rather popular, it just creates a lot of traffic. So before you suggest linking to official homepages, P2P tools, etc, think about how it would be if you had to go to ten different places before you could start with a guide. I know I wouldn't like it so that's why I'm trying to keep the download archive. I've lost a lot of sleepless nights about the whole hosting things over the years, and I know there are easy fix (I even had an offer to cover the entire hosting, site and forum, against a popup, but I hate popup even more than you so I just couldn't accept that), but I don't mind going to extra mile and I hope someone out there agrees with me.

[Neo Neko]

I have seen this error several times intermitantly over the last year. I thought it was just me. I can't reproduce it reliably. But there is a misconfigured server in the rotation somewhere. And it is not the forum server. It only hapens when loading the main page and only in non-IE clients like Konqueror, Safari, Mozilla, or Opera.

[Syntech]

I would love to help you out, but since I don't have the bandwith,
it would just end up beeing another bottleneck...

I can only manage around 140-150Gb/month (at best) if I dedicate
the whole line for the site, so it would not be an option :(

But I'm sure there are others around, willing to help you out with faster connections... :)

Cheers

Anders Kallander

[Doom9]

well.. since there were no other replies I've had to cut down on the software archive. Today, I've outsourced several tools which should lead to 250GB+ traffic less a month, yet any mirror offers would still be welcome (but now the traffic requirements should be some 50GB/month lower).

[SeeMoreDigital]

I'm sorry Doom9 I missed this thread totally!

How much money did they want per month if you did not want to carry ads?

Cheers

[Doom9]

How much money did they want per month if you did not want to carry ads?I haven't asked. But since I check most hosting ads in every PC mag I buy I doubt it's going to be anything I'm willing to pay (basically, if I have to go to work to be able to pay for hosting then I'm gonna quit.. investing most of my freetime is as much as I'm willing to invest).

[Neo Neko]

Well if you are interested I or someone else could look into using bittorrent to host and transfer files. It would not take large amounts of bandwidth. Just a few people with non transient connections with a bit of bandwidth to spare to seed files. If anyone is interested in such a thing let me know. It is definatly an avenue to explore. Perhaps we could just host the most downloaded packages via bittorrent as that would be most effective anyway. And then we could put the rarely accessed ones on the server. :D

[r6d2]

Originally posted by Neo Neko
[B]Well if you are interested I or someone else could look into using bittorrent to host and transfer files.
I'm with you, Neo Neko! Perhaps e-mule can be used too, it's very popular, secure and robust.

Let's create a task force for this!

[SeeMoreDigital]

Well I leave my Media PC on 24/7. It's used as an files and internet access server!

However my current connection speed is only around 150k and I suppose would be too slow to be of any use - but I could up it to 600k at a small extra cost per month!

Some time ago I loaded Apache server and set aside 5Gb on a partition to host my own web site, but as yet I've not got round to doing anything with it!

Earlier this year SETI (http://setiathome.ssl.berkeley.edu/) was asking people if they could use the combined processing power of their PC's to help in their search for extra terrestrial life... I know it's not the same as what you are asking for but Doom9 is of far more use to me!

Is there anything I (and other forum members who leave their PC's on 24/7) can do to help?

[Neo Neko]

Well you would be a prime candidate for a bittorrent seeder. You would not even need to raise your upstream bandwidth. 30~60kbps would be more than adequate. Especially if there were another seeder or two. But before such a task is done we would need to know which packages are the worst drain etc and how often they are accessed to assess feesability of it.

[SeeMoreDigital]

Thanks Neo,

Nice to know I'd be good for something!

Cheers

[Doom9]

top 10 stats by KB, October 03. That's just one server so take those numbers times 4.5 to get a rough total

1 7871 0.05% 12919883 7.59% /Soft21/Codecs/DivX51Bundle.exe
2 8506 0.06% 11796975 6.93% /Soft21/Codecs/DivXPro51GAINBundle.exe
3 27791 0.19% 11647113 6.84% /Soft21/Rippers/SetupDVDDecrypter_3.1.7.0.exe
4 576220 3.85% 7092663 4.17% /right.html
5 7266 0.05% 6126232 3.60% /Soft21/Decoders/DVDx_22_setup.exe
6 8420 0.06% 5020578 2.95% /Soft21/Editing/VirtualDubMod_1_5_4_1_All_inclusive.zip
7 10298 0.07% 4359479 2.56% /Soft21/Rippers/SetupDVDDecrypter.exe
8 4099 0.03% 3867044 2.27% /Soft21/Vobtools/DoItFast4U.v.1.3.0.exe
9 3021 0.02% 3472009 2.04% /Soft21/svcdtools/tscv 0.84.rar
10 3942 0.03% 2569224 1.51% /Soft21/Decoders/XMPEG5.0RC2-3.exe

The format:
Ranking #nb_access, percentage_of_total, total_traffic, percentage_of_total_traffic, path_n_filename

But now, DivX has been outsourced to the official homepage. SAme with VDubMod, DIF4U, TSCV and XMPEG so the only one remaning (70GB last month) is DVD Decrypter and I'm not inclined to remove that for obvious reasons. DVD2SVCD and GordianKnot have been served by their official homepage for a while now. I've even re-added the free edition of VCDEasy (goes to a German PC mag that carries the soft).
The only thing I couldn't outsource was DVDx.. as you may know the official homepage only allows download if you're a member (so that's because most people come and get it from my site) and membership isn't free.

[r6d2]

Originally posted by Neo Neko
30~60kbps would be more than adequate. Especially if there were another seeder or two.
I have just 64-kbps upload BW. I started playing with BitTorrent but quite unlucky I guess.

[Doom9]

there are three major concerns I have regarding bittorrent (and one more regarding emule: emule is considere to be a pirate tool):
1) update speed: if a new program comes out, I often am one of the first sites to have it for download (just as an example my current number one, DVD Decrypter). Being the first makes more people come to my site, and some of them might come back again. If you have to go through the whole seeding process, things will never be as fast (and it's out of my hands, too).
2) Don't you need many seeders to guarantee promt delivery? Tools that aren't updated will become less popular over the time, thus making it harder to get them.
3) Everybody has a browser, many have a download manager but few have bittorrent installed.

[DAvenger]

Very few people know about BitTorrent ... although its initial intention was (legal) software delivery it's now widely used for illegal activities (99,9%).

Anyway, my DSL has nasty traffic limit so I would not be able to help out :(

[r6d2]

Originally posted by Doom9
If you have to go through the whole seeding process, things will never be as fast (and it's out of my hands, too).
I understand this is supposed to be the problem BitTorrent solves.
Don't you need many seeders to guarantee promt delivery? Tools that aren't updated will become less popular over the time, thus making it harder to get them.
You need indeed many seeds, but popularity is measured by uploads, not updates. This should not be a problem.
Everybody has a browser, many have a download manager but few have bittorrent installed.
I understand BitTorrent can be made to work transparently, much like e-mule's links.

But I'm a novice at this technology. I just "bought" the FAQ&Info facts. ;)

[netterpaladin]

I have one suggestion concerning the server demands for doom9:


When we consider homebased servers: The problem is that most of us have only small upload DSL connections which suck as a server. BUT of course i have a solution. That is why i am writing all this.

I just came back from my favorite country: JAPAN. There they not only have DSL BUT also 100 mbit home connections!!!!!!!!!!!! I had one! It is very cheap and has no transfer limit as far as i could tell. It is actually quite surprising. The japanese are quite lawful (usually), so Filesharing is not a problem yet. My japanese is not good enought for reading contracts and small prints. For that we have to ask some native Japanese. I recommend Liisachan at this point.

If doom9 or Liisachan can find a japanese DVD/divx freak, he might be willing to offer his 100 mbit line as a server and all our problems should be solved. The only problem is, that the oversee connections to germany and the US are not as good as a western bases server but this should help nevertheless.

I have some friends in Japan, but none of them is dedicated to divx encoding :(

netterpaladin

[Neo Neko]

Originally posted by Doom9
there are three major concerns I have regarding bittorrent (and one more regarding emule: emule is considere to be a pirate tool):


Any P2P software that is avalible to the general public is going to be used for pirating. But that does not mean that they don't have legal uses. Bittorrent is better in this respect. Once I or someone else gets this 100% figured out it should be possible to restrict who can upload/seed files. So no strangers uploading things we don't want. Bit torrent has no search function. You have to find your torrent links on web sites etc. Which again means more control.

Originally posted by Doom9
1) update speed: if a new program comes out, I often am one of the first sites to have it for download (just as an example my current number one, DVD Decrypter). Being the first makes more people come to my site, and some of them might come back again. If you have to go through the whole seeding process, things will never be as fast (and it's out of my hands, too).

That should not be a major issue either. Simply create a new torrent and replace the old one on the downloads page. Viola! No new downloads of the old software would start. Anyone who had not completed the old download would continue to try but if there were no distributed coppies avalible their download would not finish. But that should be rather rare as updates don't often happen that quickly and the files are rather small. I have gotten caught 99.99% done on 2Gb files with no one to complete. But we are not gonna be transferring that sorta stuff.

Originally posted by Doom9
2) Don't you need many seeders to guarantee promt delivery? Tools that aren't updated will become less popular over the time, thus making it harder to get them.

One or two of us broadband users and we should be able to service a rather large group of users. Who would in turn help service an even larger group of users. Who would in turn help service an even larger group of users. Who would in turn help service an even larger group of users. Who would in turn help service an even larger group of users. But that is the key. Is there a constant enough demand for the files? Enough so that there is always a few people downloading them at almost all times.

Originally posted by Doom9
3) Everybody has a browser, many have a download manager but few have bittorrent installed.

Bittorrent is small. And many people have a BT client installed and don't know it. All users of the latest shareaza beta have it for one.

[Doom9]

@netterpaladin: actually I've been used home base hosting for a long time now.. one of my server is on a private 10mbit line, and I used to have another one that was in a dorm (also 10mbit). But I cannot make people offer me anything.

@Neo Neko: I'm afraid besides the monthly stats I don't have any details on how files are downloaded.. it might well be that there aren't enough downloads for a short while to make the whole thing go dry.

[Neo Neko]

Well I will look at it anyway. I have re-downloaded BNBT and done a custom compile. I am editing the sources a bit as well to make it look nicer. What were they thinking hard coding the page design like they did? :rolleyes: And actually once the whole thing gets going it can be in your hands if you like Doom9. All that would be required is that you provide the initial seed for a while and update the torrent on the download page. Or provide the file for others to seed in conjunction with the changed torrent. BNBT supports rudamentary user management and file control. So any user with correct permissions could start a new torrent. Not just the admin. ;)

[dragongodz]

Doom9 - DVDx is available (both binary and source) for anyone to download free from sourceforge.

http://dvdx.sourceforge.net/

[Doom9]

Doom9 - DVDx is available (both binary and source) for anyone to download free from sourceforge.
Yum, another major bandwith user I can get rid off. By now my server must feel kinda underused. Next stop fixing the anti-leech on the 4th mirror. Too bad it takes a while for the stats to show a real difference.

[Doom9]

@Neo Neko: It's almost too bad that many of the heavy loads are gone now, it might've been an interesting experiment to take a rather large tool and seed it via bittorrent. Is there any way to get some kind of statistics about what happens with a file? Like where people get it from, how many times it was downloaded (in total), stats that show you how effective the whole mechanism really is?

[Liisachan]

Originally posted by netterpaladin
If doom9 or Liisachan can find a japanese DVD/divx freak, he might be willing to offer his 100 mbit line as a server and all our problems should be solved.

a friend of mine in japan, nicked Lunar-K, is willing to help you (doom9.org)
his bw is just 3TB/year for now, so he can only offer like 100G/month for the time being,
but he has already applied for a 100Mbps service, which should be available in a few months,
and then he can offer you like 200-300G/month
Though I am not yet very sure if this plan will work, I know him quite well and he is serious...

the technical problem is...his IP address is not fixed, and he's using DDNS
(he might get a fixed IP after all, tho)
another problem is, he is a stundent who is still studying english (ie not that good at it),
but i believe we can make it out in one way or another, since he can _read_ English :)

Well, even if his offer is not realistic after all,
i hope you'll be at least spiritually encouraged to know that there are quite a few fans of this unique website,
even in the east end of asia--he is such a big fan of doom9.:cool:

PS. Using BT is a good idea I think; we don't have to be centralized, tho "seeders" are always needed anyway

[Doom9]

dynamic IP is no problem whatsoever, in fact I've had a mirror who has a dynamic IP. I pay for DNS hosting, which provides a failsave switchover, and I've set it up to use the server's dyndns domain name, so that a changing IP doesn't matter.

[Liisachan]

Originally posted by Doom9
dynamic IP is no problem whatsoever, in fact I've had a mirror who has a dynamic IP. I pay for DNS hosting, which provides a failsave switchover, and I've set it up to use the server's dyndns domain name, so that a changing IP doesn't matter. Good to know; in that case probably there's something we can do. I'll talk to him (Lunar-K)...

[Liisachan]

Originally posted by netterpaladin
If doom9 or Liisachan can find a japanese DVD/divx freak, he might be willing to offer his 100 mbit line as a server and all our problems should be solved. Lunar-K is surely willing to help out, but don't expect too much/too soon, because his bw is currently 10Mbps, altho he is now trying to get 100Mbps connex--he says he has already applied for it, but it's not likely that he will get that very soon. Like you said, many people have fast and inexpensive ADSL/FTTH connex here in japan, but (as you may know) you should usually wait long after application, possibly more than a few months, before you actually get it.
Anyway he will post here as soon as he is allowed to (He can't post now because of the 5-day rule. He is not a newbie but he didn't have an account here, he was always just lurking)


he says he has no problem to offer like 200~230GB / month even now.
Try leech/34t his bw! :D

[Lunar-K]

Hi.I'm Lunar-K of the home-server admin introduced from Liisachan.

Now, there is no reply from the telephone carrier to me, and the shift to 100Mbps FTTH is overdue.
If it is about 230 GB/month of the amounts of transmission, I think that offer is possible also at the present 10Mbps FTTH.

Then, I think that it changes by the concrete contents of a server's mirroring.
For the time being, please let me know the execution environment of a required script with disk capacity required for a host. I will install, if MySQL etc. is necessity.

Moreover, I consider that a server's mirroring method performs the directory synchronization by http at intervals of 5 minutes in consideration of security.

A server's specifications are enumerated below.

CPU : Intel Celeron(TM) 733MHz
RAM : PC-100(CL2)DIMM 384MBytes(256+128)
HDD : MPG3204T(20.4GB) + IC35L070AVVA07-0(80GB)x2 + 4R160L0(160GB)
NIC : 3C905-TX(Full-Duplex)
httpd: AnHTTPd 1.42k(http://www.st.rim.or.jp/~nakata/ written in Japanese)
Perl : ActivePerl 5.80beta(exe ver.)
php : php 4.3.1(exe ver.)
ruby : ruby 1.6.8(Cygwin)
Others software:MRTG(Multi Router Traffic Grapher)
ntcrond(cron by WindowsNT)

Thanks. :)

[Doom9]

I think the site is about 120-130MB right now, so if you can get me 200 that should last for a really long time. I haven't even considered the recent cleanup which should've lowered the space requirements a bit.
I need an ftp account to the root of the site (for your own security I suggest you chroot it). The server needs a vhost for the domain doom9.org, and it should allow aliases of the form *.doom9.org (if you want to limit them tell me and I'll pm you the exact requirements). At this point, no support for dynamic content is needed.

You do not have to worry about the mirroring, we have an automatic system in place so all servers will be fed the updates via ftp when I make an update to the site.

Some stats would be nice, preferably webalizer (I have a config file if you need one).

I don't know the server you're using so I can't help you with an anti-leech, but it would be good to have something in place. I have an ISAPI module for IIS and a .htaccess script for Apache/mod_rewrite to handle that so no external downloads are allowed, which helps reduce the bandwidth requirements (filemirrors loves my site and would have half the world downloading from me unless I had an anti-leech in place). Is your http server in any way related to apache? I saw a note about cygwin and it appears as if it originates in the linux world.

[stax76]

It only hapens when loading the main page and only in non-IE clients like Konqueror, Safari, Mozilla, or Opera.


the news in the main page don't show up in Firebird, at least here

[Doom9]

the news in the main page don't show up in Firebird, at least here Well.. my suspicion is that it's the gzip compression. It happens rarely, completely at random, on each server (IIS4, IIS5, Apache 1, Apache 2), every server OS (NT, W2K, Linux, FreeBSD), and every browser (it has been reported in browsers like IE, Mozilla, Firebird and Opear) Usually flushing the browser cache helps. So if it happens, unless you can find some kind or regularity (and keep in mind what I just said), it is of no use even reporting it because there's nobody that can do anything about it except you (re-resolving the url so that you'll get on a different server also helps some time.. but then again, the next server will also send gzipped content). If you have a look at the output in a browser that doesn't understand gzip (a good test would be telnet to port 80 on the server), you'll see that this is pretty much the same you get in your browser if things don't work out.

[Lunar-K]

I have to apologize for the reply having been overdue. :(
But, I got sufficient time to shift server software between them.:)
After all, server software was changed into Apache1.3.29 from AnHTTPD.
Thereby, use of .htaccess is attained in order to perform Anti-leech.

Now, I finished preparation of ftp account and also completed a setup of vhost. Please send a setup required for registration of DDNS etc. here.

Please give me PM. :D