MeGUI Update servers

[Sharktooth]

MeGUI version 0.2.4.1019 adds multiple update servers support.
It come with 2 default server but custom servers can be manually added by clicking the Settings -> Extra Config -> Configure Servers button.

The default servers are:
http://megui.org/auto
http://mewiki.project357.com/auto

You can safely add my own repository as well:
http://www.webalice.it/f.corriga/auto

If anyone wish to provide another alternative update server please post it here.

[Thunderbolt8]

where can I specify the server adresses in megui, so auto update knows where it has to look ?

[Sharktooth]

have you read the previous post?

[Thunderbolt8]

i got no extra config button in 2193. and no, I cant update, because I get the xml error, as stated in the other thread :S

[Sharktooth]

MeGUI version 0.2.4.1019 adds multiple update servers support.

I repeat: Have you read the first post?

[Thunderbolt8]

yes, and as I said, I have 0.2.3.2193 and cant update, because that only 1 server, from which can be update in that version doesnt work !!

[Sharktooth]

you just had to :search: or look at the next thread...
http://forum.doom9.org/showthread.php?p=921181#post921181

[lexor]

nvm shark beat me.

[qyqgpower]

@Sharktooth
the update xml file on your server seems to be invalid

Trying server: http://www.webalice.it/f.corriga/auto
Retrieving update file from server...
File downloaded successfully...
Loading update data...
Error: Invalid XML file on server. Aborting.

[Sharktooth]

Should be fixed now.

[ChronoCross]

Is there a proceedure for providing a mirror? Cause I really don't have time to update it myself but if someone wants to do it I could pretty much mirror it forever with no overage.

[halsboss]

I'm about to begin with megui ...

I have to install (from DVD) megui on a PC without an internet connection - is there a manual download and update procedure which I can use instead of the auto update ?

[check]

yes. simply download all the files in one of the mirror caches, for example, here: http://mewiki.project357.com/auto/

ST, when you add new versions, can you please remove old versions from the cache (or stick into archive/ or something)? That will help if people want to manually update. Even better would be a zip/tarball of the latest files. I can setup a script to manually tar the contents of the directory, but that means there can be no old versions.

[niphlod]

I agree with ChronoCross .... there's a way to provide a mirror that is "automatically updated" ?

[Sharktooth]

Old version are useful...

[bob0r]

I'll think about :o

[ChronoCross]

There's no easy way to mirror it. Unless someone is running rsync or allows for recursive wget. I don't have the time unfortunately to update my mirror myself.

[check]

Well, the results are in. I hit 3.3gb over the past 24hrs. If we want to be conservative, then that was 33% of the total, which means the monthly aggregate is under 300gb. I would guess this is an above average period of traffic too.
Seems like update woes are a thing of the past :)

[Sharktooth]

well... that's good :)

[bob0r]

For a Mirror what is needed?
http access?
ftp access?

Forum is too slow to search, and i am to busy to seach anyway.

Is 300gb/month data used?

Got one ready for 900gb/month (mirror03)

[check]

300 gb/month is what the maximum total could be. My mirror will only hit 30gb/month. just pm sharktooth ftp write details.

[Sharktooth]

yeah, 300gb/month seems to be enough

[bob0r]

"Sharktooth has exceeded their stored private messages quota and can not accept further messages until they clear some space"

I am not bothering by asking you to make some free, just msg me on IRC for mirror ftp only info.

[Thone]

i can give you access, but you will need to updating the server through sftp access.
will not be the fastest because it will be a linux box on a cable line but the upside will be that it will have unlimited bandwith.
just slow download about 40 kb.
tell me what you think.

[Sharktooth]

"Sharktooth has exceeded their stored private messages quota and can not accept further messages until they clear some space"

I am not bothering by asking you to make some free, just msg me on IRC for mirror ftp only info.
I'll do it ASAP.

[Sharktooth]

i can give you access, but you will need to updating the server through sftp access.
will not be the fastest because it will be a linux box on a cable line but the upside will be that it will have unlimited bandwith.
just slow download about 40 kb.
tell me what you think.
Sorry 40 kb is just too low. MeGUI has a very large userbase and it will hog your cable connection...

[check]

I hit 6gb over the past 24hrs, but the megui server is alive, so I'm estimating traffic to be around 8-10gb/day

[Sharktooth]

i think i'll add my repository to the next megui version...

[check]

your space (which is just ISP webspace, isn't it?) went over whatever budget was set for it in just a few days when it wasn't even automatically in the serverlist, are you sure that's a wise idea?

[ChronoCross]

I hit 6gb over the past 24hrs, but the megui server is alive, so I'm estimating traffic to be around 8-10gb/day

300-350GB a month is a pretty safe bet then. It depends also on how active development is. it could half or double at any time.

[berrinam]

In the long term, it doesn't make sense for me or Sharktooth to update every server when we distribute an update. How about declaring one the main server, and all the other mirrors just grab the files from that? Can anyone set up scripts to automate that?

[check]

Well, there are two options:
Push: The maintainer has a script they run to upload to each mirror (run script with path to file, upload file to each mirror).
*Updates are spread synchronously
*Update servers are not reliant on a master server for updates.
*The uploader needs to upload n times the amount of data (which takes n times longer).
Pull: Each mirror runs a cronjob responsible for keeping their mirror up to date.
*The uploader just needs their script to upload to one location, rather than n, which saves time.
*Mirrors will be asynchronously updated.

Personally I would prefer the former. It's decentralised, which means we can't have a situation where the main server dies and updates must be done by hand. If an update server dies, nothing bad happens.
Concerns about uploading to multiple servers are probably nothing to worry about, a drag and drop script would be possible even on windows without that much trouble. I have the free coreftp installed, and that implements a CLI (http://www.coreftp.com/docs/web1/Command_Line_FTP.htm).

If a pull environment is preferred, it would probably be reasonably simple to implement something with rsync. I've never done anything with rsync myself, but have been assured it's simple.


Unrelated mirror stuff: How about including the list of servers in the update.xml file? That would make updating the list simpler.

[Sharktooth]

your space (which is just ISP webspace, isn't it?) went over whatever budget was set for it in just a few days when it wasn't even automatically in the serverlist, are you sure that's a wise idea?
Even if it is an ISP space i have no restrictions in number of simultaneous connections and traffic.

EDIT: As i said in the MeGUI dev thread, the megui.org server is back online

[check]

2007-01-01 3241.06 MB
2007-01-02 3414.46 MB
2007-01-03 3364.83 MB
2007-01-04 3066.04 MB
2007-01-05 3298.75 MB
2007-01-06 3053.51 MB

Here's some data. This is also a bump to see if a decision has been made re:update procedure? I'm happy either way, but knowing which way would be good :p

[Sharktooth]

Well, no decisions were taken but i also like the "push" mode.
However we can do a mix of both. The webserver provided by SF includes PHP support. We can make a script (with authentication) to upload the new files to SF server and it will upload them to the various mirrors (and delete them from SF webspace when finished uploading).

[bob0r]

Damn, i just realized something:
http://files.x264.nl 100mbit USA, no bandwidth limit, i totally forgot about it, i feel so ashamed.

When the other mirror is fixed also (http), Sharktooth ill get you all info, thursday i should have some time to set it all up.

[an3k]

you can add my mirror (germany) too. dont care about traffic, bandwidth is 100mbit.

http://ftp.fileres.net/project/megui/autoupd/

- OR -

ftp://ftp.fileres.net/project/megui/autoupd/

same server but different services.


I whould prefer the following:

a) megui-team got their own update server, lets call them master (i.e. 2 servers)
b) megui-team selects some server as "official" (you should choose guys you can trust, see end of post). those servers are synced with the masters by an automated system and are added in megui as default (i.e. 8 servers). now, megui knows 8 or 10 servers (only servers should sync with the "masters")
c) if someone else want to establish another mirror, he cannot sync with the masters, he has to sync with one of the official servers cause every hoster of an "official" server can choose how others can sync with his server. using my server you can use recursive wget and i think there is at least one user who allows rsync ;)

this way the megui-team dont have to add/delete/update the serverupdatelist all the time ;) also you have a trustable list of servers from which everyone can update/sync


why only trusted users? => its very easy to replace a file with a suspicious one or to add files you dont need/you dont allowed to add (eg. nero codec)

i hope you understand my worse english,

cheers