How to reduce your download traffic by 75% or more

ts77 · Posted: Sun Sep 12, 2004 1:15 pm Post subject:

Hi,

thanks a lot for that great tool again.
I just got an error while running 0.5.3 for the first time:

blackpenguin · n00b Joined: 09 Mar 2004 Posts: 43 Location: Germany

ts77 · Posted: Sun Sep 12, 2004 2:06 pm Post subject:

Heh, I thought the second error was a followup for the first one.

No problem and thanks for the quick fix :-)

.

blackpenguin · n00b Joined: 09 Mar 2004 Posts: 43 Location: Germany

Another bug appeared in the output when deleting old files.
fixed in version 0.5.3.2 which is available at
http://linux01.gwdg.de/~nlissne/getdelta.sh now.
bp

Pkunkage · n00b Joined: 10 Sep 2004 Posts: 4

I have submitted
https://bugs.gentoo.org/show_bug.cgi?id=63864
to patch the xdelta package code slightly. The new ebuild and patch will fix problems xdelta has patching LARGE dtu's or tarballs because it doesn't try to limit memory usage by default.

For example in my system with 500MB of Swap and 256MB of RAM , when deltup is patching OOo tarballs or mozilla which are >200MB , xdelta will just plain run out of RAM and start mem-swapping like a forkbomb taking down X , and some other system services like squid etc.

The new patch sets the default memory cache in xdelta to 100 megs. This can be tweaked by editing /etc/deltup/getdelta.rc and setting XDELTA_MAX_MEGS=200
You can change 200 to whatever megabyte limit is appropriate for your system.

eNTi · Posted: Mon Sep 13, 2004 10:57 am Post subject:

what about putting an version check and automatic upgrade script into getdelta.sh? you could make a configuration variable like "GETDELTA_AUTOUPDATE". i think that would be great.
_________________
If you fall off a cliff, you might as well try to fly. After all, you got nothing to lose.

-- John Sheridan - Babylon 5, Season 4

Pkunkage · n00b Joined: 10 Sep 2004 Posts: 4

I think blackpenguin has very wisely decided to not go in for auto-update.

Ultimately this script should become part of deltup ebuild in official portage or another ebuild which the user can upgrade whever he wants.

Since the script is typically running as root it wouldn't be wise to have auto-update for something like that. Just something which the user can easily emerge from portage is good enough. Besides whats the big deal with wget http://patthto/getdelta.sh ?

eNTi · Posted: Mon Sep 13, 2004 11:42 am Post subject:

if it's in portage it's okay. i just don't want to have to check for updates/bugfixes all the time. i'd still prefere auto-update. what's the big deal? you can always turn it off?
_________________
If you fall off a cliff, you might as well try to fly. After all, you got nothing to lose.

-- John Sheridan - Babylon 5, Season 4

eNTi · Posted: Mon Sep 13, 2004 1:27 pm Post subject:

pleusicles · n00b Joined: 26 May 2004 Posts: 44

pleusicles · n00b Joined: 26 May 2004 Posts: 44

... and just a little cosmetic problem: after printing "The Server creates the dtu-file NOW", the output stays yellow until the next "colored" element such as "Yes, we got the dtu-file..."

ReXX · n00b Joined: 24 Feb 2004 Posts: 24 Location: DE->AC

Is this topic still alive?

Right now I've got a problem emerging deltup

PrakashP · Posted: Mon Sep 13, 2004 8:01 pm Post subject:

Take a look on page 1.

Kampi · Posted: Wed Sep 15, 2004 3:00 pm Post subject:

works great for me! thank you.

MooktaKiNG · Guru Joined: 11 Nov 2002 Posts: 326 Location: London, UK

I would (and others too) appreciate a sample config file (an up to date file, showing all the available options) in the website, right next to the .sh script

Thank you.
_________________
http://www.mooktakim.com
Athlon XP 2001, Giga-Byte GA-7VRXP MB, 640Mb DDR RAM 333MHz, MSI Geforce 4800SE 128Mb DDR, 40x12x48 Liteon CDRW drive, Flower Cooler, ADSL Router

MooktaKiNG · Guru Joined: 11 Nov 2002 Posts: 326 Location: London, UK

Correction

It does have a sample config file

_________________
http://www.mooktakim.com
Athlon XP 2001, Giga-Byte GA-7VRXP MB, 640Mb DDR RAM 333MHz, MSI Geforce 4800SE 128Mb DDR, 40x12x48 Liteon CDRW drive, Flower Cooler, ADSL Router

MooktaKiNG · Guru Joined: 11 Nov 2002 Posts: 326 Location: London, UK

One thing i don't like is the GENTOO_MIRRORS bit.
Why does it need to be empty?

The problem is that when it trys to download the full file, it now takes ages.

I would prefer to have a mirror which is close to me.
_________________
http://www.mooktakim.com
Athlon XP 2001, Giga-Byte GA-7VRXP MB, 640Mb DDR RAM 333MHz, MSI Geforce 4800SE 128Mb DDR, 40x12x48 Liteon CDRW drive, Flower Cooler, ADSL Router

blackpenguin · n00b Joined: 09 Mar 2004 Posts: 43 Location: Germany

MooktaKiNG · Guru Joined: 11 Nov 2002 Posts: 326 Location: London, UK

Twink · Posted: Fri Sep 17, 2004 2:59 am Post subject:

have to say i really love this tool and i'm looking forward to the next 'big' package i upgrade to see just how well it performs (I had already downloaded the packages for xorg and ooffice before starting to use this).

One thing i think would be nice is statistics for the local machine, surely it would be possible to add these in the future (although i understand there's more important things). Being able to see exactly how much i've saved by using this tool is of great interest.

Keep up the great work

Niosop · n00b Joined: 04 Oct 2003 Posts: 24

First of all, great job. As a (very slow) dial-up user, this has the potential to save me literally days of downloading when I want to update.

The only problem I have is: it doesn't work on amd64 (I know it's not supposed to). By using USE="~x86" it will compile fine, but it always errors on applying the patch after downloading the delta file.

Has anyone gotten it to work on amd64?

If not, does anyone know where the problem lies or where I should start looking for it?

Thanks for an awesome program,
Niosop

asph · Posted: Fri Sep 17, 2004 2:18 pm Post subject:

maybe it would be a good idea to check the gcc version, and patch file.h if going to use gcc 3.4.x so that it compiles.. having to fix that manually its a pain in the XXX

_________________
gentoo sex is updatedb; locate; talk; date; cd; strip; look; touch; finger; unzip; uptime; gawk; head; emerge --oneshot condom; mount; fsck; gasp; more; yes; yes; yes; more; umount; emerge -C condom; make clean; sleep

Niosop · n00b Joined: 04 Oct 2003 Posts: 24

Upon further inspection, deltup seems to be working fine. The error seems to be in xdelta or bdelta (think it's xdelta). Once I get home I'll continue troubleshooting.

blackpenguin · n00b Joined: 09 Mar 2004 Posts: 43 Location: Germany

millenium_psyrax · Posted: Sat Sep 18, 2004 5:53 am Post subject:

FANTASTIC!!!!!

Thanks guys, this has always been a major portage gripe of mine, I have never, and never will understand why something like this has not been a priority. It has shit to me to tears downloading another entire version of a package to just upgrade a point release, I go to the gnu ftp server, and I see a patch that fits, but portage takes the NEWBIE way out, and just downloads a fresh copy of the update.

Something like this should be in portage, FULL STOP. In fact, it should have been in the original design document.
_________________
Define ironic: Java (noun) a unicode using Objective C whose claim to portability fame is having a compiler that can only compile code for ONE architecture, a slow virtual machine.

(c) Craig Sproule freely redistributable under the GPL version 1.2.