Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
Saving downloadtime when downloading KDE by using xdelta
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Unsupported Software
View previous topic :: View next topic  
Author Message
blackpenguin
n00b
n00b


Joined: 09 Mar 2004
Posts: 43
Location: Germany

PostPosted: Tue Mar 09, 2004 5:50 pm    Post subject: Saving downloadtime when downloading KDE by using xdelta Reply with quote

KDE mirrors release xdelta files - but portage does not use them.

If you dont know what xdelta-files are - these are much similar like diff-patches but for binary files.

So downloading xdeltas reduce the size of your downloads.
For example instead of downloading ~300 MB for the complete kde-sources (incl. kde-i18n-3.2.1.tar.bz2) you would download only ~50 MB xdelta-files.

I have written a small script, that does this for you now.

You can find the script here: http://linux01.gwdg.de/~nlissne/kdedelta.sh

Have a look into the script before starting it
(for example you can/should change the packages and the kde-mirror to be used for download...)

The script checks if you have the previous versions (referred as $KDE_OLD and $ARTS_OLD in the script) and if so it will download the xdelta file and use it together with the old version of the tar.bz2-file to create the new one.
If you dont have the old version in your $DISTDIR it just downloads the new version.

Just start it before upgrading your KDE.
Of course you should have installed xdelta to use it. (just emerge xdelta)

Script is prepared to download xdelta-files for arts-1.2.1 and kde-3.2.1 but can easily be changed for future versions.

I hope this is useful for someone.
Have fun.


Last edited by blackpenguin on Wed Mar 10, 2004 1:44 am; edited 1 time in total
Back to top
View user's profile Send private message
jcc
Apprentice
Apprentice


Joined: 30 May 2003
Posts: 233
Location: Fort de France, Martinique

PostPosted: Tue Mar 09, 2004 11:36 pm    Post subject: Reply with quote

man, this is cute. I think I had to say a quick thank you :)
Back to top
View user's profile Send private message
Redeeman
l33t
l33t


Joined: 25 Sep 2003
Posts: 957
Location: Denmark

PostPosted: Wed Mar 10, 2004 5:52 pm    Post subject: Reply with quote

i have thought of stuff like this too, but never saw it before this.
_________________
Sandberg Enterprises
Back to top
View user's profile Send private message
X-Ryl669
Tux's lil' helper
Tux's lil' helper


Joined: 16 Feb 2004
Posts: 135

PostPosted: Fri Mar 12, 2004 3:20 pm    Post subject: Nice proggy Reply with quote

What a great proggy...

I will have a look at it before downloading any more tar.bz2...

Thanks
_________________
Think it twice, think it thrice, you never think enough...
Back to top
View user's profile Send private message
alec
Apprentice
Apprentice


Joined: 19 Apr 2002
Posts: 270
Location: Here

PostPosted: Fri Mar 12, 2004 3:49 pm    Post subject: Reply with quote

There's a program called deltup in portage that is suppose to add this functionality to portage (but automated), however it doesn't seem to ever have gotten off the ground.
Back to top
View user's profile Send private message
rewt
n00b
n00b


Joined: 19 Feb 2004
Posts: 58

PostPosted: Fri Mar 12, 2004 4:27 pm    Post subject: Reply with quote

Sounds cool. The only drawback I see is that you have to have the previous version to make use of it
Maybe it would be possible to store the deltas somewhere and apply them one after another if that would be faster?
In any case I'm sure this will save a lot of people huge amounts of time and bandwidth, nice job!
_________________
Because sometimes peace is another word for surrender... and secrets have a way of getting out
Back to top
View user's profile Send private message
blackpenguin
n00b
n00b


Joined: 09 Mar 2004
Posts: 43
Location: Germany

PostPosted: Fri Mar 12, 2004 7:42 pm    Post subject: Reply with quote

Good Idea, I have changed the script to do that.
It is probably not faster for the whole script, but useful on a
dialin-line to download all xdeltas first.
Back to top
View user's profile Send private message
occam2003
n00b
n00b


Joined: 03 Mar 2003
Posts: 17
Location: Melbourne, Australia

PostPosted: Sat Mar 13, 2004 3:25 am    Post subject: Reply with quote

VERY good idea - pity I did not check this forum before starting the emerge -U world. Oh well, next time..
Back to top
View user's profile Send private message
skimitar
n00b
n00b


Joined: 30 Dec 2003
Posts: 20

PostPosted: Sun Mar 14, 2004 8:21 pm    Post subject: Reply with quote

Very useful. Made me get off my butt to upgrade to 3.2.1.

Just a note for people: you'll need the orginal kde and arts distfiles in /usr/portage/distfiles.

If you've deleted them to clear space, you'll need to restore the relevant bz2's from backup (assuming you've made one).
_________________
"Internet! Is that thing still around? " - HJS
Back to top
View user's profile Send private message
ferringb
Developer
Developer


Joined: 03 Apr 2003
Posts: 355
Location: USA

PostPosted: Mon Apr 05, 2004 4:56 am    Post subject: Reply with quote

To those interested, glep 25 is another attempt at getting distfile patching support into portage- the utility it's based on (diffball, which I've been writing) supports reconstructing files via xdelta patches.

Pretty much, assuming the glep were accepted (it's currently a draft) the existing kde xdelta patches could be used automatically. Give the glep a read if your interested- feedback would be quite appreciated.
_________________
I don't want to be buried in a pet cemetery. ~Ramones
Back to top
View user's profile Send private message
mantis
Tux's lil' helper
Tux's lil' helper


Joined: 30 Jul 2002
Posts: 134
Location: Sydney

PostPosted: Sun May 02, 2004 9:37 am    Post subject: Reply with quote

I do hope this does get accepted.

Wish it were available at the moment. :(
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Unsupported Software All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum