Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
getdelta does not work
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo
View previous topic :: View next topic  
Author Message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Sun Sep 26, 2010 12:46 am    Post subject: getdelta does not work Reply with quote

Hello there

Since about 1 months my getdelta stops to work correctly. That is what I see each time it is being used:

Code:
We have the following candidates to choose from
linux-2.6.30.tar.bz2
linux-2.6.31.tar.bz2
linux-2.6.32.tar.bz2
linux-2.6.34.tar.bz2
linux-2.6.35.tar.bz2

The best of all is ... linux-2.6.34.tar.bz2

Checking if this file is OK.

Trying to download linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu

--2010-09-26 11:38:46--  http://linux01.gwdg.de/~nlissne/deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http://www.us.kernel.org/p         ub/linux/kernel/v2.6/linux-2.6.33.tar.bz2&version=0.7&time=1285461525
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu [following]
--2010-09-26 11:38:46--  http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu
Connecting to 91.191.147.227:81... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2136717 (2.0M) [application/octet-stream]
Saving to: “deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fkernel%2Fv2.6%2Flinux-2.6.         33.tar.bz2&version=0.7&time=1285461525”

100%[============================================================================================================>] 2,136,717   49.7K/s   in 40s

2010-09-26 11:39:26 (52.7 KB/s) - “deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fker         nel%2Fv2.6%2Flinux-2.6.33.tar.bz2&version=0.7&time=1285461525” saved [2136717/2136717]

GOT deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fkernel%2Fv2.6%2Flinux-2.6.33.tar.b         z2&version=0.7&time=1285461525

The dtu could not be fetched, downloading full file from original URL

--2010-09-26 11:39:26--  http://distfiles.gentoo.org/distfiles/linux-2.6.33.tar.bz2


So it downloads the delta and after this it is just skip it and goes to download complete archive.

This is my FETCHCOMMAND:

Code:

FETCHCOMMAND="/usr/bin/getdelta.sh \${URI} \${FILE}"


I also have tried some other parameters for getdelta but with no luck.

Does somebody have any idea about this?

Thanks.
Back to top
View user's profile Send private message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Sun Sep 26, 2010 12:59 am    Post subject: Reply with quote

Seems like it is wget issue, which does not give the proper name to the .dtu file according

Code:

Location: http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu
Back to top
View user's profile Send private message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Sun Sep 26, 2010 1:07 am    Post subject: Reply with quote

Well, i've fixed it by changing:

Code:
if $FETCH "${DELTUP_SERVER}${query}"


to

Code:
if $FETCH -O ${best_candidate}-${NEW_FILE}.dtu "${DELTUP_SERVER}${query}"



But I'm sure there is a wget parameter to ask it to use proper name...
Back to top
View user's profile Send private message
mv
Advocate
Advocate


Joined: 20 Apr 2005
Posts: 3803

PostPosted: Sun Sep 26, 2010 6:36 am    Post subject: Reply with quote

You might want to try getdelta from the mv overlay (but be aware that it needs an extended calling syntax).
Back to top
View user's profile Send private message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Sun Sep 26, 2010 6:42 am    Post subject: Reply with quote

Has getdelta been changed in some way there in comparison to the official tree?
Back to top
View user's profile Send private message
mv
Advocate
Advocate


Joined: 20 Apr 2005
Posts: 3803

PostPosted: Sun Sep 26, 2010 7:17 am    Post subject: Reply with quote

zerkms wrote:
Has getdelta been changed in some way there in comparison to the official tree?

Yes: Main change was to support EAPI=2, i.e. when the stored name differs from the download name (therefore the different calling convention and new config options). There were also some changes concerning handling of dtu files. Bugreports are welcome.
Back to top
View user's profile Send private message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Sun Sep 26, 2010 7:49 am    Post subject: Reply with quote

Well, I've found the answer: it is to add --content-disposition to wget keys ;-)
Back to top
View user's profile Send private message
Oyarsa
n00b
n00b


Joined: 01 Jul 2002
Posts: 73
Location: Mars

PostPosted: Fri Oct 22, 2010 6:23 pm    Post subject: Reply with quote

zerkms wrote:
Well, I've found the answer: it is to add --content-disposition to wget keys ;-)
Thank you for the tip, zerkms. I placed the command "content-disposition = on" in my /etc/wgetrc file and now getdelta is working again. I wish I had looked into this problem sooner.
_________________
Dew knot trussed yore spell chequer two fined awl ewer miss steaks.
Back to top
View user's profile Send private message
mv
Advocate
Advocate


Joined: 20 Apr 2005
Posts: 3803

PostPosted: Sat Oct 23, 2010 12:03 pm    Post subject: Reply with quote

Oyarsa wrote:
I placed the command "content-disposition = on" in my /etc/wgetrc file and now getdelta is working again.

It will fail for all packages which use "->" in the SOURCE, and these are quite a lot:
Code:
grep -Rl -- ' -> ' /usr/portage/metadata/cache
Back to top
View user's profile Send private message
Oyarsa
n00b
n00b


Joined: 01 Jul 2002
Posts: 73
Location: Mars

PostPosted: Mon Mar 28, 2011 1:06 am    Post subject: Reply with quote

It looks like it has stopped working this weekend again. Whenever I try to use getdelta I get a refused connection message as follows:
Code:

Trying to download firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu

--2011-03-27 18:59:11--  http://linux01.gwdg.de/~nlissne/deltup.php?have=firefox-3.6.13.source.tar.bz2&want=firefox-3.6.15.source.tar.bz2&url=http://releases.mozilla.org/pub/mozilla.org/firefox/releases/3.6.15/source/firefox-3.6.15.source.tar.bz2&version=0.7&time=1301273951
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu [following]
--2011-03-27 18:59:13--  http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
Connecting to 91.191.147.227:81... failed: Connection refused.
The dtu could not be fetched, downloading full file from original URL

Is anyone else seeing this?
_________________
Dew knot trussed yore spell chequer two fined awl ewer miss steaks.
Back to top
View user's profile Send private message
zerkms
n00b
n00b


Joined: 21 Aug 2008
Posts: 43
Location: Russia, Komsomolsk-na-Amure

PostPosted: Mon Mar 28, 2011 1:09 am    Post subject: Reply with quote

Oyarsa wrote:
It looks like it has stopped working this weekend again. Whenever I try to use getdelta I get a refused connection message as follows:
Code:

Trying to download firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu

--2011-03-27 18:59:11--  http://linux01.gwdg.de/~nlissne/deltup.php?have=firefox-3.6.13.source.tar.bz2&want=firefox-3.6.15.source.tar.bz2&url=http://releases.mozilla.org/pub/mozilla.org/firefox/releases/3.6.15/source/firefox-3.6.15.source.tar.bz2&version=0.7&time=1301273951
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu [following]
--2011-03-27 18:59:13--  http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
Connecting to 91.191.147.227:81... failed: Connection refused.
The dtu could not be fetched, downloading full file from original URL

Is anyone else seeing this?


Yep, I've experienced this too yesterday when I was updating my gentoo box. Haven't time to dive into an issue deeper though. But you're not alone ;-)
Back to top
View user's profile Send private message
Oyarsa
n00b
n00b


Joined: 01 Jul 2002
Posts: 73
Location: Mars

PostPosted: Sun Sep 23, 2012 2:10 am    Post subject: Reply with quote

getdelta has been pretty useless lately because the servers assign you a queue position in the thousands so it never get around to your job.

I have been using xdelta3 in its wake, but that is now not working either. It generates a valid delta file which generates the same tar file as the original. The md5 checksums match. The problems come with the compressed tar ball. I get compressed tar balls of slightly different sizes so the checksums don't match. This used to only be a problem on some gzip files. Now it I get the same problem on bzip2 files as well.

It looks like downloading deltas may soon be a thing of the past. Pity, I hate downloading a 50 - 200 MB file when the delta is only 200K.
_________________
Dew knot trussed yore spell chequer two fined awl ewer miss steaks.
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Other Things Gentoo All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum