View previous topic :: View next topic |
Author |
Message |
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Sun Sep 26, 2010 12:46 am Post subject: getdelta does not work |
|
|
Hello there
Since about 1 months my getdelta stops to work correctly. That is what I see each time it is being used:
Code: | We have the following candidates to choose from
linux-2.6.30.tar.bz2
linux-2.6.31.tar.bz2
linux-2.6.32.tar.bz2
linux-2.6.34.tar.bz2
linux-2.6.35.tar.bz2
The best of all is ... linux-2.6.34.tar.bz2
Checking if this file is OK.
Trying to download linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu
--2010-09-26 11:38:46-- http://linux01.gwdg.de/~nlissne/deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http://www.us.kernel.org/p ub/linux/kernel/v2.6/linux-2.6.33.tar.bz2&version=0.7&time=1285461525
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu [following]
--2010-09-26 11:38:46-- http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu
Connecting to 91.191.147.227:81... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2136717 (2.0M) [application/octet-stream]
Saving to: “deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fkernel%2Fv2.6%2Flinux-2.6. 33.tar.bz2&version=0.7&time=1285461525”
100%[============================================================================================================>] 2,136,717 49.7K/s in 40s
2010-09-26 11:39:26 (52.7 KB/s) - “deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fker nel%2Fv2.6%2Flinux-2.6.33.tar.bz2&version=0.7&time=1285461525” saved [2136717/2136717]
GOT deltup.php?have=linux-2.6.34.tar.bz2&want=linux-2.6.33.tar.bz2&url=http:%2F%2Fwww.us.kernel.org%2Fpub%2Flinux%2Fkernel%2Fv2.6%2Flinux-2.6.33.tar.b z2&version=0.7&time=1285461525
The dtu could not be fetched, downloading full file from original URL
--2010-09-26 11:39:26-- http://distfiles.gentoo.org/distfiles/linux-2.6.33.tar.bz2
|
So it downloads the delta and after this it is just skip it and goes to download complete archive.
This is my FETCHCOMMAND:
Code: |
FETCHCOMMAND="/usr/bin/getdelta.sh \${URI} \${FILE}"
|
I also have tried some other parameters for getdelta but with no luck.
Does somebody have any idea about this?
Thanks. |
|
Back to top |
|
|
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Sun Sep 26, 2010 12:59 am Post subject: |
|
|
Seems like it is wget issue, which does not give the proper name to the .dtu file according
Code: |
Location: http://91.191.147.227:81/linux-2.6.34.tar.bz2-linux-2.6.33.tar.bz2.dtu
|
|
|
Back to top |
|
|
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Sun Sep 26, 2010 1:07 am Post subject: |
|
|
Well, i've fixed it by changing:
Code: | if $FETCH "${DELTUP_SERVER}${query}" |
to
Code: | if $FETCH -O ${best_candidate}-${NEW_FILE}.dtu "${DELTUP_SERVER}${query}" |
But I'm sure there is a wget parameter to ask it to use proper name... |
|
Back to top |
|
|
mv Watchman
Joined: 20 Apr 2005 Posts: 6747
|
Posted: Sun Sep 26, 2010 6:36 am Post subject: |
|
|
You might want to try getdelta from the mv overlay (but be aware that it needs an extended calling syntax). |
|
Back to top |
|
|
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Sun Sep 26, 2010 6:42 am Post subject: |
|
|
Has getdelta been changed in some way there in comparison to the official tree? |
|
Back to top |
|
|
mv Watchman
Joined: 20 Apr 2005 Posts: 6747
|
Posted: Sun Sep 26, 2010 7:17 am Post subject: |
|
|
zerkms wrote: | Has getdelta been changed in some way there in comparison to the official tree? |
Yes: Main change was to support EAPI=2, i.e. when the stored name differs from the download name (therefore the different calling convention and new config options). There were also some changes concerning handling of dtu files. Bugreports are welcome. |
|
Back to top |
|
|
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Sun Sep 26, 2010 7:49 am Post subject: |
|
|
Well, I've found the answer: it is to add --content-disposition to wget keys |
|
Back to top |
|
|
Oyarsa n00b
Joined: 01 Jul 2002 Posts: 73 Location: Mars
|
Posted: Fri Oct 22, 2010 6:23 pm Post subject: |
|
|
zerkms wrote: | Well, I've found the answer: it is to add --content-disposition to wget keys | Thank you for the tip, zerkms. I placed the command "content-disposition = on" in my /etc/wgetrc file and now getdelta is working again. I wish I had looked into this problem sooner. _________________ Dew knot trussed yore spell chequer two fined awl ewer miss steaks. |
|
Back to top |
|
|
mv Watchman
Joined: 20 Apr 2005 Posts: 6747
|
Posted: Sat Oct 23, 2010 12:03 pm Post subject: |
|
|
Oyarsa wrote: | I placed the command "content-disposition = on" in my /etc/wgetrc file and now getdelta is working again. |
It will fail for all packages which use "->" in the SOURCE, and these are quite a lot: Code: | grep -Rl -- ' -> ' /usr/portage/metadata/cache |
|
|
Back to top |
|
|
Oyarsa n00b
Joined: 01 Jul 2002 Posts: 73 Location: Mars
|
Posted: Mon Mar 28, 2011 1:06 am Post subject: |
|
|
It looks like it has stopped working this weekend again. Whenever I try to use getdelta I get a refused connection message as follows:
Code: |
Trying to download firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
--2011-03-27 18:59:11-- http://linux01.gwdg.de/~nlissne/deltup.php?have=firefox-3.6.13.source.tar.bz2&want=firefox-3.6.15.source.tar.bz2&url=http://releases.mozilla.org/pub/mozilla.org/firefox/releases/3.6.15/source/firefox-3.6.15.source.tar.bz2&version=0.7&time=1301273951
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu [following]
--2011-03-27 18:59:13-- http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
Connecting to 91.191.147.227:81... failed: Connection refused.
The dtu could not be fetched, downloading full file from original URL |
Is anyone else seeing this? _________________ Dew knot trussed yore spell chequer two fined awl ewer miss steaks. |
|
Back to top |
|
|
zerkms n00b
Joined: 21 Aug 2008 Posts: 43 Location: Russia, Komsomolsk-na-Amure
|
Posted: Mon Mar 28, 2011 1:09 am Post subject: |
|
|
Oyarsa wrote: | It looks like it has stopped working this weekend again. Whenever I try to use getdelta I get a refused connection message as follows:
Code: |
Trying to download firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
--2011-03-27 18:59:11-- http://linux01.gwdg.de/~nlissne/deltup.php?have=firefox-3.6.13.source.tar.bz2&want=firefox-3.6.15.source.tar.bz2&url=http://releases.mozilla.org/pub/mozilla.org/firefox/releases/3.6.15/source/firefox-3.6.15.source.tar.bz2&version=0.7&time=1301273951
Resolving linux01.gwdg.de... 134.76.13.21
Connecting to linux01.gwdg.de|134.76.13.21|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu [following]
--2011-03-27 18:59:13-- http://91.191.147.227:81/firefox-3.6.13.source.tar.bz2-firefox-3.6.15.source.tar.bz2.dtu
Connecting to 91.191.147.227:81... failed: Connection refused.
The dtu could not be fetched, downloading full file from original URL |
Is anyone else seeing this? |
Yep, I've experienced this too yesterday when I was updating my gentoo box. Haven't time to dive into an issue deeper though. But you're not alone |
|
Back to top |
|
|
Oyarsa n00b
Joined: 01 Jul 2002 Posts: 73 Location: Mars
|
Posted: Sun Sep 23, 2012 2:10 am Post subject: |
|
|
getdelta has been pretty useless lately because the servers assign you a queue position in the thousands so it never get around to your job.
I have been using xdelta3 in its wake, but that is now not working either. It generates a valid delta file which generates the same tar file as the original. The md5 checksums match. The problems come with the compressed tar ball. I get compressed tar balls of slightly different sizes so the checksums don't match. This used to only be a problem on some gzip files. Now it I get the same problem on bzip2 files as well.
It looks like downloading deltas may soon be a thing of the past. Pity, I hate downloading a 50 - 200 MB file when the delta is only 200K. _________________ Dew knot trussed yore spell chequer two fined awl ewer miss steaks. |
|
Back to top |
|
|
|