Perl LWP and gzip compression (Solved)

[jho]

Hello,

When one fetches a page which forces gzip compression with curl you get just random mess, unless you specify the

Code: Select all

--compressed

flag to curl.

Now I'm wondering is there anything like the --compressed flag for Perl's LWP module? I am aware of the

Code: Select all

'Accept-Encoding' => 'gzip'

option for LWP, but it doesn't seem to do anything when passed to

Code: Select all

LWP::UserAgent->get 

For example,

Code: Select all

    our @gz_headers = (
      'User-Agent'      => 'test',
      'Accept-Encoding' => 'gzip',
    ); 
    my $title = $ARGV[0];
    my $ua = LWP::UserAgent->new;
    $ua->timeout(10);
   
    my $qry = $ua->get("http://anidb.net/perl-bin/animedb.pl?show=animelist&adb.search=$title&do.search=search", @gz_headers);

gives just garbage.

Thanks in advance.

[jho]

Seems like LWP doesn't support gzip compressed material.. Is there any way to uncompress it manually then? I tried Compress::Zlib::uncompress() or such, but couldn't get it to work.

Any help would be appreciated.

[barbar]

Code: Select all

#!/usr/bin/perl -w
#
#
use strict;
use LWP::Simple;
use Compress::Zlib;

my $title = $ARGV[0];
my $qry =
  get("http://anidb.net/perl-bin/animedb.pl?show=animelist&adb.search=$title&do.search=search");
my $unzipped = Compress::Zlib::memGunzip($qry);
print "$unzipped\n";

Compress::Zlib::memGunzip:This function is used to uncompress an in-memory gzip file.
If successful, it returns the uncompressed gzip file, otherwise it returns undef.
The $qry parameter can either be a scalar or a scalar reference. The contents of the $buffer parameter are destroyed after calling this function.
See:http://search.cpan.org/~pmqs/Compress-Z ... ss/Zlib.pm