perl-win32-web archive @ ASPN

RE: Proxy Logger / Automating Web File Download

I think you're referring to
HTTP::Recorder, which is a recording proxy
that outputs WWW::Mechanize scripts.
http://search.cpan.org/dist/HTTP-Recorder/
 
-- 
Mark Thomas 
Internet Systems Architect
_______________________________________
BAE SYSTEMS Information Technology 
2525 Network Place
Herndon, VA  20171  USA 


________________________________

	From: perl-win32-web-bounces@...
[mailto:perl-win32-web-bounces@... On Behalf Of
Wilkinson, Stephen E
	Sent: Tuesday, May 23, 2006 1:20 PM
	To: perl-win32-web@...
	Subject: Proxy Logger / Automating Web File Download
	
	

	I am trying to automate downloading a file from a web site.  I
am using Proxomitron to log the messages sent to/from the proxy server.
I remember using a tool a while(couple of years) back, very similar to
proxomitron, that would not only log the traffic, but also generate the
Perl commands to simulate this traffic.  Ring a bell on anyone?  Any
suggestions for the best way for me to figure out how to do this?  The
site uses SSL.

Re: Proxy Logger / Automating Web File Download

On approximately 5/23/2006 10:20 AM,
came the following characters from 
the keyboard of Wilkinson, Stephen E:
> I am trying to automate downloading a file from a web site.  I am using 
> Proxomitron to log the messages sent to/from the proxy server.  I 
> remember using a tool a while(couple of years) back, very similar to 
> proxomitron, that would not only log the traffic, but also generate the 
> Perl commands to simulate this traffic.  Ring a bell on anyone?  Any 
> suggestions for the best way for me to figure out how to do this?  The 
> site uses SSL.

Would you be referring to http://www.research.att.com/~hpk/wsp/ ???

-- 
Glenn -- http://nevcal.com/
===========================
A protocol is complete when there is nothing left to remove.
-- Stuart Cheshire, Apple Computer, regarding Zero Configuration Networking
_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs

Out of Office

I will be out of the office starting  13-05-2006 and will not return until
31-05-2006.

I am out of the office, and will deal with your email when I return on
31-05-05.

Alternatively, please contact Igor Ivanov or Ed Van den Brink

_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs

Proxy Logger / Automating Web File Download

I am trying to automate downloading a
file from a web site.  I am using
Proxomitron to log the messages sent to/from the proxy server.	I
remember using a tool a while(couple of years) back, very similar to
proxomitron, that would not only log the traffic, but also generate the
Perl commands to simulate this traffic.  Ring a bell on anyone?  Any
suggestions for the best way for me to figure out how to do this?  The
site uses SSL.

RE: CGI header problem in 5.8

dorian wrote:

: Any help on this would be most appreciated.  I am hesitant to upgrade
: my production server to 5.8 and now the scripts on my development and
: production servers are out of sync.


    Try using the CGI.pm version from your production server
instead of the version which came with Perl 5.8.

HTH,

Charles K. Clarkson
-- 
Mobile Homes Specialist
254 968-8328


_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs

Re: CGI header problem in 5.8

dorian wrote:

> I just upgraded my Win2000 server from ActivePerl5.6 to 5.8 and now my
> CGI scripts are failing.  I have many scripts where I "use CGI
> qw/:standard/;" and then:
>  
> print header;
> print start_html;
>  
> As per the CGI.pm man page.  But now it prints two http headers and
> displays the html source to the browser.  If I delete the first print
> header statement then it displays correctly.	This would not be such a
> big deal but there are many scripts where I do this and it appears to
> still be correct from looking at the CGI.pm docs.  More seriously I am
> also using CGI::Ajax (which worked under 5.6) and it is also outputting
> double headers and I see no way to control this.  I lasso don't know
> what other scripts may be affected by this.
>  
> Any help on this would be most appreciated.  I am hesitant to upgrade my
> production server to 5.8 and now the scripts on my development and
> production servers are out of sync.

I'd suggest you come up with the smallest complete test case that reproduces
your problems along with the complete script and output from the script
(maybe also run it in a command window and cut-n-paste the output into
your post).
_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs

CGI header problem in 5.8

I just upgraded my Win2000 server from
ActivePerl5.6 to 5.8 and now my CGI scripts are failing.  I have many scripts where I "use
CGI qw/:standard/;" and then:

print header;
print start_html;

As per the CGI.pm man page.  But now it prints two http headers and displays the html
 to the browser.	If I delete the first print header statement then it displays
correctly.  This would not be such a big deal but there are many scripts where I do this
and it appears to still be correct from looking at the CGI.pm docs.  More seriously I am
also using CGI::Ajax (which worked under 5.6) and it is also outputting double headers and
I see no way to control this.  I lasso don't know what other scripts may be affected by
this.

Any help on this would be most appreciated.  I am hesitant to upgrade my production server
to 5.8 and now the scripts on my development and production servers are out of sync.

thanks in advance - Dorian Winterfeld
dorian@...

IIS + Cache::Cache + W2003 + HTML header problem

I have some bizarre behaviour in a CGI
script running on
IIS 6.0 under Windows Server 2003.
(Everything was working OK for two years under Windows 2000.)

I am producing reports in XML format.
I am using Cache::Cache to save the XML output for each report.

Everything works fine
BUT
when a cached report expires I get an error in my perl program.

I have stuck in many debugging messages and found that:
a) - the cache stuff seems to be working OK.
b) - the error occurs when printing the HTML headers

Specifically - in the following lines of code
Files v7a,v7b,v7c,v7d.xml are all produced - and v8a.xml is NOT.
However if (earlier in the program) I comment out the line that saves the
output to the cache
then everything else works (i.e. file v8a.xml IS produced and I get my
output in the browser).


Anyone got ANY idea what could be causing this?


===========  Code Follows  ===================
# $FDBG = 1 - my DEBUG flag
$values->save("v7a.xml") if $FDBG;
printf "Set-Cookie: %s\n",$USER->dlnewcookie;
$values->save("v7b.xml") if $FDBG;
#printf "Set-Cookie: %s\n",$USER->password_cookie;
#$VAL->save("v7c.xml") if $FDBG;

eval { print "Content-type: text/xml;\n"; } ;
if ($@...    {
    printf $FDBG "EVAL Error:\n%s\n",$@ if $FDBG;
    }

$values->save("v7d.xml") if $FDBG;
printf "\n";
### The next line is not executed if saving to Cache.
$values->save("v8a.xml") if $FDBG


-- 
Datalucid Limited

email: mike.trotman@...
web: http://www.datalucid.com


Message Scanned by ClamAV on datalucid.com


_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs

fork() and waitpid() issue...

Hi all,
I'm using fork() and waitpid(0 and am having trouble reaping my dead
children when processing a CGI. I can run similar code from the command line
and it works fine... but for some reason, when the CGI is processing... the
first child is reaped... but all subsequent children just run forever...
here's the code snippet:

The @... array simply contains a list of UNC paths...

my @...
while (1) {
  if (my $strPath = shift (@... {
    my $pid = fork();
    push @... $pid;
    die "Can't fork: $!" unless (defined ($pid));

    if (!$pid) {
      if (-e $strPath) {
	print "Good: ".$pid." - ".$strPath."\n";
	print NAMEFILE $strPath."\n";
      }
      exit;
    }
    print "Child $pid Started
";
  } else {
    last;
  }

  my @...
  foreach my $child (@... {
    print $child."
";
    if (waitpid ($child, WNOHANG) == $child) {
      print "Child $child Died - ".$?."
";
    } else {
      push @... $child;
    }
  }
  print "I have ".(scalar (@... kids... ".$child."
";
  @... = @...
  sleep 1;
}

The output I get from the web server (IIS 6.0) is:

Good: 0 - \\XLBEARA01M\d$\apps\oracle\network\ADMIN\tnsnames.ora Child
-10180 Started
-10180
I have 1 kids...
Child -5076 Started
-10180
Child -10180 Died - 0
-5076
I have 2 kids...
Child -11468 Started
-5076
-11468
I have 2 kids...
Child -6024 Started
-5076
-11468
-6024
I have 3 kids...
Child -11192 Started
-5076
-11468
-6024
-11192
I have 4 kids...
Good: 0 - \\XLBEARF01M\d$\apps\oracle\network\ADMIN\tnsnames.ora Child -4788
Started
-5076
-11468
-6024
-11192
-4788
I have 5 kids...


and it goes on and on from there... until I max out at 64 threads... as you
can see... the first child (PID -10180) is reaped... but the rest never seem
to die... can anyone clue me into why that is?... I'm running ActiveState
Perl 5.6.0 Build 623...

Thanks,

Andy Speagle

Simon YEE/NYP/SINGOV is out of the office.

I will be out of the office from 
15/03/2006 to 28/03/2006.

Thank you for the email. I shall respond as soon as I get back to the
office.
For Part Time Diploma in Engineering Informatics, please contact Mr Koh
Choon Chye at 6550-0615 or email him at koh_choon_chye@...

Regards.

_______________________________________________
Perl-Win32-Web mailing list
Perl-Win32-Web@...
To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs