PERL:

Use LWP::Simple and the head function.

use LWP::Simple;

my $url = 'http://some.server.com/file.gif';

if (head($url)) {
# file is there
} else {
# file is missing
}

Credit goes to perlmonks.org.

PHP:

Use get_headers

$fileUrl = 'http://some.server.com/file.gif';
$AgetHeaders = @get_headers($fileUrl);
if (preg_match("|200|", $AgetHeaders[0])) {
# file is there
} else {
# file is missing
}

Credit goes to php.net.

Every once in a while I need to install Apache http server on my pc or laptop to use as local test server. I also need to install Perl, PHP and mysql to have the complete environment to test scripts and applications before uploading them on a live server.

Ricocheting.com has a great tutorial for installing Apache, PHP and Perl on a Windows server. Last time I had to do a re-install on my PC, I followed their tutorial.

A few impressions and comments:

1) They recommend staying with the default installation of Apache and changing "DocumentRoot" later. I change the installation location to "C:\Apache" which defaults DocumentRoot to C:\Apache\htdocs. It is much better to do it this way. You will not need to modify the configuration file to set DocumentRoot. You will not need to dig into all the way to C:\Program Files\Apache\... to look at log files or configuration files either.

2) I loved their tip about where to install ActiveState Perl: "C:\usr". I used to install Perl to C:\Perl directory which forced me to change the shebang lines on scripts. Listen to this:

If you will be using Perl CGI programs and want to maintain some level of portability between both Linux machines and Windows machines, you will want to install Perl to the same location on your Windows machine that it is on most Linux machines.

For example, on a standard Linux machine, Perl is located at /usr/bin/perl and so every Perl program that I write begins with #!/usr/bin/perl. So, when I install Perl on a Windows machine, instead of installing it in the default location (which is E:\perl for ActivePerl) I install it in E:\usr so that the Perl executable is located at /usr/bin/perl. This allows me to write code on my Windows machine, then move it (without making any changes) to a Linux machine and have it run there. And vice versa.

Wow! I wish I had figured this out earlier... "#!/usr/bin/perl" works in windows if you install Perl in C:\usr directory. No, you do not need to have "C:\" on the shebang line. This will save a lot of time and headache.

3) The site also includes the lines required to be added in Apache configuration file to make CGI and PHP work. I will put a copy of these here:

To activate CGI:
Edit the Apache httpd.conf Configuration File and search for Options Indexes FollowSymLinks (about line 190) when you find it add ExecCGI to the end so it looks like

Options Indexes FollowSymLinks ExecCGI

To use CGI outside the cgi-bin directory, uncomment:
#AddHandler cgi-script .cgi
Also add .pl behind .cgi so 'perl' extension is also treated as cgi files.

To use PHP at the very end of the httpd.conf file add the following lines:

LoadModule php5_module "C:/php/php5apache2_2.dll"
AddType application/x-httpd-php .php
PHPIniDir "C:/php"

Also Open php.ini in a text editor and scroll down about halfway through the file and look for doc_root then change it to point to whatever your Apache DocumentRoot is set to. In my case: doc_root = "C:\Apache\htdocs"

To get Apache to automatically look for an index.php, and index.pl search httpd.conf for DirectoryIndex (about line 212) and add the files you want Apache to look for when a directory is loaded (if it doesn't find any of these files, it displays folder contents). Mine looks like:

DirectoryIndex index.php index.pl index.html

They also have information on installing MySQL which is pretty straightforward.

There is one thing I would like to add here though: If you want to use DBD-MySQL package with Perl , you will notice that it is not included in the latest ActiveStatePerl distribution. You can't even install it using the GUI ppm. Here is what you need to do:

At the Command Prompt type:

ppm install http://theoryx5.uwinnipeg.ca/ppms/DBI-mysql.ppd

UPDATE on Jan 9, 2009 >>>

If you use ActiveState Perl 5.10, above link will not work either. The easiest way to do this is to start your Perl Package Manager, click on Edit -> Preferences and click on the Repositories tab. Type "http://cpan.uwinnipeg.ca/PPMPackages/10xx/" in Location. You just installed the Repository that has the DBD-MySQL package which will enable you to install it using your Perl ppm.

It sure will be nice to have all this info ready when I need to install Apache, Perl, PHP and MySQL on Windows next time.

It took me a while to get this right. For future reference and for others who may need the same functionality here is the information:

Task:

1. Upload a CSV file to the server,
2. Use a CRON job to run a perl script that inserts the fields in the CSV file to a MYSQL database file.

Solution 1:

#!/usr/bin/perl

use DBI;
my $DSN = 'DBI:mysql:database';
my $dsn_user = 'database_user';
my $dsn_pw = 'database_user_password';
my $dbh = DBI->connect($DSN,$dsn_user,$dsn_pw)
or die "Couldn't connect to database: " . DBI->errstr;

$rows = $dbh->do("DELETE FROM table");

$result = $dbh->do("OPTIMIZE TABLE table");

# Load local comma separated, fields enclosed by quotes text database
#- File has to be in the same directory of this file or give full directory path
$result = $dbh->do("LOAD DATA LOCAL INFILE '/full_directory_path_to/data.csv' INTO TABLE table FIELDS TERMINATED BY ','ENCLOSED BY '\"' LINES TERMINATED BY '\r\n' IGNORE 1 LINES (table_field1,table_field2,table_field3,so_on)");

This solution worked great on a server with a MYSQL 3.23

Challenge:

Time to move to a server with a MYSQL 4 or 5 where -local infile is disabled and it is not possible to get the web host do the necessary changes. You need a work-around fast... It is not easy to find a CSV parser in Perl that will parse a CSV file with comma separated columns that also has several columns that are enclosed by quotation marks ("). After trying several different solutions that either not worked at all or required major changes I found this here:

http://coding.derkeiler.com/Archive/Perl/comp.lang.perl.misc/2004-07/1638.html

sub parseCSVLine{
my $line=shift;
my @fields=();my $field=''; # initialize
my @fragments=split(/,/,$line,-1); # split into "," seperated fragments
foreach my $nibble(@fragments){
if($field){$field .= ','} # add the missing commas;
$field .= $nibble; # combine fragment into a field until...
my $count = $field =~tr/"/"/; # count quotes
unless($count % 2){ # ...there's an even number of double quotes
$field =~s/""/"/g; $field=~s/^\s*"//g; $field=~s/"\s*$//g; # fix quotes
# fix quotes
push @fields, $field;
$field=''; # reinitialize $field
}
}
return @fields;
}

Surprisingly this worked without a hitch. After you run each line through this subroutine do a REPLACE into the database table.

Incoming search terms:

• perl csv to mysql