This looks like a job for Perl, or possibly PHP?
smorrey at gmail.com
Sat Apr 14 17:09:45 MDT 2007
Ok turns out this might actually be easier to do in C (well for me at
least), doing a man wget shows I can just pipe the output to standard
out, and use that to feed a parsing program.
On 4/14/07, Steve <smorrey at gmail.com> wrote:
> > This is so simple, if it were me, I might do it in shell script using
> > 'wget' (or 'curl') and the 'date' command to do the date wrangling.
> > -=Fozz
> > --
> > fozz at iodynamics.com is Doran L. Barton, president/CTO, Iodynamics LLC
> > Iodynamics: IT and Web services by Linux/Open Source specialists
> > "Dealers will hear car talk at noon"
> > -- Headline seen in newspaper
> Thats what I tried in my first iteration, but my bash-scripting fu
> sucks, so what I've done thus far is wrote a C program that takes the
> date range as input (or if none is given, just uses the current date),
> then constructs the proper URL and uses wget to obtain the files.
> However, at present the program just creates a local mirror of the
> file. My next step would be to open the files and parse the data line
> by line looking for what I need, but this seems a bit wasteful given
> the string parsing capabilities of scripting languages such as python,
> perl and PHP.
More information about the PLUG