shpider

Version 0.0.4 revision 0 uploaded 2009-03-22T11:35:55.000Z by JohnnyMorrice.

Package meta

Synopsis

Web automation library in Haskell.

Description

Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.

It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.

It also provides a nice syntax for filling out forms.

An example:

runShpider $ do
     download "http://apage.com"
     theForm : _ <- getFormsByAction "http://anotherpage.com"
     sendForm $ fillOutForm theForm $ pairs $ do
           "occupation" =: "unemployed Haskell programmer"
           "location" =: "mother's house"

Shpider contains a patched version of the curl package, to fix cookie handling. The curl licence is therefore distributed with this package.

Author

Johnny Morrice

Bug reports

n/a

Category

Web

Copyright

n/a

Homepage

http://www.killersmurf.com/projects/shpider

Maintainer

Johnny Morrice <spoon@killersmurf.com>

Package URL

n/a

Stability

n/a

Components

• lib:shpider