simple web crawler using .net

<Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/index.html> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/martin.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/testpage.html> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/martin.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/mark.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/private/martinspages.htm> <Link http://validator.w3.org/check/referer> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/mark.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/webtech.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/scsis.htm> <Link http://www.bbk.ac.uk/> <Link http://www.dcs.bbk.ac.uk/~mark/book.html> <Link http://www.dcs.bbk.ac.uk/~mark/handheld.html> <Link http://www.dcs.bbk.ac.uk/~mark/games.html> <Link http://www.dcs.bbk.ac.uk/~mark/bookshops.html> <Link http://citeseer.nj.nec.com/cs> <Link http://www.dcs.bbk.ac.uk/~mark/search.html> <Link http://www.google.com> <Link http://www.dcs.bbk.ac.uk/~mark/software.html> <Link http://www.navigationzone.net/> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/lkl.htm> <Link http://www.dcs.bbk.ac.uk/webDyn> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/webdyn.htm> <Link http://www2002.org/fulldayworkshops.html> <Link http://www.dcs.bbk.ac.uk/~mark/papers.html> <Link http://www.dcs.bbk.ac.uk/research/> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/phd.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/martin.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/azy.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/webtech.htm> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=nigel> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=rgj> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=ap> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/mark.htm> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=ptw> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=george> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=mick> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=gr> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=pjhk> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=keith> <Link http://eros.dcs.bbk.ac.uk/dept/staffperson.asp?name=trevor> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/research.htm> <Link http://eros.dcs.bbk.ac.uk/dept/group_pubs.asp?resgrp=3> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/mark.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/research.htm> <Link http://www.dcs.bbk.ac.uk/seminars> <Link http://www.dcs.bbk.ac.uk/research/research_methods.html> <Link http://www.dcs.bbk.ac.uk/research/industry.html> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/students.htm> <Link http://www.dcs.bbk.ac.uk/research/recentphds.html> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/students.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/foo.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/foo.htm> <Link http://images.google.com/images?q=dummy> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/scsis.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/\> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/files/shside.jpg> <Link http://www.dcs.bbk.ac.uk/about/senatehouse.html> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/lower/directories/staff.htm> <Link http://www.dcs.bbk.ac.uk/about/map.html> <Link http://www.dcs.bbk.ac.uk/about/booth.html> <Link http://www.dcs.bbk.ac.uk/about/scsis-bbk.txt> <Link http://www.dcs.bbk.ac.uk/about/scsis-bbk.rtf> <Link http://www.dcs.bbk.ac.uk/about/scsis-bbk.vcf> <Link http://jigsaw.w3.org/css-validator/> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/\> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/lower/directories/staff.htm> <Link http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/foo.htm> <Link http://www.dcs.bbk.ac.uk/~martin/mark.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/foo.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/lkl.htm> <Link http://www.lonklab.ac.uk/news/index.html> <Link http://www.lonklab.ac.uk/events/index.html> <Link http://www.lonklab.ac.uk/projects/index.html> <Link http://www.lonklab.ac.uk/biogs/index.html> <Link http://www.lonklab.ac.uk/contacts/index.html> <Link http://www.lonklab.ac.uk/research.html> <Link http://www.lonklab.ac.uk/aims.html> <Link http://www.lonklab.ac.uk/history.html> <Link http://ioewebserver.ioe.ac.uk/ioe/index.html> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/webdyn.htm> <Link http://www2002.org/> <Link http://www.dcs.bbk.ac.uk/webDyn/> <Link http://www.webdyn.org/index.html> <Link http://www.webdyn.org/onlineProceedings.html> <Link http://www.webdyn.org/programme.html> <Link http://www.webdyn.org/progcomm.html> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/phd.htm> <Link http://www.dcs.bbk.ac.uk/research/phdbbk_public.html#sec:report> <Link http://www.dcs.bbk.ac.uk/seminars/> <Link http://www.dcs.bbk.ac.uk/enquiry.html> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/martin.htm> <Visited http://www.dcs.bbk.ac.uk/~martin/sewn/ls3/azy.htm> <Link http://www.bbk.ac.uk> <Link http://www.mmu.edu.my/> <Link http://www.mmu.edu.my/services/cits/cits-main.html> <Link http://www.firstmonday.org/issues/issue6_9/mat/index.html> <Link http://gong.mmu.edu.my/>