Wednesday, September 26, 2007

Extra Credit (revised)

Source Code: Available here

So, I did some research on the httpunit package and I found a nice article named "introduction to Httpunit". From, this article I have learned that we must set the script error exception to false. However, this did not solve my problem crawling the myspace Website. Then I found other useful Website that helped me learn and understand the Httpunit package. However, most of the other articles did not help in solving the problem. Since you are allowed to set options in Httpunit as in : HttpUnitOptions.setExceptionsThrownOnScriptError(false);
I then looked, with help of the Javadoc in Eclipse, at setting other options. When I set HttpUnitOptions.setScriptingEnabled(false);
the problem of crawling the myspace site was solved.

No comments: