Re: IOException for URL

From:

=?ISO-8859-1?Q?Arne_Vajh=F8j?= <arne@vajhoej.dk>

Newsgroups:

comp.lang.java.programmer

Date:

Sun, 21 Oct 2007 23:07:53 -0400

Message-ID:

<471c1401$0$90271$14726298@news.sunsite.dk>

Alan wrote:

When I try the code below with "http://www.google.com/search?
source=ig&hl=en&rlz=&q=something" in the URLs.txt file, I get an
IOException error. The server is returning an HTTP response code
403. However, when I open the same URL in my browser, it works
fine.

A different but similarly formated URL to another server worked
fine. Maybe this server is expection something additional?

I think Google tests on browser type.

In 2004 the following worked:

          URL url = new URL("http://www.google.dk/search?q=hej");
          HttpURLConnection con = (HttpURLConnection)url.openConnection();
          con.setRequestProperty("User-Agent", "Mozilla/4.0 (compatible;
MSIE 5.01; Windows NT 5.0)");
          con.setRequestProperty("Referrer", "http://www.google.dk/");
          con.connect();
          if(con.getResponseCode() == HttpURLConnection.HTTP_OK) {
             InputStream is = con.getInputStream();
             byte[] b = new byte[1000];
             int n;
             while((n = is.read(b)) >= 0) {
                System.out.println(new String(b,0,n));
             }
             is.close();
          } else {
             System.out.println(con.getResponseCode() + " " +
con.getResponseMessage());
          }
          con.disconnect();

Arne