How to know what have to set in the headers?

[mistercash60000]

Well I want to wrap a website, but I need to know what headers I have to use.

Is there a way to know this because this is different for each site.

I thought of using ethereal to watch packets.
But I'm asking it here how I'm sure to get the right headers lookup.

I hope someone can help me out.
Thanks in advance

[drew010]

at the least just

GET /somepage.php HTTP/1.0\r\n
Host: www.somehost.com\r\n
Connection: Close\r\n\r\n

will successfully request a page from a remote webserver.

the rfc for http 1.1 may be helpful too
[url]ftp://ftp.rfc-editor.org/in-notes/rfc2616.txt[/url]

[mistercash60000]

But sometime it can't connect and when I capture the packets I see other things in the headers.
Like referer and also cookie.

Do I have to insert those commands then also?

[drew010]

sometimes a site will require a certain cookie in order to allow you into certain areas or customize the site for you. generally a referrer isnt important since its mostly unreliable.
if the data you ever send is not valid, the server will send a 400 bad request response. if you cant connect that has nothing to do with the request, the request is sent after a connection is made.