News.....

NZ_Kiwis

I want to search a website and take news off it... like RSS feeds but from a site without RSS feeds, so like this site http://news.google.co.nz/?ned=nz&topic=n

Any ideas what sort of script does this????

leatherback

Illegal ones.

This sort of data is usually copyright, and you can get in serious trouble for doing this. Unless you have written permission to do this, you usually are not allowed to reproduce content from one site on another.

NZ_Kiwis

Yeah but all i will be doing is linking to another site LIKE an RSS feed would..... many sites do this i'm just not sure how this works..

leatherback

No. An RSS feed is made available to other users to facilitate linking & redistribution. If they do not make such a link available it is probably because they do not want you to do that.
The site you gave as an example is the perfect example of a site that does NOT want you to parse it. See at the bottom:

NZ_Kiwis

The information is not copyright to google it's copyright the it's valid website. Google sourced it from their site directly....

leatherback

OK, go ahead and parse the google news sites and see how long before you get people knocking 🙂.

Just think why it is that google has things like books online, and you would not be allowed to do this.. They have the size->push to get permissions from the bigger players to recombine information. Untill you get the permission to do so -either from the site's rules or from the owner directly- you are at risk of being found guilty of plagiarism & breach of copyright.

bpat1434

You realize that Google news has an RSS and ATOM feed right?

RSS: http://news.google.co.nz/?ned=nz&topic=n&output=rss

Atom: http://news.google.co.nz/?ned=nz&topic=n&output=atom

If you're talking about running through a site to get links of news and harvesting data, then you'd have to have an idea of what that sites HTML is like, and do a regex against it to get the data you want. Typically this is very intensive and if they change their HTML, your script won't work. This is why it's better to ask for an RSS or Atom feed.

If you want to read up on it, I suggest you read up on harvesting data. I wrote an article ages ago about picking up data from weather.com here: Simple Remoting. It may or may not help you.

bradgrafelman

As has been noted, it's best to look for an RSS feed. The page you linked to above has a nav menu to the left containing two links - RSS and Atom.

Also, once you find a feed for a site, don't just assume you have free reign over the info; Google, for example, has some feed-related Terms of Use you should follow.

NZ_Kiwis

So can google news supply RSS feeds for my own news search right... what if it was from one site only? is this possible?