fetching older articles

View: New views
3 Messages — Rating Filter:   Alert me  

fetching older articles

by phubaba :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I've noticed that google feed reader can gather articles that are extremely old. (or just more articles than the 15 or so that are currently displayed). I was wondering if it was possible to do this with ROME? I imagine it has something to do with some sort of header HTTP request with the RSS server, but I'm not exactly sure.

I have not been able to find any information on this online.

Thanks

Re: fetching older articles

by Dave Johnson-8 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Mon, Apr 14, 2008 at 10:08 PM, phubaba <phubaba@...> wrote:
>
>  I've noticed that google feed reader can gather articles that are extremely
>  old. (or just more articles than the 15 or so that are currently displayed).
>  I was wondering if it was possible to do this with ROME? I imagine it has
>  something to do with some sort of header HTTP request with the RSS server,
>  but I'm not exactly sure.
>
>  I have not been able to find any information on this online.

Google keeps old entries after they have disappeared from the feeds.

You can't do that with ROME alone. You could use ROME to parse, but
you'll have to develop code to determine when you have a new entry and
to store that new entry in some sort of persistence storage service.

- Dave

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@...
For additional commands, e-mail: users-help@...


Re: fetching older articles

by Brian Starke :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

I had noticed this too.  ROME won't do this out of the box, you have to
sniff the actual GET requests Google Reader is performing and build the
URL's and set your session cookie and the parameters some other way and
retrieve the raw feed.  Then, you can surely use ROME to parse the result.

I'd be more specific, but once I had figured out how to do this, I was
pretty sure that doing this is a violation of Google's ToS and stopped.

Then again, it might not be.  It just seems like you shouldn't be able to.

Google also provides a javascript API to do this very thing if you want to
stay on the straight and narrow : http://code.google.com/apis/ajaxfeeds/


On 4/14/08 11:08 PM, "phubaba" <phubaba@...> wrote:

>
> I've noticed that google feed reader can gather articles that are extremely
> old. (or just more articles than the 15 or so that are currently displayed).
> I was wondering if it was possible to do this with ROME? I imagine it has
> something to do with some sort of header HTTP request with the RSS server,
> but I'm not exactly sure.
>
> I have not been able to find any information on this online.
>
> Thanks


---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@...
For additional commands, e-mail: users-help@...

LightInTheBox - Buy quality products at wholesale price