problems fetching rss

[Cam Bazz]

Hello,

I just made my first program using rome-fetcher. There are some problems with some feeds however.

What happens is for one of the servers I am following rome polls the feed, but does not retrieve it, the server does not return an error, but just waits. but when I put the url in firefox, it returns a valid rss.

Checking a little bit more, I found out the feed url sets a cookie in the browser, my speculation is that correct me if I am wrong, the server tries to set a cookie, and then checks it before sending the xml. and since rome fetcher does not understand, it gets stuck.

Another problem is that sometimes some of the feeds is not parsed properly, I get content is not allowed in prolog exception (this is what happens because of invalid formed xml)

Any ideas/solutions/help greatly appreciated.

Best Regards,
-C.B.

[erlingwl]

I'm thinking that the error here are really on the server if it
actually demands that a cookie is being set on a client. How does this
feed work in other Feed Readers, e.g. Google Reader? If it works
there, I guess they have come up with some sort of workaround, maybe
you can find some best practices somewhere?

- Erling

On Wed, Jun 4, 2008 at 1:00 PM, Cam Bazz <cambazz@...> wrote:

> Hello,
>
> I just made my first program using rome-fetcher. There are some problems
> with some feeds however.
>
> What happens is for one of the servers I am following rome polls the feed,
> but does not retrieve it, the server does not return an error, but just
> waits. but when I put the url in firefox, it returns a valid rss.
>
> Checking a little bit more, I found out the feed url sets a cookie in the
> browser, my speculation is that correct me if I am wrong, the server tries
> to set a cookie, and then checks it before sending the xml. and since rome
> fetcher does not understand, it gets stuck.
>
> Another problem is that sometimes some of the feeds is not parsed properly,
> I get content is not allowed in prolog exception (this is what happens
> because of invalid formed xml)
>
> Any ideas/solutions/help greatly appreciated.
>
> Best Regards,
> -C.B.
>

--
Med vennlig hilsen
Erling Wegger Linde

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@...
For additional commands, e-mail: users-help@...

[Alejandro Abdelnur-2]

> Another problem is that sometimes some of the feeds is not parsed properly,
> I get content is not allowed in prolog exception (this is what happens because of invalid formed xml)

Rome uses an xmlfixer (by default) that takes care of some of this, if you are getting such exception, could you send what you are getting in the prolog up to the rss root element?

A

On Wed, Jun 4, 2008 at 4:30 PM, Cam Bazz <cambazz@...> wrote:

Hello,

I just made my first program using rome-fetcher. There are some problems with some feeds however.

What happens is for one of the servers I am following rome polls the feed, but does not retrieve it, the server does not return an error, but just waits. but when I put the url in firefox, it returns a valid rss.

Checking a little bit more, I found out the feed url sets a cookie in the browser, my speculation is that correct me if I am wrong, the server tries to set a cookie, and then checks it before sending the xml. and since rome fetcher does not understand, it gets stuck.

Another problem is that sometimes some of the feeds is not parsed properly, I get content is not allowed in prolog exception (this is what happens because of invalid formed xml)

Any ideas/solutions/help greatly appreciated.

Best Regards,
-C.B.

[Cam Bazz]

sometimes it works, sometimes it does not. I removed the feedfetchercache, and since then it did not make the same error again.

anyways, is there a way to set the timeout?

also, I understand that in rome.properties you can set some sort of timestamp mask, and it will do the trick. I have done that, and it worked, however only for one feed. can I give custom timestamps for each feed I have?

Best Regards,
-C.B.

On Wed, Jun 4, 2008 at 2:07 PM, Erling Wegger Linde <erlingwl@...> wrote:

I'm thinking that the error here are really on the server if it
actually demands that a cookie is being set on a client. How does this
feed work in other Feed Readers, e.g. Google Reader? If it works
there, I guess they have come up with some sort of workaround, maybe
you can find some best practices somewhere?

- Erling

On Wed, Jun 4, 2008 at 1:00 PM, Cam Bazz <cambazz@...> wrote:
> Hello,
>
> I just made my first program using rome-fetcher. There are some problems
> with some feeds however.
>
> What happens is for one of the servers I am following rome polls the feed,
> but does not retrieve it, the server does not return an error, but just
> waits. but when I put the url in firefox, it returns a valid rss.
>
> Checking a little bit more, I found out the feed url sets a cookie in the
> browser, my speculation is that correct me if I am wrong, the server tries
> to set a cookie, and then checks it before sending the xml. and since rome
> fetcher does not understand, it gets stuck.
>
> Another problem is that sometimes some of the feeds is not parsed properly,
> I get content is not allowed in prolog exception (this is what happens
> because of invalid formed xml)
>
> Any ideas/solutions/help greatly appreciated.
>
> Best Regards,
> -C.B.
>

--
Med vennlig hilsen
Erling Wegger Linde

---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscribe@...
For additional commands, e-mail: users-help@...