Nabble - Antville

new film download site

2008-02-02T03:18:24Z

_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

new film download site

2008-02-01T15:15:34Z

_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Antville License Change

2007-06-02T10:15:37Z

Hello again, Antville developer's mailing-list, after quite some time...

I hope the fellow subscribers are doing fine and that those to whom
this message may concern are still reading here.

As you might have noticed I returned from my resignation of
developing Antville and proclaimed the Antville Summer Of Code 2007
[1] for the sake of fixing and polishing the wonderful weblog
software to make it shine even brighter as it already did in its
glorious past.

Now I don't want to bother you with my vision of further evolving a
software that others might already consider a dated legacy, anyway.

It's just that I want to straighten out some things to ease the
burden of caring about too many details and thus, to enjoy the future
development even more.

One of these things is to replace the current, custom Antville
License [2] with the Apache License 2.0 [3].

Why? It's more popular and actually just a more abstract version of
the current Antville License [4]. Thus, Antville would be fitted with
a license that is widely accepted and everbody can care a little less
what's so special about this special Antville License.

Since some of you contributed code to the project, I want to be sure
that this action is taken in accordance with you.

If you should have any objections against this change please consider
to speak up now and let me hear your suggestions how we could solve
any issue you might be concerned about.

Otherwise, after a grace period of two weeks from now (17 June 2007
at midnight), I regard the license change as granted.

Best regards,
tobi

--

[1] http://tobi.antville.org/stories/1634995/

[2] http://project.antville.org/license/17/

[3] http://www.apache.org/licenses/LICENSE-2.0.html

[4] The most important difference between Antville License and Apache
License 2.0 is, AFAIK, the latter missing point 5 ("We ask you to
give credit..."); since this isn't an obligation of the license it
can be considered redundant and be stated somewhere else with at
least the same (if not even a bigger) impact.

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Custom Authentication (Shibboleth)

2007-04-10T15:30:41Z

Hello,
I have added a rudimentary single sign on (based on Internet2
Shibboleth) support to antville, by checking for specific http-headers
in the Global/autologin function which is called by HopObject.onRequest.
The authentication works for the antville main page at /antville/,
however, if I try to access a blog, say /antville/someblog/ it doesn't
seem to work anymore. I can't tell if the session isn't valid anymore
and it fails to create a new one in autologin, or if autologin is called
at all. Here's the code I added to autologin:

function autoLogin() {
if (session.user) return;

var u;
var name=req.data['shib-person-uid'];

if(name && name.length>0)
{
u = root.users.get(name);
if(!u)
{
u = app.registerUser(name, "foo");
if (!u) throw new Exception("memberExisting");
u.email = req.data['shib-inetorgperson-mail'];
u.publishemail = false;
u.registered = new Date();
u.blocked = 0;
}
session.login(u);
session.data.shib=true;
u.lastVist=new Date();
return
}
(...)

Please note, that I added the additional http headers to the helma
source, so
they work just fine.
Thanks in advance,
--Florian
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Shibboleth Support

2007-03-19T15:07:26Z

Hello all,
Shibboleth is a Single Sign On system developed by internet2 to enable
users to just log in at one instance and providing different
applications with the user's credentials after he authenticated himself
using a single password.
The communication of user credentials works through environment
variables provided by a apache module.
I installed antville as described using mod_jk, but while I can code
some javascript, I'm by no means experienced with the technology used to
build server-side applications with helma.
I'd appreciate some tips as to where to start looking in the source. If
you think the changes necessary would be simple to implement for you,
I can support you regarding the apache module.
Shibboleth is on it's way to become the de-facto standard for web sso in
the academic sector and is already being used at a lot of institutions
worldwide, while antville seems to be the only free solution for mass
blog hosting, so integration looks like a worthwhile effort for all
concerned.

regards,
--Florian
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Online Gambling-Online Black Jack-Black Jack Casino-Online Slots-Slots Online

2007-01-01T23:55:42Z

Hannes Wallnoefer wrote:

Hi list, here is a very rough referrer spam detection and blocking script I wrote for antville.org. I think it may be useful for other big antville installations. It's very rough in its current state, and not at all integrated into the antville app infrastructure. It needs to be polished and probably should be be integrated into the antville SysMgr. Attached you find file refspam, which provides a global object containing two functions: Refspam.track(), which should be called as first thing in HopObject.onRequest(), and Refspam.dump(), which should be called from Root.refspam_action() and provides output for current referrer blocking state and blocked requests. The way referrer detection and blocking works is very simple, it's described here . We keep a least-recently-used Hashtable of size 128 in app.data.refspam which is keyed with the host names of referrer headers we get. As soon as we see more than 20 requests with a given referrer host, we check if the number of IP addresses the requests came from is below a given ratio, and if the number of referrer path names is above a certain ratio (this is to prevent valid intranet links to be qualified as spam), and if so, requests are redirected to the /refspam action which displays a message and provides a link to continue to the original target. Referrer bots won't follow the redirect, so it's a good safety net. The script also contains a hardcoded whiltelist for hostnames which currently contains ".antville.org" and ".google.". The parameters and the whitelist should probably be configurable through antville's management interface, and there probably should also be configurable blacklist. I hope this will be useful for somebody, and that somebody is going to integrate this into the antville code base. hannes _______________________________________________ Antville-dev mailing list Antville-dev@helma.org http://helma.org/mailman/listinfo/antville-dev

Online Black Jack

Where to buy viagra
Buy cheap acomplia
Buy cheap generic acomplia
Generic Pharmacy Online
Buy viagra where
Buy cheap viagra where
Buy cheap viagra where
Buy cheap acomplia
cheap generic acomplia
Order cheap acomplia
Order cheap Albenza

From forum: Antville - Dev

Your money, paper foot

2006-09-16T12:59:29Z

Worried about the loss of erectoin? EVEN if you have no
erectoin problems SOFT CIA6LIS would help you to bring
back some romantic moments that u lost in past.

Just disolve half a pil under your tongue and get ready for action
in 15 minutes. SOFT CIABLIS! It makes your lovemaking incredible!

VISIT US TODAY, AND GET OUR SPECIAL 70% DISCAOUNT OFER!

http://rhwglg.sgarow.info/?18325030

Instant shipping worldwide. Absolutely CONFIDENTIAL and SECURE purchase.

------------------
with time. We're ahead of the fashion, maybe, Ahead of the way that most
The unit came configured with Microsoft XP Home Edition with SP2 as well as the following software:

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Crosspost: Job Offer in Vienna

2006-07-17T03:58:15Z

Hi,

This message has already been posted to the Helma developer list.
I don't know how many subscriber here don't read the other least.

Summary for non-German speakers: this is a job offer for Helma
developers in Vienna.

Best regards,
Christoph

---------------------------------------------------------------

Wir, die Entwicklungsabteilung der ORF Online und Teletext GmbH,
suchen ab sofort Software-EntwickerInnen zur Verstärkung unseres
Teams.

ORF Online ist verantwortlich für den Großteil der Websites, die
unter ORF.at laufen. Dazu gehören u.a. news.ORF.at, die Futurezone,
FM4 und die ORF-Ski Challenge.

Unsere Abteilung besteht aus ca. einem Dutzend Entwicklern und wir
suchen Leute, die gut ins Team passen. Die meisten Applikationen
sind auf Helma-Basis.

Tätigkeitsprofil:
-----------------
- Konzeption und Programmieren von Helma-Applikationen
- Arbeit an server- und client-seitigen JavaScript Libraries
- Betreuung von bestehenden Angeboten, aber keine Helpline
- enge Zusammenarbeit mit Design, Projektentwicklung und Redaktion
- Festanstellung in Wien
- möglichst Vollzeit, ab Sommer oder Herbst 2006

Erfahrungen, Fähigkeiten und Qualifikation:
-------------------------------------------
essentiell:
- Zeitgemäßer Umgang mit XHTML/CSS2
- Helma-Kenntnisse bzw. Erfahrungen mit JavaScript oder Java im
Webkontext
- Mitarbeit an professionellen Webapplications, bevorzugt CMS
- Strukturiertes Arbeiten
- Abstraktionsvermögen

weiterhin erwünscht:
- Grundkenntnisse Bildbearbeitung
- Erfahrungen mit Audio/Video
- SQL-Kenntnisse
- Linux/Unix
- Apache
- Interfaces, Usability
- Webservices, Syndication, XML
- Communities

Interessenten melden sich bitte bei mir (christoph.lincke[ät]orf.at).

_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: referrer spam detection

2006-06-07T05:09:01Z

For the record, here's the current and probably final (as far as I'm
concerned) version of my refspam.js file. It's been working very well
for over a week on antville.org, most of the blocking being done by
the blacklist, with occasional attacks from new spammers being
detected quite reliably.

hannes

2006/5/29, Hannes Wallnoefer <hannesw@...>:

> Hi list,
>
> here is a very rough referrer spam detection and blocking script I
> wrote for antville.org. I think it may be useful for other big
> antville installations. It's very rough in its current state, and not
> at all integrated into the antville app infrastructure. It needs to be
> polished and probably should be be integrated into the antville
> SysMgr.
>
> Attached you find file refspam, which provides a global object
> containing two functions: Refspam.track(), which should be called as
> first thing in HopObject.onRequest(), and Refspam.dump(), which should
> be called from Root.refspam_action() and provides output for current
> referrer blocking state and blocked requests.
>
> The way referrer detection and blocking works is very simple, it's
> described here <http://www.henso.com/log/2006.05.28/1154/>. We keep a
> least-recently-used Hashtable of size 128 in app.data.refspam which is
> keyed with the host names of referrer headers we get. As soon as we
> see more than 20 requests with a given referrer host, we check if the
> number of IP addresses the requests came from is below a given ratio,
> and if the number of referrer path names is above a certain ratio
> (this is to prevent valid intranet links to be qualified as spam), and
> if so, requests are redirected to the /refspam action which displays a
> message and provides a link to continue to the original target.
> Referrer bots won't follow the redirect, so it's a good safety net.
>
> The script also contains a hardcoded whiltelist for hostnames which
> currently contains ".antville.org" and ".google.". The parameters and
> the whitelist should probably be configurable through antville's
> management interface, and there probably should also be configurable
> blacklist.
>
> I hope this will be useful for somebody, and that somebody is going to
> integrate this into the antville code base.
>
> hannes
>
>
>

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

refspam.js (10K) Download Attachment

From forum: Antville - Dev

Re: SITE_DISKUSAGE mediumint(10)

2006-06-06T07:25:01Z

nighthawk wrote:
> Hi,

Hi,

> I ran into an interesting problem that might affect other antville
> installations aswell today. I am running Mysql 5.x which seems to be
> more strict about datatypes and the values you try to store with them.
> Apparently I have uploaded more than ~8MB of files (mostly pictures)
> to my blog which resulted in the following error message:
>
> com.mysql.jdbc.MysqlDataTruncation: Data truncation: Out of range
> value adjusted for column 'SITE_DISKUSAGE' at row 1

Funny to hear that, I experienced the same problem this weekend on our
installation. I didn't know that this comes from our Mysql 5.x.

> I got that message while using the metaWeblogAPI, but I'm pretty sure
> it would have happened aswell, if I had uploaded a file using the
> Antville Webfrontend.
> The simple fix to this is making the column SITE_DISKUSAGE in the
> AV_SITE table a little bigger.. I made it "int(11) unsigned" which has
> a maximum value of 4294967295 - that should be enough for a while.
> I would suggest that every Antville administrator does the same, even
> when running Mysql 4.x only since using mediumint(10) will only result
> in inconsistent data for large blogs - which is exactly where this
> column comes in handy.

I did it, thank you.

> +n
<snip />

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

SITE_DISKUSAGE mediumint(10)

2006-06-05T15:13:15Z

Hi,

I ran into an interesting problem that might affect other antville
installations aswell today. I am running Mysql 5.x which seems to be
more strict about datatypes and the values you try to store with them.
Apparently I have uploaded more than ~8MB of files (mostly pictures)
to my blog which resulted in the following error message:

com.mysql.jdbc.MysqlDataTruncation: Data truncation: Out of range
value adjusted for column 'SITE_DISKUSAGE' at row 1

I got that message while using the metaWeblogAPI, but I'm pretty sure
it would have happened aswell, if I had uploaded a file using the
Antville Webfrontend.
The simple fix to this is making the column SITE_DISKUSAGE in the
AV_SITE table a little bigger.. I made it "int(11) unsigned" which has
a maximum value of 4294967295 - that should be enough for a while.
I would suggest that every Antville administrator does the same, even
when running Mysql 4.x only since using mediumint(10) will only result
in inconsistent data for large blogs - which is exactly where this
column comes in handy.

+n
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-06-01T02:21:18Z

Hi list,

I don't know why but the implementation makes trouble. As I mentioned on
the helma-user list:

http://helma.org/pipermail/helma-user/2006-May/006533.html

I get all the time these strange tomany open files errors from java, so
I think there is something buggy.

Another thing strange is that I tried to add the black/whitelist to the
root object so it gets stored after a restart. First of all it doesn't
get stored, and today in the morning the black/whitelist on the root
object disappeared. They where simply null. Maybe I should use an other
java Object to store the lists, or simply a HopObject.

Can somebody help? The current version can be downloaded from my weblog:

http://weblogs.brandnews.at/pm/stories/3808/

cu Philipp

<snip />
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: introduction

2006-05-30T12:54:41Z

me too :D

On 5/30/06, girindra nath <girindranath@...> wrote:
> hi everybody.....!
> i am India based journalist.i am very happy to subscribe this panell...
> thanks.
> Girindra
> _______________________________________________
> Antville-user mailing list
> Antville-user@...
> http://helma.org/mailman/listinfo/antville-user
>

--
Linux is like living in a teepee. No Windows, no Gates and an Apache in house!
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: referrer spam detection

2006-05-30T09:05:45Z

Franz Philipp Moser wrote:
<snip />
> I put the whole thing under GPL on my blog if anybody needs it:
>
> http://weblogs.brandnews.at/pm/stories/3808/
<snip />

Sorry for that but I released it now, under the antville licence so
everybody can use it.

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

introduction

2006-05-30T08:17:00Z

hi everybody.....!
i am India based journalist.i am very happy to subscribe this panell...
thanks.
Girindra
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: referrer spam detection

2006-05-30T07:35:35Z

I added it now to HopObject/onRequest() just after res.handlers.site is
filled and it works fine.

We need res.handlers.site on our blogs, but for antville.org I think you
can just add "root.refspam.track()" as the first instruction in
HopObject/onRequest().

Works good thx to hns for thinking about that and finding a quick solution.

I put the whole thing under GPL on my blog if anybody needs it:

http://weblogs.brandnews.at/pm/stories/3808/

cu Philipp

nighthawk wrote:

> I guess it saves the load of generating the HTML source. Esp. those
> spammers often send a lot of requests at once and don't even bother
> read the answer from the webserver - so its really just a waste of cpu
> power that could be avoided.
>
>
> On 5/30/06, Franz Philipp Moser <philipp.moser@...> wrote:
>> One last question, why this redirect? We could just skip the Access entry?
>>
>> cu Philipp

<snip />

--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-05-30T02:35:03Z

nighthawk wrote:
> I guess it saves the load of generating the HTML source. Esp. those
> spammers often send a lot of requests at once and don't even bother
> read the answer from the webserver - so its really just a waste of cpu
> power that could be avoided.
<snip />

Ohh, sorry yes missed that ;) you are right of course. So logAccess is
not the right place to redirect, it should than be onRequest() instead.

Where is it integrated in antville?

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-05-30T02:20:20Z

I guess it saves the load of generating the HTML source. Esp. those
spammers often send a lot of requests at once and don't even bother
read the answer from the webserver - so its really just a waste of cpu
power that could be avoided.

On 5/30/06, Franz Philipp Moser <philipp.moser@...> wrote:
> One last question, why this redirect? We could just skip the Access entry?
>
> cu Philipp
>
> Franz Philipp Moser wrote:
> <snip />
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-05-30T02:01:18Z

One last question, why this redirect? We could just skip the Access entry?

cu Philipp

Franz Philipp Moser wrote:
<snip />
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-05-29T14:52:24Z

Hannes Wallnoefer wrote:
<snip />
> * Track referrer hosts like my script currently does

Done ;)

> * Whenever one host is *definitely* referrer spam, automatically add
> it to a permanent blacklist and send the site admin a mail about it

Done

> * Offer the site admin a list of referrer hosts sorted by requests/ip
> address ratio and let him/her manually add sites to the permanent
> blacklist.

Done

> * A request with a referrer host that is blacklisted is redirected to
> the refspam page so if it's a valid request, users can still click
> through.

Done. Added a security feature so not every url is accepted

> If anybody is interested in implementing this you're welcome. I'm
> available for any questions you may have.

I hope this looks like you want it. I also implemented a whitelist,
manually adding/removing hosts. As I sayed I added the track function to
the Global/logAccess() function. The whole thing is encapsuled in an
AntiSpamRefMgr mounted on root.

Added support for domains, maybe not needed for antville.org

Please take a look. I tested it on our weblogs and it worked out of the box.

> hannes
<snip />

I wonder if app.data Objects are stored(serialized) when the app is
restarted? Because we would loose the white and blacklist.

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

antirefspam_module.zip (10K) Download Attachment

From forum: Antville - Dev

Re: referrer spam detection

2006-05-29T07:33:52Z

Hi,

Hannes Wallnoefer wrote:
> I just found there's an error in the original script that makes the
> spam redirect go into an infinite loop. I'm attaching the new script
> with a fix. Also, the detection check thresholds changed a little bit
> since the last version.

I started to implement some things like skins, and so on, and found some
other problem.

*) what to do with weblogs with their own domain. req.path doesn't work
here, or am I wrong?

> Actually, I think the approach I choose is not the ideal one. For
> instance, one person clicking through a (large) blogroll on his/her
> weblog looks very much like referrer spam to this script. From what I
> know now, I would suggest the following approach:
>
> * Track referrer hosts like my script currently does
> * Whenever one host is *definitely* referrer spam, automatically add
> it to a permanent blacklist and send the site admin a mail about it
> * Offer the site admin a list of referrer hosts sorted by requests/ip
> address ratio and let him/her manually add sites to the permanent
> blacklist.
> * A request with a referrer host that is blacklisted is redirected to
> the refspam page so if it's a valid request, users can still click
> through.

I'm working on it, also try to implement a whitelist. I will integrate
your suggestions.

We also should not add hosts to the cache that are allready on the
blacklist/whitelist, doesn't make sense.

> If anybody is interested in implementing this you're welcome. I'm
> available for any questions you may have.

I am and I started some things as you can see in the attached file. Got
this implementation working on our weblogs.

logAcces may not be the right place for the check, but it worked good
for me.

> hannes
<snip />

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

antirefspam_module.zip (5K) Download Attachment

From forum: Antville - Dev

Re: referrer spam detection

2006-05-29T06:01:24Z

Hi,

I am not much of a Javascript Developer.. But is it maybe possible to
also add a check against the referrerspam filterlist that is already
existant in Antville? I have often thought that this would be a nice
addon, because I am suffering from some special spammer that keeps
"referring" links from only a few domains and usually with obvious
words like 'viagra' or 'casino' in the URL. It is actually pretty easy
to filter those, but they're still being tracked - which I would like
to avoid aswell.

On 5/29/06, Hannes Wallnoefer <hannesw@...> wrote:

> I just found there's an error in the original script that makes the
> spam redirect go into an infinite loop. I'm attaching the new script
> with a fix. Also, the detection check thresholds changed a little bit
> since the last version.
>
> Actually, I think the approach I chose is not the ideal one. For
> instance, one person clicking through a (large) blogroll on his/her
> weblog looks very much like referrer spam to this script. From what I
> know now, I would suggest the following approach:
>
> * Track referrer hosts like my script currently does
> * Whenever one host is *definitely* referrer spam, automatically add
> it to a permanent blacklist and send the site admin a mail about it
> * Offer the site admin a list of referrer hosts sorted by requests/ip
> address ratio and let him/her manually add sites to the permanent
> blacklist.
> * A request with a referrer host that is blacklisted is redirected to
> the refspam page so if it's a valid request, users can still click
> through.
>
> If anybody is interested in implementing this you're welcome. I'm
> available for any questions you may have.
>
> hannes
>
> 2006/5/29, Franz Philipp Moser <philipp.moser@...>:
>>
>> Hannes Wallnoefer wrote:
>> > Hi list,
>>
>> Hi,
>>
>>> here is a very rough referrer spam detection and blocking script I
>>> wrote for antville.org. I think it may be useful for other big
>>> antville installations. It's very rough in its current state, and not
>>> at all integrated into the antville app infrastructure. It needs to be
>>> polished and probably should be be integrated into the antville
>>> SysMgr.
>> <snip />
>>
>> thanxs for that. I thought of writing such a "thing" (global spam
>> detection) myself, but hadn't the time.
>>
>> I will testdrive your script and let you know how it works.
>>
>> Thanxs again
>>
>> cu Philipp

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: referrer spam detection

2006-05-29T05:43:46Z

I just found there's an error in the original script that makes the
spam redirect go into an infinite loop. I'm attaching the new script
with a fix. Also, the detection check thresholds changed a little bit
since the last version.

Actually, I think the approach I chose is not the ideal one. For
instance, one person clicking through a (large) blogroll on his/her
weblog looks very much like referrer spam to this script. From what I
know now, I would suggest the following approach:

* Track referrer hosts like my script currently does
* Whenever one host is *definitely* referrer spam, automatically add
it to a permanent blacklist and send the site admin a mail about it
* Offer the site admin a list of referrer hosts sorted by requests/ip
address ratio and let him/her manually add sites to the permanent
blacklist.
* A request with a referrer host that is blacklisted is redirected to
the refspam page so if it's a valid request, users can still click
through.

If anybody is interested in implementing this you're welcome. I'm
available for any questions you may have.

hannes

2006/5/29, Franz Philipp Moser <philipp.moser@...>:

>
> Hannes Wallnoefer wrote:
> > Hi list,
>
> Hi,
>
> > here is a very rough referrer spam detection and blocking script I
> > wrote for antville.org. I think it may be useful for other big
> > antville installations. It's very rough in its current state, and not
> > at all integrated into the antville app infrastructure. It needs to be
> > polished and probably should be be integrated into the antville
> > SysMgr.
> <snip />
>
> thanxs for that. I thought of writing such a "thing" (global spam
> detection) myself, but hadn't the time.
>
> I will testdrive your script and let you know how it works.
>
> Thanxs again
>
> cu Philipp
> --
> XML is the ASCII for the new millenium
> (Cocoon Documentation)
> _______________________________________________
> Antville-dev mailing list
> Antville-dev@...
> http://helma.org/mailman/listinfo/antville-dev
>

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

refspam.js (5K) Download Attachment

From forum: Antville - Dev

Re: referrer spam detection

2006-05-29T02:27:12Z

Hannes Wallnoefer wrote:
> Hi list,

Hi,

> here is a very rough referrer spam detection and blocking script I
> wrote for antville.org. I think it may be useful for other big
> antville installations. It's very rough in its current state, and not
> at all integrated into the antville app infrastructure. It needs to be
> polished and probably should be be integrated into the antville
> SysMgr.
<snip />

thanxs for that. I thought of writing such a "thing" (global spam
detection) myself, but hadn't the time.

I will testdrive your script and let you know how it works.

Thanxs again

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

referrer spam detection

2006-05-29T01:55:01Z

Hi list,

here is a very rough referrer spam detection and blocking script I
wrote for antville.org. I think it may be useful for other big
antville installations. It's very rough in its current state, and not
at all integrated into the antville app infrastructure. It needs to be
polished and probably should be be integrated into the antville
SysMgr.

Attached you find file refspam, which provides a global object
containing two functions: Refspam.track(), which should be called as
first thing in HopObject.onRequest(), and Refspam.dump(), which should
be called from Root.refspam_action() and provides output for current
referrer blocking state and blocked requests.

The way referrer detection and blocking works is very simple, it's
described here <http://www.henso.com/log/2006.05.28/1154/>. We keep a
least-recently-used Hashtable of size 128 in app.data.refspam which is
keyed with the host names of referrer headers we get. As soon as we
see more than 20 requests with a given referrer host, we check if the
number of IP addresses the requests came from is below a given ratio,
and if the number of referrer path names is above a certain ratio
(this is to prevent valid intranet links to be qualified as spam), and
if so, requests are redirected to the /refspam action which displays a
message and provides a link to continue to the original target.
Referrer bots won't follow the redirect, so it's a good safety net.

The script also contains a hardcoded whiltelist for hostnames which
currently contains ".antville.org" and ".google.". The parameters and
the whitelist should probably be configurable through antville's
management interface, and there probably should also be configurable
blacklist.

I hope this will be useful for somebody, and that somebody is going to
integrate this into the antville code base.

hannes

_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

refspam.js (4K) Download Attachment

From forum: Antville - Dev

question about app.data.indexManager and updating

2006-05-20T04:21:22Z

Hi list,

I've updated our weblogserver to debian sarge, java 5_06, helma cvs and
mysql 5.

Some problems I've encountered, maybe somebody will have the same
problems when updating:

1) I lost the app.data.indexManager. strange thing this
app.data.indexManager is never used really. So what is it for? I read
something about searching. Some never finished development?

2) Strange thing: Suddenly all stories where offline, because the
"this.online" (in the Story prototype) was allways false. I had to to
change all tinyint collumns to mediumint. After that change the status
of stories was correctly displayed.

3) All settings of the Root prototype have been lost because I did not
copy the db directory. This should be changed for future releases ;)
maybe a AV_ROOT table, like in twoday open?

after all the update was successfull. Be shure to check the
default-character-set in the mysql setting. This setting caused a lot of
trouble (no layouts found, some blogs offline, no users found), where
objects are being retrieved by name (Textcollumn). This thing caused me
2 hours of work to find out, grrrr.

Hope that is usefull to someone upgrading to current software (helma,
mysql, java).

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-dev mailing list
Antville-dev@...
http://helma.org/mailman/listinfo/antville-dev

From forum: Antville - Dev

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-29T11:22:10Z

thanks alot philipp!
feedback about the tests will come in next few days.
bye,bernhard

Franz Philipp Moser wrote:

>
>
> bernhard bauch wrote:
>> hi,
>
> Hi list,
>
>> i already contacted hannes and he gave me a link to an old version of
>> export.hac which just works with helma 1.2/fesi
>> http://www.antville.org/static/project/files/export.hac
> <snip />
>
> Based on the script, I did a complete rework and ported it to the
> current antville release. You should copy the file to the Root prototype
> and protect it somehow.
>
> Set the timeout of your application to an appropriate value!
>
> Call: http://your.installation.host/export
>
> Please test it and give me feedback.
>
> cu Philipp
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Antville-user mailing list
> Antville-user@...
> http://helma.org/mailman/listinfo/antville-user

--
http://stupidius.dyndns.org
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-29T06:49:18Z

bernhard bauch wrote:
> hi,

Hi list,

> i already contacted hannes and he gave me a link to an old version of
> export.hac which just works with helma 1.2/fesi
> http://www.antville.org/static/project/files/export.hac
<snip />

Based on the script, I did a complete rework and ported it to the
current antville release. You should copy the file to the Root prototype
and protect it somehow.

Set the timeout of your application to an appropriate value!

Call: http://your.installation.host/export

Please test it and give me feedback.

cu Philipp
--
XML is the ASCII for the new millenium
(Cocoon Documentation)

_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

action_export.js (8K) Download Attachment

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-21T05:03:30Z

hi,
i already contacted hannes and he gave me a link to an old version of
export.hac which just works with helma 1.2/fesi
http://www.antville.org/static/project/files/export.hac

if i get a working export-script i'll let you know.
bye,bernhard

Franz Philipp Moser wrote:

> Sorry for my late reply, I just found the article you refer to
>
> http://www.antville.org/project/stories/354448
>
> it seems that hannes has written sometimes this export.hac script.
>
> Maybe it is still somewhere on his harddisk ;)
>
> cu Philipp
>
> bernhard bauch wrote:
>> should i post my request (export.hoc) to the antville-dev list ?
>>
>>
>> jota cuatro gatos wrote:
>>> i'm sorry. i cannot help you. glad to receive a message from a user of
>>> antville.
>>>
>>> seeing soon.
>>>
>>> it could be easy writing spanish, if possible.
>>>
>>> jota.
>>>
>>> ------------------------------------------------------------------------
>>>
>>> > Date: Fri, 14 Apr 2006 16:10:05 +0200
>>> > From: bernikuh@...
>>> > To: antville-user@...
>>> > Subject: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
>>> >
>>> > hi,
>>> > missing the export.hoc or makeSQL.hoc script to convert my internal
>>> > mckoi java-DATA of Antville to an external mySQL database!
>>> >
>>> > anybody got this script ???
>>> > thanks alot!
>>> > bernhard
>>> >
>>> >
>>> > --
>>> > http://stupidius.dyndns.org
>>> > _______________________________________________
>>> > Antville-user mailing list
>>> > Antville-user@...
>>> > http://helma.org/mailman/listinfo/antville-user
>>>
>>>
>>> ------------------------------------------------------------------------
>>> Tu horóscopo diario, semanal y gratuito. Cartas, tarot y predicciones en
>>> MSN Horóscopo <http://astrocentro.msn.es/msnes/>
>>>
>>>
>>> ------------------------------------------------------------------------
>>>
>>> _______________________________________________
>>> Antville-user mailing list
>>> Antville-user@...
>>> http://helma.org/mailman/listinfo/antville-user
>

--
http://stupidius.dyndns.org
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-21T04:40:51Z

On 4/21/06, Franz Philipp Moser <philipp.moser@...> wrote:
> Sorry for my late reply, I just found the article you refer to
>
> http://www.antville.org/project/stories/354448
>
> it seems that hannes has written sometimes this export.hac script.
>
> Maybe it is still somewhere on his harddisk ;)

there is no need to look through his hdd.. its right there:
http://www.antville.org/static/project/files/export.hac
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-21T03:41:57Z

Sorry for my late reply, I just found the article you refer to

http://www.antville.org/project/stories/354448

it seems that hannes has written sometimes this export.hac script.

Maybe it is still somewhere on his harddisk ;)

cu Philipp

bernhard bauch wrote:

> should i post my request (export.hoc) to the antville-dev list ?
>
>
> jota cuatro gatos wrote:
>> i'm sorry. i cannot help you. glad to receive a message from a user of
>> antville.
>>
>> seeing soon.
>>
>> it could be easy writing spanish, if possible.
>>
>> jota.
>>
>> ------------------------------------------------------------------------
>>
>> > Date: Fri, 14 Apr 2006 16:10:05 +0200
>> > From: bernikuh@...
>> > To: antville-user@...
>> > Subject: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
>> >
>> > hi,
>> > missing the export.hoc or makeSQL.hoc script to convert my internal
>> > mckoi java-DATA of Antville to an external mySQL database!
>> >
>> > anybody got this script ???
>> > thanks alot!
>> > bernhard
>> >
>> >
>> > --
>> > http://stupidius.dyndns.org
>> > _______________________________________________
>> > Antville-user mailing list
>> > Antville-user@...
>> > http://helma.org/mailman/listinfo/antville-user
>>
>>
>> ------------------------------------------------------------------------
>> Tu horóscopo diario, semanal y gratuito. Cartas, tarot y predicciones en
>> MSN Horóscopo <http://astrocentro.msn.es/msnes/>
>>
>>
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Antville-user mailing list
>> Antville-user@...
>> http://helma.org/mailman/listinfo/antville-user
>

--
XML is the ASCII for the new millenium
(Cocoon Documentation)
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-20T16:28:40Z

i just go in antville web for have a nice time reading some news, english and spanish, and i really have not much news for you on your request.

thanks for having this mailing.

if needing more, don't worry: go on mailing this place.

jota

> Date: Thu, 20 Apr 2006 13:51:36 +0200

> From: bernikuh@...
> To: antville-user@...
> Subject: Re: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
>
> should i post my request (export.hoc) to the antville-dev list ?
>
>
> jota cuatro gatos wrote:
> > i'm sorry. i cannot help you. glad to receive a message from a user of
> > antville.
> >
> > seeing soon.
> >
> > it could be  easy writing spanish, if possible.
> >
> > jota.
> >
> > ------------------------------------------------------------------------
> >
> >  > Date: Fri, 14 Apr 2006 16:10:05 +0200
> >  > From: bernikuh@...
> >  > To: antville-user@...
> >  > Subject: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
> >  >
> >  > hi,
> >  > missing the export.hoc or makeSQL.hoc script to convert my internal
> >  > mckoi java-DATA of Antville to an external mySQL database!
> >  >
> >  > anybody got this script ???
> >  > thanks alot!
> >  > bernhard
> >  >
> >  >
> >  > --
> >  > http://stupidius.dyndns.org
> >  > _______________________________________________
> >  > Antville-user mailing list
> >  > Antville-user@...
> >  > http://helma.org/mailman/listinfo/antville-user
> >
> >
> > ------------------------------------------------------------------------
> > Tu horóscopo diario, semanal y gratuito. Cartas, tarot y predicciones en
> > MSN Horóscopo <http://astrocentro.msn.es/msnes/>
> >
> >
> > ------------------------------------------------------------------------
> >
> > _______________________________________________
> > Antville-user mailing list
> > Antville-user@...
> > http://helma.org/mailman/listinfo/antville-user
>
> --
> http://stupidius.dyndns.org
> _______________________________________________
> Antville-user mailing list
> Antville-user@...
> http://helma.org/mailman/listinfo/antville-user

Tu horóscopo diario, semanal y gratuito. Cartas, tarot y predicciones en MSN Horóscopo
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-20T05:51:36Z

should i post my request (export.hoc) to the antville-dev list ?

jota cuatro gatos wrote:

> i'm sorry. i cannot help you. glad to receive a message from a user of
> antville.
>
> seeing soon.
>
> it could be easy writing spanish, if possible.
>
> jota.
>
> ------------------------------------------------------------------------
>
> > Date: Fri, 14 Apr 2006 16:10:05 +0200
> > From: bernikuh@...
> > To: antville-user@...
> > Subject: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
> >
> > hi,
> > missing the export.hoc or makeSQL.hoc script to convert my internal
> > mckoi java-DATA of Antville to an external mySQL database!
> >
> > anybody got this script ???
> > thanks alot!
> > bernhard
> >
> >
> > --
> > http://stupidius.dyndns.org
> > _______________________________________________
> > Antville-user mailing list
> > Antville-user@...
> > http://helma.org/mailman/listinfo/antville-user
>
>
> ------------------------------------------------------------------------
> Tu horóscopo diario, semanal y gratuito. Cartas, tarot y predicciones en
> MSN Horóscopo <http://astrocentro.msn.es/msnes/>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Antville-user mailing list
> Antville-user@...
> http://helma.org/mailman/listinfo/antville-user

--
http://stupidius.dyndns.org
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

Re: export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-19T16:15:03Z

i'm sorry. i cannot help you. glad to receive a message from a user of antville.

seeing soon.

it could be easy writing spanish, if possible.

jota.

> Date: Fri, 14 Apr 2006 16:10:05 +0200

> From: bernikuh@...
> To: antville-user@...
> Subject: [Antville-user] export.hoc / makeSQL.hoc -- mckoi to mySQL
>
> hi,
> missing the export.hoc or makeSQL.hoc script to convert my internal
> mckoi java-DATA of Antville to an external mySQL database!
>
> anybody got this script ???
> thanks alot!
> bernhard
>
>
> --
> http://stupidius.dyndns.org
> _______________________________________________
> Antville-user mailing list
> Antville-user@...
> http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User

export.hoc / makeSQL.hoc -- mckoi to mySQL

2006-04-14T08:10:05Z

hi,
missing the export.hoc or makeSQL.hoc script to convert my internal
mckoi java-DATA of Antville to an external mySQL database!

anybody got this script ???
thanks alot!
bernhard

--
http://stupidius.dyndns.org
_______________________________________________
Antville-user mailing list
Antville-user@...
http://helma.org/mailman/listinfo/antville-user

From forum: Antville - User