Hedir Review : A word about The Community Review system

bantychick · Posted: Sat Sep 17, 2005 10:47 am Post subject:

Okay thank you.

lakhya · Joined: 01 Mar 2005 Posts: 473 15240 Hedir Points

We do have an 'official submission guideline' for submitters. Reviewers can make sure that no site violates these guidelines. But 'official set of guidelines' for reviewers would be like imposing our views of what is good and what is bad on all the reviewers.We wanted to avoid this. May be we need to have a second look at what is missing in the system, or what modifications are needed to make it more logical and simple.

acorus

winterfrost · Posted: Sat Sep 17, 2005 6:21 pm Post subject:

lakhya, I can understand your hesitation, but I also think that it's a mistake to leave the review process "wide open." You can find 10 people to approve ANY site of ANY content if you look hard enough.

You MUST have an idea of what kind of content you want to see in hedir. As much as you don't want to impose your ideas of "what is good and what is bad" if you don't do this, you risk hedir turning into something you hate.

On another note...

I can see that the number of "fly-by" submissions is still dramatically exceeding those of people who are sticking around. This is going to continue unless there is some motivation for people to contribute to the community. I know I've said it a few times already, but I strongly suggest that no site will be approved without the submitter reviewing at least 10 other sites him/herself (or having at least 11 posts or X number of hedir points, or whatever criteria you dictate).

I know hedir decided to rely on the community to review free sites because of the manpower required to review them, but I honestly don't see any effort to build that community. At the current review rate free sites will literally never be approved because they will be bumped off the first page or two by the "fly-by" submitters who have no reason to stick around. Personally, I have little desire left to contribute to hedir because of this.

Just my opinion! Confused

bantychick · Posted: Sun Sep 18, 2005 10:49 am Post subject: thanks

Thank you lakhya for the link from here to the submission guidelines. That will make it easier to find. I will read those and then maybe review some sites for you if I can find any I like.

Acorus, I found the link in your post. Thank you, that was one page I was looking for. I had read it before but like I said I read too many things at one time and more or less lost my place. I appreciate the link.

Jos

bantychick · Posted: Wed Sep 21, 2005 12:24 am Post subject:

As I saw somewhere else suggested, and as winterfrost.geo suggested in this thread, "... in order any site to be approved, the initial poster must review at least 10 other sites."

I think this is a good idea. Maybe it will help with getting the number of reviews needed to approve sites that are good.

At the rate it's going, 10 positive reviews seems as though there will be a long time before any site reaches the quota. By then perhaps many pages of submissions will be added. Is 10 too many, Could that rule be modified and combined with the rule about the poster reviewing 10 other sites?

acorus · Posted: Wed Sep 21, 2005 4:52 am Post subject:

lakhya · Joined: 01 Mar 2005 Posts: 473 15240 Hedir Points

Hi guys,
I have prepared the following list based on your suggestions. Feel free to add your suggestions to the list. Lets give it some more thought.. together we will work out the best model for our community, based on these feedbacks

what we have at present:
=================

1) anyone can suggest

2) anyone can review

3) 10 positive reviews

4) no reviewer guidelines

Suggestions from members:
===================

1) minimum 10 reviews or minimum 280 hedir points should be done to post a site for review

2) 5 positive reviews needed to get listed in hedir

3) specific reviewer guidelines

acorus · Posted: Wed Sep 21, 2005 6:59 am Post subject: specific reviewer guidelines

Yvonne · Posted: Wed Sep 21, 2005 9:58 am Post subject:

I think the whole idea/concept of a community review system is a brilliant idea but in practice it doesn't appear to be working that well yet.

As stated in previous posts, the main problems appear to be as follows:

I was wondering if maybe the following solution might work, although I'm not sure how easy it would be to implement.

You register with the forum but are not allowed to post any site for review and can only review other sites.

Once any of the sites you've reviewed has accumulated 10 positive reviews from 10 different people Hedir then reviews the site and if it is found to be of good quality and submitted into Hedir, each of the people who gave it a positive review/vote receive a point. Also those members who gave it a bad review have point taken away.

Alternatively if the site is of poor quality and rejected a point is taken away from all the members that gave it a positive vote and a point is added to members who gave it a negative review.

Once any member reaches 10 points they are then allowed to submit a site for review.

The point system would act as an indication of how good each member is at reviewing sites and I was thinking it might be a way of stopping the people who would just vote for anything so that they can submit their own site.

acorus

lakhya · Joined: 01 Mar 2005 Posts: 473 15240 Hedir Points

Tight control over the proceedings seems to be the common suggestion of all our members.

winterfrost · Posted: Wed Sep 21, 2005 2:23 pm Post subject:

I'm glad to see some progress being made! Smile

I hadn't thought of Hedir points as being a good measure of the "quality" of posts -- that's a good thought. If submitters need a minimum of 280-300 Hedir points in addition to 10 reviews (or posts), it means they have to have posted actual content, not just "Yes"/"No" posts.

I was adamant about having a review guide at first, but the more I thought about it (and tried to write a rebuttal to acorus a few times Wink

) the more I realized that it is very hard to nail down.

Even if the criteria for review are listed, it's still going to come down to a "subjective" review based on those criteria. (If it was an "objective" review somehow, we wouldn't need 10 reviews because everyone should come up with the same score!)

My feeling at the moment is that review criteria should simply "suggest" a list of things to check (content, layout, color, readability, load speed, overall impression, whatever...) and a list of things to "watch for" (lack of content, excessive links/ads, adult content, fronting for another site, whatever...).

At the end of the day it just comes down to someone "feeling" that the site would be a valuable addition to the directory -- that's hard to break into specific criteria and/or ways of judging it.