Not sure how this review got approved
Liwet
If she walks away smiling, you spent too much.
I know you can't see who's posting the review or the scores he's posting, but this could be a review for any club.
Got something to say?
Start your own discussion
26 comments
Latest
Making it part of maintaining VIP would help. Maybe writing a review would get you 1-2 weeks of access and then you can earn the other two weeks by voting on reviews before you have to write another review.
I don't see any simple answers on fixing fake or shill reviews but perhaps a flagging system to flag them off might work.
- Minimum 24 hours
- Minimum percent positive approval rate (like 60% or something)
- Minimum amount of positive approvals (even if 24 hours have passed)
- Automatic disqualification after too many negative approvals
I'd also like to know the numbers that a reviewer puts up and how many reviews they've done in the past. I don't see too many problems with knowing the name of the reviewer. It would also be nice to have a way to take down reviews that have already gone up, if something seems amiss.
The downside of having volunteers do the reviewing is the standard varies all over the lot. Speaking personally, that makes me less likely to invest time in a review for fear the review will be rejected out of hand.
For less reviewed clubs, there is a lot that can be said. It’s easy to add something of value. For popular clubs, a typical visit may discover very little new. One or two nuggets of detail might be a reasonable expectation.
I think I remember someone saying it was 3 approvals or 3 rejections which ever came first. If that is the case I would suggest changing it to 10 approvals or 3 rejections. I could also see a 24 hour cap on the voting so reviews are stuck in limbo just because it is a slow day and not enough people are approving/rejecting reviews.
I also think posting the names of the approvals would help hold people accountable for the quality of reviewz they approve. The possible downside would be that some VIPs may not approve/reject reviews as often for fear of their decision being mocked.
Before rejecting a review, I suggest you ask whether there is any info that could benefit another member. For example, simply naming one ROB is worthwhile info for all of us. That can be done in one sentence. I don’t need a 16 paragraph review telling me how many urinals are in the men’s room.
-- I think that the review's author should remain anonymous at the time of review, but that the users who approved the review should be public once the review goes live.
-- Bad reviews will get through, regardless. I think that we need to be diligent about reporting them to founder, and then founder can determine if the review should be deleted and/or revoking any VIP benefits.
I would look at the issue differently. Accept the current review system with its positives (speed, ease of use, anonymity, user managed) and negatives (sometimes bad ones slip through).
I agree there is an issue with shill reviews but I don’t think the best way to handle it is an overhaul of the approval system. Maybe some tweaks like 5 ok’s to approve, 3 nays to reject.
I think the better way to handle it is input after the initial approval. Only after it’s posted do we have the reviewer’s name, history, rating numbers, etc. to help identify poor reviews. Also, and most importantly, we then have local members who know the club focusing on the review who can best identify incorrect, stale or faked commentary. This is the ‘second level’ where we can better weed out the bad. We sort of have this system with the comments, but it does allow the rating numbers to slip through. I think a button allowing recommendations for post- publication rejection would do the trick. Maybe have the ability to recommend rejection allowable for 5 days and if nobody questions the review in that time, it’s final?
I’m sure there are other solutions but my vote is we need a finer tooth net after the initial screen.
I would look at the issue differently. Accept the current review system with its positives (speed, ease of use, anonymity, user managed) and negatives (sometimes bad ones slip through).
I agree there is an issue with shill reviews but I don’t think the best way to handle it is an overhaul of the approval system. Maybe some tweaks like 5 ok’s to approve, 3 nays to reject.
I think the better way to handle it is input after the initial approval. Only after it’s posted do we have the reviewer’s name, history, rating numbers, etc. to help identify poor reviews. Also, and most importantly, we then have local members who know the club focusing on the review who can best identify incorrect, stale or faked commentary. This is the ‘second level’ where we can better weed out the bad. We sort of have this system with the comments, but it does allow the rating numbers to slip through. I think a button allowing recommendations for post- publication rejection would do the trick. Maybe have the ability to recommend rejection allowable for 5 days and if nobody questions the review in that time, it’s final?
I’m sure there are other solutions but my vote is we need a finer tooth net after the initial screen.
But with that said, overall the review quality has still improved dramatically over the old system. Nothing is perfect, but I'll take this over what we had before any day.
As Mark94 mentioned, not sure if putting more hoops to jump thru is necessarily a good-thing - but not saying things can't improve but I'm not sure what that may be - and "reviewing the reviewers" per a 2nd-level reviewing seems overkill - and naming-names may be counterproductive.
Perhaps upping the # of approvals would help - but I think approval/rejection thresholds should be equal, and as someone suggested have a 24-hr timeout that if a review has not gotten to the threshold then it gets auto-published.
The peer-review system is good but not foolproof - i.e. there are peers that are morons - there are reviewers that write weak reviews that get approved and these same weak-reviewers then approve other weak reviews.