I think we need a review of referees

Is there ever a review of referee or moderators, some are very poor at their job lol.

WE, as users, do NOT know all the work a referee executes!!!! What we do know, is that we from time to time send a Change Request to be treated. If that takes time, so be it, maybe the referee had 100 requests in the same week? If a referee didn't accept your CR, he probably gave you a reason, which you can appeal, if you're not happy. 

Please specify with examples, why you stated, that some are poor, without naming names, of course?

I'm not a referee, but I find they do a lot and mostly well, and all that on their own time! You, as a user, is spending your time only on yourself, they spend some of theirs for the numista community. 

Have a look at your own profile to see, what you have attributed to numista over the years, please. Then evaluate, if you're in a strong position to judge others, please?

Sjoelund

WE, as users, do NOT know all the work a referee executes!!!! What we do know, is that we from time to time send a Change Request to be treated. If that takes time, so be it, maybe the referee had 100 requests in the same week? If a referee didn't accept your CR, he probably gave you a reason, which you can appeal, if you're not happy. 

 

Please specify with examples, why you stated, that some are poor, without naming names, of course?

 

I'm not a referee,but I find they do a lot and mostly well, and all that on their own time! You, as a user, is spending your time only on yourself, they spend some of theirs for the numista community. 

 

Have a look at your own profile to see, what you have attributed to numista over the years, please. The evaluate, if you're in a strong position to judge others, please?

Well said @Sjoelund. Of course, if others think they can do better, then they could apply to be a referee themselves.

@Gumardee
Mate, I believe that numista is actively seeking to recruit referees for many vacant slots. Perhaps you ought to apply for one, and help out.

Gumardee

Is there ever a review of referee or moderators, some are very poor at their job lol.

 

 

There are at least two ways that the admins are made aware of problems with referees. Long queues of pending work are occasionally handled by other referees so there is some notice to the staff when reviews aren't handed. Also the appeals process gives insight to which referees aren't making good decisions.

bjherbison

Gumardee

Is there ever a review of referee or moderators, some are very poor at their job lol.

 

 

There are at least two ways that the admins are made aware of problems with referees. Long queues of pending work are occasionally handled by other referees so there is some notice to the staff when reviews aren't handed. Also the appeals process gives insight to which referees aren't making good decisions.

Funny that the appeal queue is also 3 months.

We have internal tool to check and measure referee acrivity. :)

For appeals, yes, some take time, because they are not easy to handle. If I am not an expert in some coinage, I have to ask around for a solution.

Gumardee

Is there ever a review of referee or moderators, some are very poor at their job lol.

 

 

Yes, being myself a referee, I agree with you. I can easily imagine the delays looking at some work load we face sometimes. Members also have to realize that we, as referee, also have to maintain both languages pages for each coin. I'm not sure every referee have the availability or knowledge of both languages (French and English) to do this.

But reading you comment. it would be useful if you could be more specific on what you think us referees should concentrate our efforts on.

Everyone understands that some infos are more critical than others to fill, but some members don't really help speed up things by not filling the basics. I suggest members use more the DUPLICATION function (find the most similar coin to the one you want to add and duplicate it).

It's not easy to find the right balance. Some members expect referees to be “perfect” in all aspect of their duties and others just wants us to be quick to process their requests.

What are the members real expectations, quality or speed ? Referees accepting changes/new coins without completing/verifying all the fields and not causing delay or a speedy processing that might result in incomplete or even erroneous infos. 

Since this is a collaborative site, maybe the solution would be for referees to accept coins without much verifications and let the community do the work. What would you prefer? Maybe we should do a survey regarding this aspect of the referee duties.

Regards,

We're slowly turning into this thread: https://en.numista.com/forum/topic124660.html

Sjoelund

We're slowly turning into this thread: https://en.numista.com/forum/topic124660.html

Not really the same topic/subject in my view.

Expectation and referee duties must be reviewed I think, and eventually, after a review, measure the referees on their performance to achieve their main duties. This being said, we also need to train members to submit more complete requests. The duplication tools is a good exemple of what we can provide members to help them submit change that will required less work from the referees. I don't know if there's another tool in Xavier's mind, but I really appreciate members that use this tool when a similar coin already exist in the catalog. It saves me a lot of work when members add multiple coins in a serie with this tool .

Regards,

I try and be informative and complimentary on a request, especially from someone new to submitting. For example this one today that I sent back for modifications with a link to sections of the guidelines…

Thank you for your submission!!!
When possible include the city and state both completely spelled out and within parenthesis like this...
Teddy Bear Arcade Token (Boston, Massachusetts)
Pictures should be cropped closer to the edges, makes the item look better, Also should be taken with a white background
https://en.numista.com/catalogue/contributions/instructions.php#banknote_pictures
Do you know the diameter, weight, shape?
Value should be blank
Under Edge - Smooth or Plain is fine. No need to mention "edging" on edge category
No date box should be checked on date line
If writing is present on the obverse, reverse or edge then a script must be applied, English is latin
Again, Thank you for your submission and Numista looks forward to your future submissions

Or if I have one that they are not new to submitting, if I make the changes to their submission. I include those changes and provide links to the proper sections of the guidelines on an approval for example..

Thanks!!
I removed script from reverse due to no writing present

and

Thank you for your submission
I made some changes
Changed title by adding Parenthesis
Added "FM" to lettering on reverse
Removed "Governor's Edition" from date line, you can add that to comments if you like
https://en.numista.com/catalogue/contributions/instructions.php#dateline_comment

I believe that making changes and approving the submission and not explaining what changes were made, then the contributor will not know what to do next time.