About 5 or 6 years ago, I joined a local photo club, on the urging of my wife (an artist) who thought I could benefit from sharing with other photographers. It's a rather large club (membership ranges from 100-160 people each year), and have a number of very accomplished professional and advanced amateur photographers. It's a club that is very active in encouraging various aspects of the photographic arts (technical, shooting opportunities, exploration of old and new techniques, judging, exhibiting, and competition), with weekly meetings having different subjects (presentations by well-known and/or local photographers, art gallery curators, members describing their specialties, member competitions, member show-and-tell nights).
One of the aspects that gets a lot of attention is cultivating new judges from among the members, with the goal of having all members capable of being judges in any of the competitions the club holds. There is one basic course that is taught by a long-time judge and each judge is encouraged to come up with a set of criteria to use in conducting their evaluation activities. The club deliberately wants a rotation of judging talent since any one judge, being human, has his/her own perspectives and point of view and habits, and these will inevitably colour their perceptions. By encouraging rotation, the judging reactions can never be predicted (or played to by the photographers entering the competition). At the presentation of the competition results, all the images and their scoring are shown, and then the top three and the runner-ups are discussed in detail, with each judge (there are usually three for each competition) discussing on the stage what aspects of the image contributed/detracted from the final scoring. It is traditional to have one of the judges be an "expert" in the field not affiliated with the club, and with the other two being the club members. This allows for a very transparent and clear discussion which explores what attributes of an image contribute to the overall result.
In participating in these competitions, I've come up with a personal checklist that I use in analyzing images to help guide my analysis of the image. This is my checklist:
Subjective:
· What it the overall feeling when you first look at the image?
· What attracts your attention?
· Is there a story or narrative that the image evokes?
· What does the photographer reveal or show to you?
· Is there a specific aspect that makes you want to look at this image again?
Objective:
· Are the camera choices (exposure, aperture, shutter speed, focus position, DOF, focal length, filtering) supporting or detracting from the overall feeling?
· It/are the position(s) of the main subject(s) in the frame supporting or detracting the overall feeling?
· Is the light arrangement contributing positively or negatively to the image?
· Are the post-processing choices contributing to the overall feel or distracting?
· Are the elements that are not the main subject(s) supporting or competing with the main subject(s)?
Bottom line: Is it an interesting image?
In competition, it is rare for us to need to refer to the "objective" aspects as most of the images are very well executed from a technical point-of-view. However, in workshops where we coach and mentor other photographers, those aspects are discussed in detail as they are often the reason why an image doesn't work, or at least, not in the way the photographer intended.
In the C&C on this forum, we also have the challenge that many of the posters have not gone through any kind of formal training in image evaluation, and are learning how to express an opinion on an image. This applies to some of the very good photographers, as well, as making good images is not the same as analyzing and evaluating them. So, the comments made "may" be founded on deep knowledge and practice, or may be the ramblings of a monday-quarterback *** photographer, who may or may not have actually done any photography himself/herself. So when participating in an on-line forum, it pays to hang around and get a feeling from the various posts who knows what they are talking about, and who talks because they like the sound of their own voice.
Personally, if I come across a good critique, I usually try and look up the work of the person offering the critique, to see if there is a body of work which back-stops the opinions expressed, or was just a lucky guess. Then, I can go back and see if the critique is consistent with the principles practiced by the critique-giver. Sometimes the person does not have an online presence, and you get an idea of their abilities from the online postings. The basic lesson in evaluating critiques is to know whether the person actually knows what they are talking about. You don't have to agree with the view/opinion expressed, but you should be able to understand how that opinion was arrived at.