Warning: Wordy
Mills in our area are taking two different tacks on this.
One group writes a test that a very knowledgeable person would score about 60%. The advantages are simple. With a test that hard, the likelihood of having four or five people ace the test is nil. Second the proctor gets a good view of the individuals under a certain amount of stress. This group includes a decent skills (hands on) check to follow up the knowledge test. Results are typically what you would expect, if they do well on the written test, they do well on the practical.
The other group writes a basic test and expects a high grade. They do more interviews, and use the interviews to sort out the good ones.
We just completed a Pay-For-Skills assessment for one mill in a major company. The skills included wiring and programming a reversing starter (using PLC5), setting up a powerflex 70 to meet certain standards (ramp up, down, max current etc.), replacing a processor, input card, and RIO card (again PLC5) and checking a motor with a megger, (the motor is actually a trainer that is faultable.) finding open and shorted wires in conduit, and clearing a fault (math error) in a processor. This did not include a written test.
Another mill in the same company asked for a four hundred question bank to pull a 150 question test as the written part of their Pay-For-Skills. The written will be followed by an instrumentation skills test.
NFPA 70E knowledge is a plus. Safety violations are grounds for failure.
I see both strategies working. The choice is up to the individuals who do the interviews/grade the tests. I like to interview at least three people for every position I need to fill.
One thing I really expect of a good electrician is a good working knowledge of the most common equipment in a mill. Directional valves, regulators, gearboxes, cylinders, and so on are a must. Nothing gets on my nerves faster than an electrician that says “that’s not my job,” when the millwrights and operators are stretched out. Note to union guys: In a union mill I fully respect the union, but lazy is lazy. I don’t like lazy. I was a shop steward, and Local VP.