Pilot evaluation
A practical checklist for a mining maintenance workflow pilot
A bounded pilot should answer a specific operating question and leave the site with evidence for a deliberate rollout or no rollout decision.
A maintenance software pilot should test a defined operating question. It should not become an open-ended rollout with unclear expectations. Before site use, both parties need a written scope, named owners and a way to decide what the evidence means.
1. Name the operating question
Decide what the pilot needs to prove. For example: can one crew maintain a reviewable fault record across a shift change, or can supervisors coordinate the same field record without recreating it in a separate update?
A focused question keeps the pilot from becoming a broad judgement on every future product capability.
2. Bound the people, fleet and workflow
Confirm the site, crew, roles, asset slice and maintenance workflow. Identify who can create, review, hand over, supervise and export records. Record any process that stays outside the pilot.
3. Confirm devices and connectivity conditions
List the supported devices, operating system versions, browser or application configuration and the expected connectivity pattern. Validate the supported cached information and low connectivity workflow for that configuration before relying on it on site.
A successful test on one device or network condition should not be treated as a blanket offline claim.
4. Agree the information and safety boundary
Identify the asset information, demonstration or site records and technical sources approved for the pilot. Confirm rights, organisation scope and who may review them. Document the site procedures and machine information that remain controlling for safety.
Advisory guidance should keep its source state visible. Where no governed retrieval or generation occurred, the workflow should say so plainly.
5. Choose measures the records can support
Agree the baseline, observation method and success criteria before kickoff. Measures should be based on information the pilot can actually record. Avoid promising availability, MTBF, MTTR or downtime improvement where the required meter and event coverage is not in scope.
6. Define support, incidents and rollback
Name the customer and FaultPilot contacts, support window, incident path and the condition that pauses the pilot. Confirm how access can be disabled, what data can be exported and how the agreed environment is closed if the test stops.
7. Make a deliberate rollout decision
At the end of the pilot, review the agreed evidence, unresolved limitations, crew feedback, security position and integration requirements. The output should support a rollout, a revised test or a no-rollout decision without changing the criteria after the fact.
Review the current 30-day pilot structure, the security and procurement pathway, and where FaultPilot fits before scoping the engagement.
Scope the pilot with FaultPilot →