*

Note - the following guide is written from the perspective of an inspection workflow that includes one machine assessment stage then two human assessment stages, for interrogation and QA.

*

Admin setup

  1. Account Admin create new Processes (P1, P2) for Vendor 1 & Vendor 2 (V1, V2)

    1. Taxonomy copied from any previous Process that has the correct up-to-date taxonomy.

  2. Account Admin create new Data Sources (DS1, DS2)

  3. Account Admin adds:

    1. V1 Process Manager (PM1) to data source DS1 and process P1

    2. V2 Process Manager (PM2) to data source DS2 and process P2

  4. Contact Silverpond to create Machine Assessment Stage 1 & Machine Assessment Stage 2 for vendors within their processes

    1. Note: These machine assessment stages are duplicates with separate target processes P1 and P2

  5. Account Admin creates an interrogation Human Assessment Stage for each vendor within their process

  6. Account Admin creates a QA Human Assessment Stage for each vendor within their process


*

Vendor process

  1. PM1 [PM2] optionally adds another Process Manager to P1 and DS1 [P2 and DS2]

  2. PM1 [PM2] optionally adds labellers L1A, L1B etc. to P1 [L2A, L2B etc. to P2]

  3. Repeat following steps per sequence until contract is complete:

    1. Outside Highlighter, Vendors snap files (one file per pole, Equip_No is filename)

    2. Vendors upload data for a sequence to their data source

      1. Each sequence and smaller batches can be partitioned using new subfolders in S3, then the “sync” button is clicked. Steps:

        1. Add a new folder, for example called “S3://vendor-1/sequence-1/batch-1”

        2. Upload new files to that new folder

        3. Click the ‘Sync’ button on the data source page to bring those new files in that sub-folder into Highlighter

    3. Vendors add files to their machine assessment stage using these steps:

      1. Visit the process New Orders page

      2. See the diagram showing the sequence of stages for your process. It indicates how data will flow between the various stages within the process.

      3. Enter a name for the new order or leave as the default, the current date and time

      4. For the tickbox called 'Lock and prevent addition of new files to order':

        1. Leave it ticked if you don't want any new files to be added to this order later.

        2. Untick it if you want people to be able to add files to this order later, via the Media Search page.

      5. Optionally enter a “Original Source URL filter”. Files whose sub-folder in S3 matches this will be selected for the new order. If you leave this blank, all files in the data source will be selected.

      6. Click Review Order to see what will happen - you will see the number of files matched by the filter, and the folders in your data source that match.

      7. Click Create Order to create the order, or back to change anything.

      8. Once the process oder is created, files will now be added from the data source (Stage 1) to the the next process stage (Stage 2) for processing. Once they have been processed by that stage, they will automatically be added to the next process stage.

    4. Silverpond is notified immediately when tasks are added to a machine assessment stage.

    5. If the machine assessment stage is not already running, Silverpond will manually start it. Vendors can also request Silverpond start their machine assessment stage via Freshdesk.

    6. Silverpond is also notified immediately when a machine assessment stage finishes processing tasks, and then informs Vendor via Freshdesk.

    7. Vendor interrogates files within their interrogation human assessment stage

*

Account QA process

  1. After each file has been interrogated in the interrogation human assessment stage, it passes into the next stage, depending on the filter on that stage (which is the QA human assessment stage). If the file matches the filter, it passes into that stage.

  2. The QA interrogator examines each file and clicks submit on each file when they're happy with what is there.


Export results

  1. On the Admin tab of the process page, Account Admins can export Assessments from each vendor's process which will contain the annotations from their process.
  2. They can export all assessments, or just the latest assessment on each of the files. Also, they can export assessments from the entire process, or just from a process order by selecting that process order in the dropdown.
  3. Since there is only one data source per process, selecting a data source in the dropdown will not affect the export.