NER Certified Speech-to-Text Provider FAQs

Who are the members of the Committee and Task Force that created the NCSP?

Committee members:
Steve Clark, steno captioner, USA
Chris Ales, voice captioner, USA
Jamie Kelly, steno captioner, USA
Heidi Callahan, voice captioner, USA
Victor Perez, industry, USA

Matthew Call, voice captioner, USA

What is the NER?
The NER (which stands for number of words, edition error and recognition error) was developed by Dr. Pablo Romero-Fresco, past Global Alliance Board Member and professor and researcher.

Please see this link NER model - Wikipedia for further explanation of the NER model for determining the accuracy of live captions (a.k.a. subtitles).

Additional resources: NER Model (video),   NER Model handout,    NER PowerPoint slides, The NER grading model for the Global Alliance NCSP certification (short video)

What is the NCSP and how was it developed?
The NCSP is the Global Alliance’s Level 1 skills test. Additional levels of testing will be developed. The accuracy required to pass these Level 2 and Level 3 tests will be higher and the material will be more difficult.

Committee members and Task Force members have met since 2020 to determine the best and most accurate way to assess accuracy of live captions, and the NER model was chosen. The NER is used internationally to assess the accuracy of live broadcast captions. It is also used by many captioning companies globally to assess the accuracy of live CART (communication access realtime translation) captions.

Who is eligible to sit for the NCSP?

Any Global Alliance member is eligible to sit for the NCSP.  Anyone who is not a Global Alliance member but would like to sit for the NCSP can go to the NCSP registration page and follow the prompts to become a member and register to take the NCSP skills test.  You must be a Global Alliance member to take the test and to use the "NCSP" credentials with your name, on business materials, etc.

The NCSP is open to all methods of live captioning.

When testing ASR, each product must be tested individually. Any resulting NCSP certification will only apply to that unique product.

What is the cost to test?
$300 USD, Global Alliance members
$495 USD, non-Global Alliance members  ($300 test fee and $195 membership fee)

How do I register for the NCSP?
Click here to register for the NCSP.

How is the NCSP administered?
The NCSP is administered online, using Zoom and StreamText.net. The test candidate must have a StreamText.net account and a laptop with a camera and microphone. The test candidate will be provided a Zoom link by the proctor.

The test consists of a ten-minute clip from an actual motivational speech and one-on-one interview with the presenter. During the clip the speed varies, there is the need for parenthetical information to be added by the captioner, and there is some slang used.

Before beginning the assessment, the proctor will have the test candidate verify identity (government-issued ID or passport). A one-minute clip from the same motivational speech is played to allow the test candidate to get a feel for the speaker and his style and to make any adjustments to audio and other computer settings.

Upon completion, the proctor will save the realtime transcript directly from StreamText.net. 

How is the realtime transcript graded?
The transcript is graded by Certified NER Evaluators. Two Global Alliance members have been trained by Pablo Romero-Fresco and have been awarded the Certified NER Evaluator designation and certificate.

An Excel spreadsheet has been created to compare the verbatim transcript of the assessment to the test candidate’s realtime transcript. Errors are marked, and the reason for marking an error is given where necessary. A pass/fail score is then determined. Each spreadsheet will be checked by both evaluators to ensure accuracy.

What is a passing score?
98% or above is a passing score when taking the Level 1 assessment.

The committee continues to work on Level 2 and Level 3 assessments. It is anticipated that the accuracy level for each will be 98.5% with the assessment recordings increasing in difficulty.

What happens when a test candidate passes the NCSP?
The test candidate is notified the test has been successfully passed, and a digital certificate is then sent to the test candidate.

The NCSP certificate is valid for one year. Upon attestation of continuing to provide realtime captioning services at a minimum of 10 hours per month, and maintaining good membership status in the Global Alliance, a renewal certificate will be sent annually. After four years, the certificate holder must retest to maintain NCSP certification. The fee to re-certify is $150 USD.

How do I register to re-take the NCSP when I need to re-certify?
 Click here to register for the NCSP to re-certify.

What happens when a test candidate fails the NCSP?
The test candidate is notified the test has not been successfully passed. The test candidate is eligible to retest after one month, and the cost to retest is $150 USD.

How do I register to re-take the NCSP after the one-month waiting period?
 If you are currently eligible to RETAKE the NCSP test, please click here to register.

Is there a video that explains all the details about the NCSP?

Yes!  Please view this video to answer most, if not all, your questions related to the NCSP.