PROGOS

language

JP

EN

language

JP

EN

Product Information

Service Provision

PROGOS service is available both as a test and as a system. For more details, please contact us.

PROGOS tests are customizeable. For example, we can provide customized feedback sheets linked to system user's data, learning contents, etc.
Case: RareJob Speaking Test powered by PROGOS

  • ・RareJob, Inc. customized the PROGOS feedback sheet to be linked to its own proficiency levels and online learning materials.
  • ・The customized sheets are used both in theautomatedandmanualevaluation versions of PROGOS.

Test Description

A 20-minute business English speaking test with open-ended questions

Part Questions No. of Questions/ Preparation Time
/ Answer Time		 Evaluation
Part 1 Interview Answer each question within 20 seconds. 10 interview questions
No preparation time
Answer time: 20 seconds per question		 Give relevant responses to general questions.
Part 2 Read Aloud Read sentences aloud.
A sentence shown on a screen → Read aloud. Repeat it 8 times.		 8 sentences
No preparation time
Answer time: 10 seconds per question		 Read the sentences correctly and intelligibly.
Part 3 Presentation 1 task with a few required points. 1 task
Preparation time: 40 seconds
Answer time: 60 seconds		 Present a topic and expand the points.
Part 4 Graphics Presentation Present a graph 1 task
Preparation time: 40 seconds
Answer time:　60 seconds		 Present a graph by describing the facts and the information shown.
Part 5 Role Play Respond to the voice prompts spontaneously. 1 task with a few audio prompts
Preparation time: 40 seconds
Answer time: 30 seconds per prompt		 Respond to the prompts spontaneously.

Click here for sample questions

Test Evaluation and Feedback

Test Evaluation is based on the CEFR (Common European Framework of Reference for Languages) and the CEFR-J. Manual evaluation is conducted by trained and experienced evaluators.
The evaluation focuses on task achievement, appropriateness, and the sufficiency of the answers.

Overall Evaluation CEFR (CEFR-J) Levels
Analytical Evaluation 6 analytical aspects defined by the CEFR

  • Range

    Knowledge of grammar, sentence structures, vocabulary, and phrases

  • Accuracy

    Correct use of grammar, vocabulary, etc.

  • Fluency

    Fluent and
    smooth speaking

  • Interaction

    Ability to start, end
    and / or maintain a conversation

  • Coherence

    Organization of speech and logic

  • Phonology

    Intelligible pronunciation,
    intonation and stress

The following are also included in the feedback sheets:
・ The Can-Do descriptor of the CEFR level result.
・ General feedback and advice on how to improve speaking skills by one level.

Example:

Overall Evaluation B1
Analytical Evaluations Range, Fluency, Interaction, Coherence, Phonology = B1, Accuracy = A2 Feedback on Accuracy:
Word choice, vocabulary and sentence structure needs improvement.The speech volume is sufficient. Although fluent, there are some risks associated with miscommunication in information sharing and intention, particularly in business situations.
In summary, word choice and grammar/sentence structures are weak.

Advisors for PROGOS (human evaluation)

In charge of advising on test design,
test and task implementation, etc.

Prof. Yukio Tono

Leading scholar in CEFR research in JapanProf. Yukio Tono
Tokyo University of Foreign Studies

・CEFR-J Project Leader
・Instructor of NHK radio and TV English programs

In charge of evaluating the final stages of
planning and development

Prof. Masashi Negishi

Leading scholar in language testingProf. Masashi Negishi
Tokyo University of Foreign Studies

Participated in the development of large-scale language tests
Co-leader in the CEFR-J Project, developing CEFR-based language tests.

Developer of PROGOS Test Concept

Mr. Takeshi Shimomata

Chief Quality Officer, PROGOS Inc.Mr. Takeshi Shimomata