BabyTech® Awards 2023, Grading and Evaluation Criteria Committee meets to confirm direction for grading in 2023.

The BabyTech® Awards 2023 (hereafter BTA2023) Preparatory Committee held a Scoring Evaluation Criteria Committee meeting (Chairperson: Tetsuya Nagata, BTA Judging Committee Chairperson) to discuss the direction and scoring criteria for BabyTech® Awards 2023, which will begin accepting applications in mid-May 2023. The following is a disclosure of the meeting.

Scoring the BabyTech Award 2023

• The initial screening will be based on documents submitted by applicants.
• In the second round of judging, the judges will give each criterion a score out of 5 points (25 points total), and the total number of points will determine the ranking.
• There is no order of precedence for each screening criterion.
• Screening will be based on declarations made by applicants, and questions and detailed information may be checked with applicants during the screening process.

Scoring and Evaluation Criteria Committee Considerations

Does the order of application affect the evaluation?

Since the documents for the first screening are checked as needed, the scores are basically unaffected. The order of applications for the second round of screening is basically unaffected since the documents are disclosed to the evaluators (judges) after they are compiled.

Is there a limit to the total number of entries per category?

Currently, it is not assumed. Although it is not assumed, there is no denying the possibility that the order of applications will be affected if there are too many applications. (Because the applications will be approved sequentially).

Is the numerical evaluation absolute or relative?

The list and the order of evaluation are in alphabetical order by product name, so it is safe to assume that it is in fact a relative evaluation. It is our understanding that the evaluation is based on a relative evaluation, with each department being differentiated and assigned a numerical value.

Currently, the rating order of the scoring sessions is in alphabetical order by category, but doesn't this give preconceived notions?

In light of the current number of applications, we believe that the bias effect will be minimal even if the evaluation order is in alphabetical order. Depending on the number of applications in the future, we will consider the handling of internal materials for judging, such as the order of evaluation and the order of publication in the list of submitted products.

If there are only a small number of entries in a category, does the first place in the evaluation score get the grand prize even if it is of low quality?

There is a standard score to be reached for the award, and categories that did not score above the standard may be designated as "no products eligible for the award". This has been consistently the case since the first event in 2019.

Evaluation items and their criteria

• Problem statement, solution
  • Is the argument for the issue (focus point) clear and is the granularity of extraction appropriate?
  • Do you have a strong awareness of issues, concerns, and thoughts about the childcare environment?
  • Does the solution assume that the issues can be adequately covered?

• Novelty, originality, and practicality
  • Compared to similar products, are there any unique initiatives, and do these initiatives create an advantage?
    • Advantage refers to an advantage in terms of features, ease of use, price, etc.
  • Are the one-of-a-kind appeal points leading to the right advantages?

• Functionality, ease of use
  • Is the system designed to be easy to use for the target users, and does it ensure the certainty of operation?
  • For devices, is it easy to install, can it be used in fewer steps (e.g., fewer button presses)?
  • If it is a community service, is it structured to make it easy for anyone to participate?
  • For a second application, is the functionality and ease of use refined compared to the previous application?

• Safety and health considerations(Newly established in 2023)
  • In the case of physical products such as devices and toys, are the main body and accessories considered to be safe from accidents and other damages that could be expected in childcare settings?
  • When handling personal information of parents, children, and family members, and data related to their life and growth, is the purpose of use clearly indicated, and is the data collected and utilized in accordance with the purpose?
  • Is the storage and processing of data assumed to be secure (this notation is based on the assumption that prototype applications are possible)?

• Prospects, continuity
  • Is it intended for long-term use, not just short-term perspective?
  • Is there potential for future development, such as envisioning approaches to new areas of coexistence?
  • Are there any new insights or assumptions in the re-application compared to the previous application? If pivoting, is it appropriate?

... and upwards