The superior performance of the two-step rating-based double-faced applicability (DFA) test to the check-all-that-apply (CATA) question

Ye Jin Lee; Min A. Kim; Hye Seong Lee

doi:10.1016/j.foodqual.2022.104751

The superior performance of the two-step rating-based double-faced applicability (DFA) test to the check-all-that-apply (CATA) question

Ye Jin Lee, Min A. Kim, Hye Seong Lee

Department of Food Science & Biotechnology

Research output: Contribution to journal › Article › peer-review

4 Scopus citations

Abstract

For successful product development and marketing in the food/beverage industry, it is vital to study the product attributes perceived by consumers effectively and efficiently. Recently, a two-step rating-based ‘double-faced applicability’ (DFA) test was developed to study consumer perception and evaluation of product attributes in a quantitative way using d-prime affect magnitude (d'_A) based on signal detection theory. This study assessed the product discrimination and characterization performance and interpretationability of d'_Aoutput measures of the DFA approach in comparison with the check-all-that-apply (CATA) question. An independent samples design (each N = 108) was used to evaluate eighteen ready-to-drink (RTD) latte products with eighteen attributes. A cluster analysis was also performed, and based on this the relationships of the two output statistics - d'_A and total citation frequency were examined. Product attributes were generated based on literature reviews on coffee sensory and emotion studies and sensory/consumer research methodology to encompass consumer perception generally applicable to beverage, and for each attribute, a pair of ‘double-faced’ descriptors in three categories - ‘general weak-strong’, ‘sensory’, and ‘sentimental consequence’ were used for the DFA test. The d'_A of the DFA test provided similar product characterization to citation frequency of the CATA question, yet provided better product discrimination and reflected the consumer affective perception for each product independently in a better interpretable way, in valence. It showed a sigmoid relationship with the citation frequency due to its nature of reflecting valence. Overall, the results contribute support for the usefulness of the DFA approach for consumer product testing and suggest the potential of developing a generally applicable DFA test format for studying integrated attribute perception.

Original language	English
Article number	104751
Journal	Food Quality and Preference
Volume	104
DOIs	https://doi.org/10.1016/j.foodqual.2022.104751
State	Published - Mar 2023

Bibliographical note

Funding Information:
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (No. 2018R1D1A1A02086215). Also, this work was carried out with the support of “Cooperative Research Program for Agriculture Science and Technology Development (Project No. PJ01711101)” Rural Development Administration, Republic of Korea.

Publisher Copyright:
© 2022 Elsevier Ltd

Keywords

CATA question
Consumer perception
DFA test
Measurement
Product test
Rating
Sensory profiling
Signal detection theory

Access to Document

10.1016/j.foodqual.2022.104751

Cite this

@article{f7514ae1cc764d4e9524a3c616965f61,

title = "The superior performance of the two-step rating-based double-faced applicability (DFA) test to the check-all-that-apply (CATA) question",

abstract = "For successful product development and marketing in the food/beverage industry, it is vital to study the product attributes perceived by consumers effectively and efficiently. Recently, a two-step rating-based {\textquoteleft}double-faced applicability{\textquoteright} (DFA) test was developed to study consumer perception and evaluation of product attributes in a quantitative way using d-prime affect magnitude (d'A) based on signal detection theory. This study assessed the product discrimination and characterization performance and interpretationability of d'Aoutput measures of the DFA approach in comparison with the check-all-that-apply (CATA) question. An independent samples design (each N = 108) was used to evaluate eighteen ready-to-drink (RTD) latte products with eighteen attributes. A cluster analysis was also performed, and based on this the relationships of the two output statistics - d'A and total citation frequency were examined. Product attributes were generated based on literature reviews on coffee sensory and emotion studies and sensory/consumer research methodology to encompass consumer perception generally applicable to beverage, and for each attribute, a pair of {\textquoteleft}double-faced{\textquoteright} descriptors in three categories - {\textquoteleft}general weak-strong{\textquoteright}, {\textquoteleft}sensory{\textquoteright}, and {\textquoteleft}sentimental consequence{\textquoteright} were used for the DFA test. The d'A of the DFA test provided similar product characterization to citation frequency of the CATA question, yet provided better product discrimination and reflected the consumer affective perception for each product independently in a better interpretable way, in valence. It showed a sigmoid relationship with the citation frequency due to its nature of reflecting valence. Overall, the results contribute support for the usefulness of the DFA approach for consumer product testing and suggest the potential of developing a generally applicable DFA test format for studying integrated attribute perception.",

keywords = "CATA question, Consumer perception, DFA test, Measurement, Product test, Rating, Sensory profiling, Signal detection theory",

author = "Lee, {Ye Jin} and Kim, {Min A.} and Lee, {Hye Seong}",

note = "Funding Information: This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (No. 2018R1D1A1A02086215). Also, this work was carried out with the support of “Cooperative Research Program for Agriculture Science and Technology Development (Project No. PJ01711101)” Rural Development Administration, Republic of Korea. Publisher Copyright: {\textcopyright} 2022 Elsevier Ltd",

year = "2023",

month = mar,

doi = "10.1016/j.foodqual.2022.104751",

language = "English",

volume = "104",

journal = "Food Quality and Preference",

issn = "0950-3293",

publisher = "Elsevier Ltd.",

}

TY - JOUR

T1 - The superior performance of the two-step rating-based double-faced applicability (DFA) test to the check-all-that-apply (CATA) question

AU - Lee, Ye Jin

AU - Kim, Min A.

AU - Lee, Hye Seong

N1 - Funding Information: This research was supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (No. 2018R1D1A1A02086215). Also, this work was carried out with the support of “Cooperative Research Program for Agriculture Science and Technology Development (Project No. PJ01711101)” Rural Development Administration, Republic of Korea. Publisher Copyright: © 2022 Elsevier Ltd

PY - 2023/3

Y1 - 2023/3

N2 - For successful product development and marketing in the food/beverage industry, it is vital to study the product attributes perceived by consumers effectively and efficiently. Recently, a two-step rating-based ‘double-faced applicability’ (DFA) test was developed to study consumer perception and evaluation of product attributes in a quantitative way using d-prime affect magnitude (d'A) based on signal detection theory. This study assessed the product discrimination and characterization performance and interpretationability of d'Aoutput measures of the DFA approach in comparison with the check-all-that-apply (CATA) question. An independent samples design (each N = 108) was used to evaluate eighteen ready-to-drink (RTD) latte products with eighteen attributes. A cluster analysis was also performed, and based on this the relationships of the two output statistics - d'A and total citation frequency were examined. Product attributes were generated based on literature reviews on coffee sensory and emotion studies and sensory/consumer research methodology to encompass consumer perception generally applicable to beverage, and for each attribute, a pair of ‘double-faced’ descriptors in three categories - ‘general weak-strong’, ‘sensory’, and ‘sentimental consequence’ were used for the DFA test. The d'A of the DFA test provided similar product characterization to citation frequency of the CATA question, yet provided better product discrimination and reflected the consumer affective perception for each product independently in a better interpretable way, in valence. It showed a sigmoid relationship with the citation frequency due to its nature of reflecting valence. Overall, the results contribute support for the usefulness of the DFA approach for consumer product testing and suggest the potential of developing a generally applicable DFA test format for studying integrated attribute perception.

AB - For successful product development and marketing in the food/beverage industry, it is vital to study the product attributes perceived by consumers effectively and efficiently. Recently, a two-step rating-based ‘double-faced applicability’ (DFA) test was developed to study consumer perception and evaluation of product attributes in a quantitative way using d-prime affect magnitude (d'A) based on signal detection theory. This study assessed the product discrimination and characterization performance and interpretationability of d'Aoutput measures of the DFA approach in comparison with the check-all-that-apply (CATA) question. An independent samples design (each N = 108) was used to evaluate eighteen ready-to-drink (RTD) latte products with eighteen attributes. A cluster analysis was also performed, and based on this the relationships of the two output statistics - d'A and total citation frequency were examined. Product attributes were generated based on literature reviews on coffee sensory and emotion studies and sensory/consumer research methodology to encompass consumer perception generally applicable to beverage, and for each attribute, a pair of ‘double-faced’ descriptors in three categories - ‘general weak-strong’, ‘sensory’, and ‘sentimental consequence’ were used for the DFA test. The d'A of the DFA test provided similar product characterization to citation frequency of the CATA question, yet provided better product discrimination and reflected the consumer affective perception for each product independently in a better interpretable way, in valence. It showed a sigmoid relationship with the citation frequency due to its nature of reflecting valence. Overall, the results contribute support for the usefulness of the DFA approach for consumer product testing and suggest the potential of developing a generally applicable DFA test format for studying integrated attribute perception.

KW - CATA question

KW - Consumer perception

KW - DFA test

KW - Measurement

KW - Product test

KW - Rating

KW - Sensory profiling

KW - Signal detection theory

UR - http://www.scopus.com/inward/record.url?scp=85141267547&partnerID=8YFLogxK

U2 - 10.1016/j.foodqual.2022.104751

DO - 10.1016/j.foodqual.2022.104751

M3 - Article

AN - SCOPUS:85141267547

SN - 0950-3293

VL - 104

JO - Food Quality and Preference

JF - Food Quality and Preference

M1 - 104751

ER -

The superior performance of the two-step rating-based double-faced applicability (DFA) test to the check-all-that-apply (CATA) question

Abstract

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this