Skip to main content

Preliminary validation of the pica, ARFID and rumination disorder interview ARFID questionnaire (PARDI-AR-Q)

Abstract

Background

The Pica, ARFID, and Rumination Disorder Interview (PARDI) is a structured interview that can be used to determine diagnosis, presenting characteristics, and severity across three disorders, including avoidant/restrictive food intake disorder (ARFID). The purpose of this study was to evaluate the psychometric properties of a questionnaire focused specifically on ARFID (PARDI-AR-Q), which has the potential to provide related information with less participant burden.

Methods

Adolescents and adults (n = 71, ages 14–40 years) with ARFID (n = 42) and healthy control participants (HC, n = 29) completed the PARDI-AR-Q and other measures. A subset of the ARFID group (n = 27) also completed the PARDI interview.

Results

An exploratory factor analysis of proposed subscale items identified three factors corresponding to the ARFID phenotypes of avoidance based on the sensory characteristics of food, lack of interest in eating or food, and concern about aversive consequences of eating. Further analyses supported the internal consistency and convergent validity of the PARDI-AR-Q subscales, and subscale ratings on the questionnaire showed large and significant correlations (all p-values < 0.001; r’s ranging from 0.48 to 0.77) with the corresponding subscales on the interview. The ARFID group scored significantly higher than HC on all subscales. Furthermore, 90% of the ARFID group scored positive on the PARDI-AR-Q diagnostic algorithm while 93% of the HC scored negative.

Conclusions

Though replication in larger and more diverse samples is needed, findings provide early support for the validity of the PARDI-AR-Q as a self-report measure for possible ARFID in clinical or research settings.

Plain English summary

Few measures are available for detecting avoidant/restrictive food intake disorder (ARFID) in clinics or research settings. This makes it difficult for individuals with the disorder to be identified and offered appropriate care. We developed the Pica, ARFID, and Rumination Disorder Interview ARFID Questionnaire (PARDI-AR-Q), a brief self-report measure of possible ARFID, and evaluated how well it worked in the current study. In our preliminary study of 71 adolescents and adults, most individuals with ARFID (90%) scored positive on this measure, whereas most healthy control participants (93%) scored negative. Our findings provide early support for the PARDI-AR-Q as a promising new measure for detecting possible ARFID when a full clinical interview is not possible.

Introduction

Although avoidant/restrictive food intake disorder (ARFID) was added to the psychiatric nomenclature nearly 10 years ago, there are still few available measures designed to identify potential cases and assess their clinical features [1]. Widely used self-report questionnaires for eating disorders—such as the Eating Disorder Examination-Questionnaire [2], Eating Attitudes Test [3], Eating Disorders Inventory [4] and Eating Pathology Symptoms Inventory [5]—focus primarily on purposeful dietary restriction in the context of shape/weight concerns, which is an exclusion criterion for ARFID. Available structured clinical interviews that include ARFID criteria either have not been validated for ARFID specifically (e.g., Eating Disorder Assessment for DSM-5 [6]; Structured Clinical Interview for DSM-5 [7]) or are lengthy and may not be practical for routine use in clinical settings (e.g., Pica, ARFID, and Rumination Disorder Interview [8]; Eating Disorder Examination ARFID module [9]). Available self-report measures of ARFID symptoms include the Nine-Item ARFID Screen (NIAS) [10], which provides data on the three ARFID phenotypes that may motivate food avoidance and restriction in ARFID (including subscales labeled “picky eating,” “fear,” and “low appetite”). However, screening positive or negative for ARIFD on the NIAS has not been validated against diagnosis via clinical interview, and cut-points for a possible ARFID diagnosis have only recently been proposed [11]. Thus, a brief questionnaire that elucidates possible ARFID in both clinical and research settings, and summarizes clinical features that may be relevant to treatment planning (e.g., selecting modules to apply according to ARFID phenotype [12, 13]) is urgently needed.

To that end, the purpose of the current study was to provide a preliminary evaluation of the construct validity and reliability of the Pica, ARFID and Rumination Disorder Interview ARFID Questionnaire (PARDI-AR-Q). Just as the EDE-Q [2] is a brief questionnaire assessing similar constructs to those evaluated in greater depth on the EDE interview [14], the PARDI-AR-Q is a brief questionnaire assessing similar constructs to those evaluated in the PARDI. The PARDI-AR-Q focuses on the psychopathology of ARFID specifically and does not include items keyed to pica or rumination disorder. By inviting adolescents and adults with ARFID, as well as healthy control participants (HC), to complete the PARDI-AR-Q, we tested the following hypotheses. First, using an exploratory factor analysis of this new measure in the ARFID group only, we anticipated that we would identify three factors consistent with the three ARFID phenotypes described in DSM-5 (avoidance based on sensory characteristics of food, lack of interest, concern about aversive consequences [15]), each of which would exhibit a high degree of internal consistency. Second, across the whole sample, we predicted that three factors, as well as a severity of impact scale measuring the clinical impairment associated with ARFID symptoms, would correlate strongly and significantly with related constructs (supporting convergent validity) but not with unrelated constructs (supporting divergent validity). We further explored, in a subset of ARFID participants who also completed the PARDI interview, whether the PARDI-AR-Q would show a high degree of concurrent validity with subscales measuring similar constructs on the interview. Third, we predicted that, compared to HC, individuals with ARFID would score significantly higher on all subscales (avoidance based on sensory characteristics of food, lack of interest, concern about aversive consequences, and severity of impact), and that the majority of the ARFID group would score positive on the PARDI-AR-Q diagnostic algorithm while the majority of HC would score negative.

Method

Participants

Table 1 provides demographic characteristics of the sample. We recruited participants with ARFID (n = 42, ages 14–40 years) from two NIMH-funded studies (R01MH108595, investigating the neurobiology of ARFID; and R01MH103402, examining low-weight eating disorders), as well as consecutive referrals to the Eating Disorders Clinical and Research Program at the Massachusetts General Hospital. Neurobiology study participants were diagnosed with ARFID via the PARDI [8], and clinic patients were diagnosed with ARFID via routine clinical interview by their treating psychologist or psychiatrist according to DSM-5 criteria [16]. Because the purpose of the current study was to evaluate the performance of the PARDI-AR-Q in identifying full-threshold cases of ARFID, only individuals diagnosed with full-threshold ARFID via clinical interview were included; we excluded subthreshold cases. Furthermore, given that the PARDI-AR-Q is meant for ages 14 and up, we excluded participants below the age of 14 from both recruitment sources. We excluded individuals over the age of 40 as there were none in the neurobiology study and very few in the clinic sample.

Table 1 Demographic characteristics of the avoidant/restrictive food intake disorder (ARFID) group and healthy control participants (HC)

We recruited HC (n = 29, ages 14–40 years, to match the age range of the ARFID group) who had either served as healthy controls from the neurobiology study (n = 1), learned about the study from Rally (a Mass General Brigham-wide recruitment platform; n = 4), or participated via Amazon Mechanical Turk (MTurk, an online recruitment platform for survey research; n = 24). Healthy controls from the neurobiology study did not meet criteria for any current psychiatric disorder on the Kiddie Schedule for Affective Disorders and Schizophrenia (KSADS) [17]. Adults and children from MTurk and Rally were classified as HC through a self-report battery; they had to score below clinical cut points including < 2.3 on the Eating Disorder Examination-Questionnaire [2], < 44 on the State–Trait Anxiety Inventory trait scale [18], < 16 on the Center for Epidemiological Studies Depression Scale [19], and < 10, 9, and 10, respectively, on the Picky Eating, Appetite, and Fear subscales of the Nine-Item ARFID Scale [10, 11]. To ensure data quality for individuals recruited through MTurk, we set our survey such that individuals could not participate twice. Additionally, and in line with recommendations for analyzing MTurk data [20], we ensured there were no duplicate entries by collecting MTurk worker IDs. Participant compensation varied by recruitment source. Clinic participants received no compensation as they completed the necessary measures as part of routine care. Participants drawn from one of our team’s neurobiology of ARFID study received up to $550 (because the broader study included several multi-hour visits over a period of two years, including not just questionnaires but also fMRI scans, test meals, and blood draws). MTurk participants received $1 for completing a pre-screener and $15 for completing a battery of questionnaires.

Measures

Demographics

All participants reported their age, sex, race, and ethnicity on a standard self-report form or via clinical interview.

Pica, ARFID and rumination disorder interview ARFID questionnaire (PARDI-AR-Q)

All participants completed the PARDI-AR-Q, which asks individuals to report on their own symptoms. (A parent version in which parents report on their child’s symptoms is also under study but was not investigated in the current study). The full 32-item questionnaire and scoring algorithm appear in Additional file 2 as well as online at mccaed.slam.nhs.uk and are freely available for use.

The PARDI-AR-Q begins with five general demographic and anthropomorphic questions. The anthropomorphic items are included so that the assessor can calculate body mass index for adults or body mass index percentile for youth (when combined with demographic data), if desired. Next, 12 dichotomous (yes/no) items assess the presence of DSM-5 diagnostic criteria for ARFID, including the presence of an eating problem (two items), low weight or faltering growth (five items), nutrition deficiency (one item), supplement dependence (three items), and psychosocial impairment (one item). Given that several diagnostic criteria for ARFID are polythetic, the PARDI-AR-Q includes multiple items per criterion for comprehensiveness. For example, criterion A1 can be met by endorsing items 8, 9, 11, 12, and/or 13. Of note, four of the dichotomous diagnostic items include free-text follow-up questions (e.g., amount of weight lost, type of supplements used) to provide additional context for the assessor to confirm why and how specific diagnostic criteria are being fulfilled. Based on the pattern of response on these yes/no items, respondents can score positive or negative for possible ARFID based on the PARDI-AR-Q diagnostic algorithm (see Additional file 3 for scoring). “Yes” ratings should be followed up with a clinical interview to confirm diagnosis. Finally, the PARDI-AR-Q presents 11 Likert-scale items (scored 0 to 6, with higher scores indicating greater severity) designed to assess the presence and severity of each ARFID profile (i.e., avoidance based on sensory characteristics of food, lack of interest, concern about aversive consequences) as well as severity of impact.

Pica, ARFID and rumination disorder interview (PARDI)

A subset of participants with ARFID only (n = 27, 93%) also completed the PARDI [8], a structured interview designed to confirm the presence of an ARFID diagnosis as well as to provide a detailed assessment of the severity of each ARFID profile (i.e., avoidance based on sensory characteristics of food, lack of interest, or concern about aversive consequences) and the severity of overall impact. Like the PARDI-AR-Q, some questions on the PARDI were yes/no questions with follow-up questions asking the interviewee to elaborate on their response, while others were rated on a Likert scale of 0 to 6, where 6 represented the highest level of symptom severity for that question.

We scored the PARDI according to updated guidelines from a recent psychometric paper [21]. In the current study, we used the PARDI to (1) confer ARFID diagnoses among participants from the neurobiology study; and (2) evaluate concurrent validity of the three PARDI-AR-Q subscales and the severity score by assessing their degree of correlation with comparable subscales on the PARDI interview. Inter-rater reliability of the ARFID diagnosis in randomly selected subsets of the neurobiology sample have been reported previously (100% agreement; kappa = 1.0 [22, 23]). Cronbach alphas for each of the three subscales in the current sample were 0.81 (avoidance based on the sensory characteristics of food), 0.88 (lack of interest in food or eating), 0.88 (concern about aversive consequences).

Nine-item ARFID screen (NIAS)

A subset of participants (15 [36% of] ARFID and 26 [90% of] HC) completed the NIAS [10], a 9-item self-report questionnaire designed to measure each of the three ARFID phenotypes described in DSM-5 including “picky eating” (3 items), “low appetite” (3 items), and "fear" (3 items). All items in the NIAS are rated on a 5-point Likert scale from 0 (“Strongly disagree”) to 5 (“Strongly agree”). The NIAS was originally validated for use in adults ages 18 and up but has also been used in adolescents [11]. In the current study we used the NIAS to evaluate the convergent validity of PARDI-AR-Q subscales. Cronbach alphas in our sample were: for the whole sample: 0.89 for picky eating, 0.91 for low appetite, and 0.92 for fear; for the ARFID sample: 0.31 for picky eating, 0.83 for low appetite, and.88 for fear; and for HC: 0.65 for picky eating, 0.71 for low appetite, and 0.82 for fear.

Food neophobia scale (FNS)

A subset of participants (28 [66% of] ARFID and 26 [90% of] HC) completed the FNS [24], a self-report measure of reluctance to try novel foods. All items in the FNS are rated on a 7-point Likert scale from “Disagree extremely” to “Agree extremely”, where “Agree extremely” represented the greatest severity in some items and the least severity in other, reverse-scored items. The FNS was originally validated for use in adults ages 18 and up but has also been used in adolescents [22]. In the current study, we used the FNS to evaluate convergent validity with the PARDI-AR-Q avoidance based on sensory characteristics subscale. Cronbach alphas in our sample were: 0.97 for the whole sample, 0.84 for the ARFID sample, and 0.94 for HC.

Clinical impairment assessment (CIA)

All participants with ARFID and 26 (90% of) HC completed the CIA [25], a self-report measure of the functional impairment associated with eating disorders. All CIA items are rated on a 4-point Likert scale from “Not at all” to “A lot”, where “A lot” represented the greatest severity. Although the CIA has not yet been validated for use with ARFID specifically, we evaluated the degree to which it was correlated with the PARDI-AR-Q severity of impact score, as a proxy measure of convergent validity. Cronbach alphas in our sample were: 0.96 for the whole sample, 0.95 for the ARFID sample, and 0.84 for HC.

Eating disorder examination-questionnaire (EDE-Q)

All participants in both the ARFID and HC groups completed the EDE-Q [2], which measures the specific psychopathology of eating disorders—particularly anorexia nervosa, bulimia nervosa, and binge-eating disorder—including frequency of key symptoms as well as dietary restraint, eating concern, weight concern, and shape concerns. All items in the EDE-Q are rated on a 7-point Likert scale from 0 (“No days” or “Not at all”) to 6 (“Every day” or “Markedly”), where 6 represented the greatest severity. In the current study, we used a cut-off score of 2.3 on the EDE-Q [26] to rule out other eating disorders (apart from ARFID) in both the ARFID and HC groups. Cronbach alphas in our sample were: 0.85 for the whole sample, 0.93 for the ARFID sample, and 0.71 for HC.

Data analysis

We conducted all analyses in R [27]. First, to test our hypothesis that we would identify three PARDI-AR-Q factors reflecting avoidance based on sensory characteristics of food, lack of interest, and concern about aversive consequences, we conducted an exploratory factor analysis (EFA) of the continuously scored items that were intended to be comparable to the three subscales in the PARDI (i.e., items 24–32). Our rationale for subjecting just the nine ARFID presentation items to the primary EFA was two-fold. First, severity of impact varies across ARFID presentations. Thus, we expected the severity of impact items to correlate with all other items on the PARDI-AR-Q. Second, our team’s recently published factor analysis of the PARDI interview (Cooper-Vince et al., 2022) also analyzed only ARFID presentation items together in a single EFA; thus we took a similar analytic approach here to enhance the comparability of psychometric properties for the interview and self-report measures. (However, Additional file 1: Table S1 provides the results of an EFA that includes the severity of impact items as well.) Given that ARFID presentations often overlap clinically [28, 29], we used a promax rotation that allowed factors to inter-correlate. Given our expectation that the HC would show very low variance on these items, we included only the ARFID group in this analysis. We had no missing PARDI-AR-Q data at the participant or item level. Although the sample size for EFA was modest, the Kaiser–Meyer–Olkin measure of sampling adequacy was > 0.80 (i.e., 0.82 in our sample), and the Bartlett’s test of sphericity was significant (X2 [36] = 250.33, p < 0.001), suggesting that EFA was appropriate. To evaluate the internal consistency of each subscale, we calculated Cronbach alphas for each of the ARFID-only group, the HC-only group, and the full sample.

Second, to evaluate convergent validity, we evaluated the strength of correlations between PARDI-AR-Q subscales and related constructs, including the corresponding NIAS subscales, the FNS, and the CIA. To evaluate divergent validity, we evaluated the strength of correlation with EDE-Q, which should not be conceptually related to PARDI-AR-Q scores as weight and shape concerns are not central to the ARFID diagnosis. To evaluate concurrent validity, in the subset of individuals with ARFID for whom PARDI interview data were also available, we evaluated the strength of intraclass correlation coefficients between subscale scores on the PARDI-AR-Q and their analogous scores on the PARDI interview.

Third, to test our hypothesis that individuals with ARFID would score significantly higher than HC on all PARDI-AR-Q subscales, we conducted a Mann–Whitney-Wilcoxon test (given the non-normal distribution of subscale scores). We also calculated Wilcoxon r values to determine effect size [30]. Wilcoxon r effect sizes range from 0 to 1, with r < 0.3 indicating a small effect, 0.3–0.5 indicating a moderate effect, and > 0.5 indicating a large effect.

Lastly, we evaluated the percentage of participants with ARFID as well as HC who scored positive versus negative on the PARDI-AR-Q diagnostic algorithm. We then qualitatively reviewed responses of ARFID participants who scored negatively as well as HC who scored positively to evaluate the reasons for any discrepancies.

Results

Exploratory factor analysis (EFA)

The EFA identified either a three-factor solution (explaining 75% of the variance) or four-factor solution (explaining 76% of the variance) as optimal. Additional file 1: Fig. S1 depicts the scree plot. Because the three-factor solution was more interpretable and the difference in variance explained between the three- and four-factor solution was minimal, we moved forward with interpretation of the three-factor solution. Additionally, Horn’s parallel analysis provided empirical support for the retention of three factors. Table 2 displays loadings for each item on each of the three factors. Factor 1 explained 38% of the variance (eigenvalue = 22.02) and included all items assessing concern about aversive consequences (items 30–32). Factor 2 explained 34% of the variance (eigenvalue = 7.93) and included all items assessing sensory-based avoidance (items 24–26). Factor 3 explained 28% of the variance (eigenvalue = 4.64) and included all items assessing lack of interest in eating or food (items 27–29). (Of note, as depicted in Additional file 1: Table S1, adding the PARDI-AR-Q severity of impact items resulted in a 4-factor solution including concern about aversive consequences; sensory-based avoidance; lack of interest in eating or food; and severity of impact).

Table 2 Loadings of individual items in an exploratory analysis of the Pica, ARFID, and Rumination Disorder ARFID Questionnaire (PARDI-AR-Q) among individuals with ARFID

Cronbach alphas for all subscales were good to excellent for the ARFID group (but lower for the HC group due to low variance in HC responses) for sensory-based avoidance (0.94 whole sample; 0.89 ARFID only; 0.40 HC only), concern about aversive consequences (0.92 whole sample; 0.93 ARFID only; 0.40 HC only), and lack of interest in eating or food (0.84 whole sample; 0.83 ARFID only; 0.30 HC only).

Convergent, divergent, and concurrent validity

Table 3 depicts a Spearman correlation matrix with each of the three PARDI-AR-Q subscales and measures of convergent (i.e., NIAS subscales, FNS) and divergent (EDE-Q) validity in the whole sample. As hypothesized, supporting convergent validity, PARDI-AR-Q sensory-based avoidance was highly correlated with NIAS picky eating and with the FNS; PARDI-AR-Q concern about aversive consequences was highly correlated with NIAS fear; and PARDI-AR-Q lack of interest in food or eating was highly correlated with NIAS low appetite. Also as anticipated, all PARDI-AR-Q subscales were correlated with one another, and with all NIAS subscales. Lastly, PARDI-AR-Q severity of impact was highly correlated with CIA scores.

Table 3 Spearman correlation matrix of scores on the Pica, ARFID, and rumination disorder interview ARFID questionnaire (PARDI-AR-Q) and related measures for the whole sample

Furthermore, as hypothesized, none of the PARDI-AR-Q subscales were significantly correlated with EDE-Q global score (which is intended to measure a different construct, i.e., purposeful dietary restraint and shape/weight concerns). In the subset of ARFID participants who also completed the PARDI interview (n = 27), intraclass correlations were large and significant across subscales, supporting concurrent validity (avoidance based on sensory characteristics of food: r = 0.73, p < 0.001; concern about aversive consequences: r = 0.54, p < 0.001; lack of interest: r = 0.73, p < 0.001; and severity of impact: r = 0.48, p < 0.001).

Comparisons between ARFID and HC

Table 4 displays PARDI-AR-Q subscale scores in the ARFID group versus HC. As hypothesized, the ARFID group scored significantly higher than HC on all subscales. All but one effect size was large. Concern about aversive consequences had a medium effect size. Given that the two groups differed significantly by sex and age (Table 1), we followed this up with an ANCOVA controlling for sex and age (Additional file 1: Table S2), and results remained unchanged.

Table 4 Scores (M, SD) on the Pica, ARFID, and Rumination Disorder Interview Questionnaire (PARDI-AR-Q) and relevant measures for individuals with avoidant/restrictive food intake disorder (ARFID) versus the healthy control participants (HC)

Positive and negative scores on the PARDI-AR-Q diagnostic algorithm in ARFID vs. HC

Of the 42 participants in the ARFID group, 90% (n = 38) scored positive on the PARDI-AR-Q diagnostic algorithm. However, the remaining 10% (n = 4) scored negative on the diagnostic algorithm, despite receiving an ARFID diagnosis via PARDI or clinical interview. Of the four who scored negative, one was an adolescent male who met criteria via interview based on having an underweight BMI percentile and psychosocial impairment (diagnostic criteria A1 and A4, respectively). This participant was also undergoing psychological treatment for ARFID at the time. However, this participant did not endorse any items on the PARDI-AR-Q. The other three false negative cases met criteria for ARFID during the interview based on psychosocial impairment only (diagnostic criterion A4). However, all three scored negative on the PARDI-AR-Q because they did not endorse item 21 (psychosocial impairment), though two of the three did endorse items 6 (thinking they had a problem with eating) and 7 (other people saying they had a problem with eating).

In contrast, of the 29 of participants in the HC group, only 7% (n = 2) scored positive on the PARDI-AR-Q diagnostic algorithm, while 93% (n = 27) scored negative. Both HC participants who scored positive on the diagnostic algorithm endorsed item 6 (thinking they had a problem with eating) and 9 (weight loss due to avoidance or restriction). Both participants were adults with BMIs in the overweight range, based on the heights and weights they provided on the PARDI-AR-Q.

Discussion

Though replication in larger and more diverse samples is needed, findings provide early support for the validity and reliability of the PARDI-AR-Q as a self-report measure of possible ARFID in clinical or research settings. Specifically, our exploratory factor analysis provided preliminary support for a three-factor structure consistent with DSM-5 ARFID phenotypes. Furthermore, medium to large correlations between PARDI-AR-Q subscales and related constructs (e.g., NIAS, FNS, CIA) provided preliminary support for convergent validity, and high intraclass correlations between PARDI-AR-Q subscales and their corresponding subscales on the PARDI-AR-Q provided preliminary evidence of concurrent validity. In contrast, low and non-significant correlations between PARDI-AR-Q subscales and EDE-Q global scores provided preliminary support for divergent validity. Finally, as expected, the majority of participants with ARFID scored positive on the PARDI-AR-Q whereas the majority of the HC scored negative.

PARDI-AR-Q subscale scores correlated highly with one another, but still loaded onto distinct factors. This was also true of NIAS subscale scores in the current study, as well as in prior studies [10]. Taken together, these findings are consistent with existing reports of overlap among ARFID phenotypes [28] and lend support to a three-dimensional model of ARFID in which there are three distinct phenotypes and individuals may present with one, two, or all three [29].

Our qualitative analysis of discordant cases highlights the challenges inherent to the self-report assessment of ARFID diagnostic criteria. In the case of the four participants diagnosed with ARFID who scored negative on the PARDI-AR-Q diagnostic algorithm, one participant was underweight and concurrently undergoing ARFID treatment. This patient may have exhibited a minimizing response style on the questionnaire, which is also common in other eating disorders, such as anorexia nervosa [31]. In the other three cases, individuals denied psychosocial impairment as specifically queried on the PARDI but were ascertained by their PARDI interviewer or treating clinician to have eating-related impairment present. Given that currently available measures of functional impairment due to disordered eating have not been validated for ARFID specifically, a better understanding of the impairing features unique to ARFID (versus other eating disorders) is urgently needed, to ensure that questionnaires such as the PARDI-AR-Q can fully capture this impairment. In the case of the two HC participants with positive PARDI-AR-Q scores, both endorsed restrictive eating in the context of overweight. It is unclear whether they would have met criterion A1 upon clinical interview.

Our findings should be interpreted in light of limitations. Our sample size was modest, and our sample was from a single country (United States) and identified primarily as non-Hispanic white, thus limiting generalizability. This limitation is particularly important in the context of assessment, which may play a gate-keeping function for treatment access. Future research on the PARDI-AR-Q and other eating-disorder assessments should recruit more racially, ethnically, and geographically diverse samples [32]. Similarly, we did not include participants under the age of 14 in the current study, so our findings cannot be generalized to children. (Our team is currently working on a parent-report version of the PARDI-AR-Q for this younger age range.) In addition, the HC group did not complete the PARDI or routine clinical interview, but rather were characterized as HC by their non-clinical scores on a battery of self-report questionnaires; and not all ARFID participants completed the PARDI interview as some were evaluated in a routine clinical setting. To that end, we could not calculate sensitivity and specificity in the current study. Moreover, there are challenges to collecting psychological data through MTurk (e.g., difficulty confirming that participants have represented demographic characteristics truthfully and were paying attention to all survey questions), which may have impacted the HC group for this study. Lastly, because the Cronbach alpha value for HC on all PARDI-AR-Q subscales and the Cronbach alpha value for ARFID on the NIAS picky eating scale were fairly low, more research is needed on how measures of ARFID psychopathology may differentially perform in ARFID vs. HC populations, and how that may impact comparisons between these groups. Of note, our HC group included only those individuals who scored below established clinical cut-offs on measures of depression, anxiety, and disordered eating; or showed no evidence of psychiatric disorder on the KSADS. Indeed, as shown in Table 4, our HC group scored near the minimum on nearly every measure of psychopathology, including the NIAS, EDE-Q, and CIA. These findings suggest that that the low PARDI-AR-Q scores in our HC group may be reflective of their especially their low levels of psychopathology, rather than the PARDI-AR-Q’s inability to adequately capture ARFID symptoms in a non-clinical group. However, future research is needed to clarify normative PARDI-AR-Q scores in community samples that include the full range of psychopathology.

The study also had strengths. Specifically, our entire ARFID sample included participants whose diagnosis had been confirmed via PARDI or structured clinical interview. This is particularly important as past studies of self-report measures of ARFID have largely relied on analogue or college samples with picky eating [10]. Further efforts to validate and improve upon the PARDI-AR-Q should include larger and more diverse samples, all of whom are followed up by clinical interview to confirm diagnosis.

Conclusion

In summary, the PARDI-AR-Q showed preliminary evidence of reliability and validity in the current study. The PARDI-AR-Q has advantages over existing self-report and interview measures of ARFID symptoms. For example, while the PARDI-AR-Q and NIAS both measure ARFID psychopathology via self-report, only the PARDI-AR-Q has a severity of impact scale and diagnostic algorithm for screening purposes. Indeed, in the current study, the PARDI-AR-Q correctly identified 90% of ARFID cases, regardless of specific ARFID profile, based on DSM-5 criteria. Compared to clinical interviews (e.g., PARDI, EDA-5, SCID-5), the PARDI-AR-Q is quick to administer and does not require a trained interviewer or clinician for scoring. Our findings suggest that the PARDI-AR-Q can be used to elucidate clinical characteristics (e.g., profiles) when a clinical interview is not practical or desirable. Future research should use the PARDI as part of a two-stage screening process with which to evaluate the diagnostic properties of the PARDI-AR-Q against a gold standard interview.

Prior presentation

Portions of these findings were presented at the 2020 Eating Disorders Research Society meeting and 2022 International Conference on Eating Disorders (both held virtually due to COVID-19).

Availability of data and materials

The data that support the findings of this study are available from the corresponding author upon reasonable request.

References

  1. Dinkler L, Bryant-Waugh R. Assessment of avoidant restrictive food intake disorder, pica and rumination disorder: interview and questionnaire measures. Curr Opin Psychiatry. 2021;34(6):532–42.

    Article  PubMed  Google Scholar 

  2. Fairburn CG, Beglin SJ. Eating disorder examination questionnaire. Cogn Behav Therapy Eat Disord. 2008;309:313.

    Google Scholar 

  3. Garner DM, Olmsted MP, Bohr Y, Garfinkel PE. The eating attitudes test: psychometric features and clinical correlates. Psychol Med. 1982;12(4):871–8.

    Article  PubMed  Google Scholar 

  4. Garner DM. Eating disorder inventory-3 (EDI-3). Professional manual. Odessa, FL: Psychological Assessment Resources. 2004 May 1.

  5. Forbush KT, Wildes JE, Pollack LO, Dunbar D, Luo J, Patterson K, Petruzzi L, Pollpeter M, Miller H, Stone A, Bright A. Development and validation of the eating pathology symptoms inventory (EPSI). Psychol Assess. 2013;25(3):859.

    Article  PubMed  Google Scholar 

  6. Sysko R, Glasofer DR, Hildebrandt T, Klimek P, Mitchell JE, Berg KC, Peterson CB, Wonderlich SA, Walsh BT. The eating disorder assessment for DSM-5 (EDA-5): development and validation of a structured interview for feeding and eating disorders. Int J Eat Disord. 2015;48(5):452–63.

    Article  PubMed  PubMed Central  Google Scholar 

  7. First MB, Williams JB, Karg RS, Spitzer RL. User’s guide for the SCID-5-CV structured clinical interview for DSM-5® disorders: clinical version. Washington: American Psychiatric Publishing, Inc; 2016.

    Google Scholar 

  8. Bryant-Waugh R, Micali N, Cooke L, Lawson EA, Eddy KT, Thomas JJ. Development of the Pica, ARFID, and rumination disorder interview, a multi-informant, semi-structured interview of feeding disorders across the lifespan: a pilot study for ages 10–22. Int J Eat Disord. 2019;52(4):378–87.

    Article  PubMed  Google Scholar 

  9. Schmidt R, Kirsten T, Hiemisch A, Kiess W, Hilbert A. Interview-based assessment of avoidant/restrictive food intake disorder (ARFID): a pilot study evaluating an ARFID module for the eating disorder examination. Int J Eat Disord. 2019;52(4):388–97.

    Article  PubMed  Google Scholar 

  10. Zickgraf HF, Ellis JM. Initial validation of the nine item avoidant/restrictive food intake disorder screen (NIAS): a measure of three restrictive eating patterns. Appetite. 2018;123:32–42.

    Article  PubMed  Google Scholar 

  11. Burton Murray H, Dreier MJ, Zickgraf HF, Becker KR, Breithaupt L, Eddy KT, Thomas JJ. Validation of the nine item ARFID screen (NIAS) subscales for distinguishing ARFID presentations and screening for ARFID. Int J Eat Disord. 2021;54(10):1782–92.

    Article  PubMed  Google Scholar 

  12. Thomas JJ, Eddy KT. Cognitive-behavioral therapy for avoidant/restrictive food intake disorder: children, adolescents, and adults. Cambridge: Cambridge University Press; 2019.

    Google Scholar 

  13. Bryant-Waugh R, Loomes R, Munuve A, Rhind C. Towards an evidence-based out-patient care pathway for children and young people with avoidant restrictive food intake disorder. J Behav Cogn Therapy. 2021;31(1):15–26.

    Article  Google Scholar 

  14. Fairburn CG, Cooper Z, O’Connor ME. Eating disorder examination. Cogn Behav Therapy Eat Disord. 2008;265:308.

    Google Scholar 

  15. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington: American Psychiatric Association; 2013.

    Book  Google Scholar 

  16. Becker KR, Keshishian AC, Liebman RE, Coniglio KA, Wang SB, Franko DL, Eddy KT, Thomas JJ. Impact of expanded diagnostic criteria for avoidant/restrictive food intake disorder on clinical comparisons with anorexia nervosa. Int J Eat Disord. 2019;52(3):230–8.

    Article  PubMed  Google Scholar 

  17. Kaufman J, Birmaher B, Axelson D, Perepletchikova F, Brent D, Ryan N. Kiddie schedule for affective disorders and schizophrenia (KSADS-PL). 2013. Working draft/unpublished interview.

  18. Spielberger C, Gorsuch R, Lushene R, Vagg P, Jacobs G. Manual for the state-trait anxiety inventory. Palo Alto: Consulting Psychologists Press; 1983.

    Google Scholar 

  19. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.

    Article  Google Scholar 

  20. Kambanis PE, Bottera AR, De Young KP. Eating disorder prevalence among Amazon MTurk workers assessed using a rigorous online, self-report anthropometric assessment. Eat Behav. 2021;41:101481.

    Article  PubMed  Google Scholar 

  21. Cooper-Vince C, Bryant-Waugh R, Eddy KT, Lawson EA, Thomas JJ, Micali N. Further evidence for the validity and psychometric properties of the Pica, ARFID, and rumination disorder interview. Under revision.

  22. Thomas JJ, Becker KR, Kuhnle MC, Jo JH, Harshman SG, Wons OB, Keshishian AC, Hauser K, Breithaupt L, Liebman RE, Misra M. Cognitive-behavioral therapy for avoidant/restrictive food intake disorder: feasibility, acceptability, and proof-of-concept for children and adolescents. Int J Eat Disord. 2020;53(10):1636–46.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Thomas JJ, Becker KR, Breithaupt L, Murray HB, Jo JH, Kuhnle MC, Dreier MJ, Harshman S, Kahn DL, Hauser K, Slattery M. Cognitive-behavioral therapy for adults with avoidant/restrictive food intake disorder. J Behav Cogn Therapy. 2021;31(1):47–55.

    Article  Google Scholar 

  24. Pliner P, Hobden K. Development of a scale to measure the trait of food neophobia in humans. Appetite. 1992;19(2):105–20.

    Article  PubMed  Google Scholar 

  25. Bohn K, Fairburn CG. The clinical impairment assessment questionnaire (CIA). Cogn Behav Therapy Eat Disord. 2008;315–7.

  26. Mond JM, Hay PJ, Rodgers B, Owen C, Beumont PJ. Validity of the eating disorder examination questionnaire (EDE-Q) in screening for eating disorders in community samples. Behav Res Ther. 2004;42(5):551–67.

    Article  PubMed  Google Scholar 

  27. R Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing. Vienna Austria: R Foundation for Statistical Computing. 2018. Available from https://www.r-project.org/.

  28. Reilly EE, Brown TA, Gray EK, Kaye WH, Menzel JE. Exploring the cooccurrence of behavioural phenotypes for avoidant/restrictive food intake disorder in a partial hospitalization sample. Eur Eat Disord Rev. 2019;27(4):429–35.

    Article  PubMed  Google Scholar 

  29. Thomas JJ, Lawson EA, Micali N, Misra M, Deckersbach T, Eddy KT. Avoidant/restrictive food intake disorder: a three-dimensional model of neurobiology with implications for etiology and treatment. Curr Psychiatry Rep. 2017;19(8):1–9.

    Article  Google Scholar 

  30. Kassambara A. Wilcoxon test in R: The ultimate guide. 2018. Available from http://www.privatehomepage.com.

  31. Courturier J, Lock J. Denial and minimization in adolescents with anorexia nervosa. Int J Eat Disord. 2006;39:212–6.

    Article  Google Scholar 

  32. Goel NJ, Jennings Mathis K, Egbert AH, Petterway F, Breithaupt L, Eddy KT, Franko DL, Graham AK. Accountability in promoting representation of historically marginalized racial and ethnic populations in the eating disorders field: a call to action. Int J Eat Disord. 2022;55(4):463–9.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Research reported in this publication was supported by the Hilda and Preston Davis Foundation (JJT, KTE), the National Science Foundation (SBW, DGE-1745303), and the National Institutes of Health: National Institute of Mental Health R01MH108595 (JJT, EAL, NM), K24MH120568 (EAL), R01MH103402 (MM, KTE, EAL), R03MH103402 (LB), KL2TR002542 (LB), F31MH125495 (SBW), K23MH125143 (KRB); and the National Institute of Diabetes and Digestive and Kidney Diseases K23DK131334 (HBM). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or the National Science Foundation.

Author information

Authors and Affiliations

Authors

Contributions

RBW, JJT, KTE, NM, and LC developed the measure. JJT, EAL, NM, KTE, and MM secured funding for data collection. MJD, MCK, CMS, HBM, KRB, LB, JJT, and KTE collected the data. CMS, MJD, SBW, JJT, and NM analyzed and interpreted the data. JJT, CMS, and MJD drafted the manuscript. All authors read, edited, and approved the final manuscript.

Corresponding author

Correspondence to Jennifer J. Thomas.

Ethics declarations

Ethical approval and consent to participate

The study was conducted according to the Declaration of Helsinki and study protocol was approved by the Institutional Review Board (Protocols 2015P001826 and 2013P002614). Written informed consent was obtained from all participants.

Consent for publication

The authors consent for this manuscript to be published. There are no other parties involved in the decision to publish.

Competing interests

Drs. Becker, Eddy, and Thomas receive royalties from Cambridge University Press for the sale of their books on ARFID. Dr. Thomas has received an honorarium for her work as Associate Editor for the International Journal of Eating Disorders. Dr. Rachel Bryant-Waugh receives royalties from Taylor and Francis for the sale of her books on ARFID. Dr. Breithaupt is a consultant for Otsuka Pharmaceuticals. Dr. Misra has consulted for Abbvie and Sanofi and served on the scientific advisory board for Abbive and Ipsen. Dr. Micali received an honorarium for her work as Associate Editor for the European Eating Disorders Review.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplemental tables and supplemental figure.

Additional file 2

. PARDI-AR-Q Self 14+.

Additional file 3.

PARDI-AR-Q instructions for administrators.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bryant-Waugh, R., Stern, C.M., Dreier, M.J. et al. Preliminary validation of the pica, ARFID and rumination disorder interview ARFID questionnaire (PARDI-AR-Q). J Eat Disord 10, 179 (2022). https://doi.org/10.1186/s40337-022-00706-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40337-022-00706-7