|
Papers
[Full list]
|
You can find PDF copies of my papers here
This list is not fully updated. Someday, perhaps, I will have time enough for this... or not. You can check more updated lists of my publications in these sources:
Google Scholar
Web of Science
Scopus
ORCID
|
[In press]
|
Barrada, J. R., Cativiela, B., van Strien, T., & Cebolla, A. (2020).
Intuitive eating: A novel eating style? Evidence from a Spanish sample. European Journal of Psychological Assessment.
[Abstract]
[PDF]
[Spanish version - IES-2]
Intuitive eating is defined as an adaptive way of eating that maintains a strong connection with the internal physiological signs of hunger and satiety. It has four elements: unconditional permission to eat whenever and whatever food is desired, eating for physical rather than for emotional reasons, reliance on hunger and satiety cues to determine when and how much to eat, and body-food choice congruence. In this study, we assessed the differences and similarities between intuitive eating, as measured with the Intuitive Eating Scale-2, and eating styles (restrained, emotional, and external eating), assessed with the Dutch Eating Behavior Questionnaire. Using a Spanish sample of mainly university students (n = 1,095) we found that (a) unconditional permission to eat presented a large negative correlation with restrained eating, r = –.82; (b) eating for physical reasons had a large negative correlation with emotional eating, r = –.70; (c) the dimensions of intuitive eating only showed very small correlations with positive and negative affect, satisfaction with life, body dissatisfaction or weight control behavior after restrained, emotional, and external eating had been partialled out. Altogether, the present results suggest that two of the dimensions of intuitive eating as assessed with the IES-2 are not very new or innovative. The most promising new dimension of intuitive eating seems to be body-food choice congruence.
Winkens, L. H., van Strien, T., Barrada, J. R., Brouwer, I. A., Penninx, B. W., & Visser, M. (In press).
The Mindful Eating Behavior Scale: Development and psychometric properties in a sample of Dutch adults aged 55 years and older. Journal of the Academy of Nutrition and Dietetics.
[Abstract]
[PDF]
Background
Earlier scales on mindful eating do not measure mindful eating independent from emotional or external eating, or mindful eating in common situations.
Objective
The objective was to develop a new instrument to measure the attention element of mindful eating, the Mindful Eating Behavior Scale (MEBS), and to compute the internal structure, reliabilities, and convergent validity of this scale.
Design
A cross-sectional ancillary study within the Longitudinal Aging Study Amsterdam was conducted between fall 2014 and spring 2015.
Participants/setting
Participants were 1,227 Dutch adults aged 55 years and older from the Longitudinal Aging Study Amsterdam.
Main outcome measure
A selection of 20 items from existing instruments was used to design an initial version of the MEBS.
Statistical analyses performed
The internal structure of the MEBS was evaluated using an exploratory structural equation modeling approach on half of the sample and confirmatory factor analysis on the whole sample to develop the final version of the scale. The measurement invariance of the scores was tested with respect to sex, age, and body mass index. Reliabilities of subscales were determined with Cronbach’s a. To test convergent validity, the scores of the new scale were correlated with theoretically relevant variables.
Results
Two items were deleted because of low item loadings and one item because of high correlated uniqueness. The final confirmatory factor analysis model with 17 items and four domains (Focused Eating, Hunger and Satiety Cues, Eating with Awareness, and Eating without Distraction) showed good fit (comparative fit index=0.97, Tucker-Lewis index=0.96, and root mean square error of approximation=0.04). Measurement invariance was found for sex, age, and body mass index. Cronbach’s a values were medium to high (.70 to .89). Most correlations were in the expected directions, which indicated good preliminary convergent validity.
Conclusions
The MEBS was successfully developed consisting of 17 items and four domains. Because of low interfactor correlations, a total score combining the four domains should not be computed. The MEBS showed good internal consistency and preliminary convergent validity in a sample of Dutch adults aged 55 years and older.
|
[2018]
|
Barrada, J. R., Castro, Á., Correa, A. B., & Ruiz-Gómez, P. (2018).
The tridimensional structure of sociosexuality: Spanish validation of the Revised Sociosexual Orientation Inventory. Journal of Sex & Marital Therapy, 44, 149-158.
[Abstract]
[PDF]
[Spanish version - SOI-R]
Casual sex has become a common experience for many university students. Therefore, it is necessary to have instruments and studies that analyze youth’s orientation toward sociosexuality. The SOI-R assesses sociosexual behavior, attitudes toward sociosexuality, and the desire for relationships without commitment with just nine items. The goal of this study was to validate the Spanish version of the SOI-R, to improve the scale, and to contribute evidence of the utility of the Sociosexual Desire subscale. Participants were 839 heterosexual university students of both sexes, aged between 18 and 26, who completed a battery of online questionnaires. The internal structure of the SOI-R revealed the three proposed theoretical dimensions, with medium to low relationships between factors. The instrument has measurement invariance with regards to sex and age. The Spanish version of the SOI-R had adequate levels of reliability. The modification of the first item of the scale is suggested, as well as the relevance of assessing sociosexual desire as an independent construct. The relation between sociosexuality and other sociodemographic and psychosocial variables was also analyzed. The discussion highlights the need for research to determine youth’s sociosexual orientation and patterns of casual sex.
Barrada, J. R., & Roncero, M. (2018).
Bidimensional structure of the orthorexia: Development and initial validation of a new instrument. Anales de Psicología, 34, 283-291.
[Abstract]
[PDF]
[English version - TOS]
Orthorexia nervosa could be conceptualized as extreme or excessive preoccupation with eating food believed to be healthy. Orthorexia nervosa and healthy orthorexia (interest in healthy eating) can be distinguised. Up to now, there is no available instrument evaluating every aspect of orthorexia with sufficient psychometric guarantees. The objective of the present study was two-fold. First, to develop and validate a new questionnaire of orthorexia –the Teruel Orthorexia Scale– and, second, to analyze the association with other psychological constructs and disorders theoretically related to orthorexia nervosa: eating disorder symptoms, obsessive-compulsive disorder symptoms, negative affect, and perfectionism. Participants were 942 mainly university students who completed a battery of online questionnaires. Of them, 148 provided responses in a retest 18 months later. Starting with an initial item bank of 31 items, we proposed a bidimensional test of orthorexia. This final version, with 17 items, encompassed two related, although differentiable (r = .43), aspects of orthorexia. First, Healthy Orthorexia, which evaluates the “healthy” preoccupation with diet, which is independent of psychopathology, and even inversely associated with it. Second, Orthorexia Nervosa, which assesses the negative social and emotional impact of trying to achieve a rigid way of eating. This dimension represents a pathological preoccupation with a healthy diet. This study presents a new instrument that offers promising possibilities in the study of orthorexia.
López-Antón, R., Barrada, J. R., Santabárbara, J., Posadas-de Miguel, M., Agüera, L., Burillo, C., ... & Lobo, A. (2018).
Reliability and validity of the Spanish version of the IDEAL Schedule for assessing care needs in dementia: Cross-sectional, multicenter study. International Journal of Geriatric Psychiatry, 33, 482-488.
[Abstract]
[PDF]
Objective: The IDEAL Schedule was developed for staging “care needs” in patients with dementia. We here aim to validate the Spanish version, further test its psychometric properties and explore a latent construct for “care needs”.
Methods: A multicenter study was done in 8 dementia care facilities across Spain. Patients referred with a reliable ICD-10 diagnosis of dementia (n = 151) were assessed with the IDEAL Schedule by pairs of raters. Inter-rater reliability (intra-class correlation [ICC] coefficients), internal consistency (Cronbach's alpha), and factor analysis were calculated. Convergent validity for individual items was tested against validated Spanish versions of international instruments.
Results: Pilot testing with numerical scales supported the feasibility, face, and content validity of the schedule. The psychometric coefficients were good/clinically acceptable: inter-rater reliability (mean ICC = 0.861; 85% of the ICCs > 0.8), internal consistency (global alpha coefficient = 0.74 in 5 nuclear items), and concurrent validity (global score against the Clinical Dementia Rating schedule, r = 0.63; coefficients for individual items ranging from 0.40 to 0.84, all statistically significant, p < 0.05). Internal consistency was low for the “nonprofessional care” and “social support” dimensions. Factor analysis supported a unidimensional solution, suggesting a latent “care needs” construct.
Conclusion: The Spanish version of the IDEAL Schedule confirms the main psychometric properties of the original version and documents for the first time the convergent validity of individual items. Factor analysis identified a latent construct consistent with the concept “care needs” although 2 dimensions need further psychometric research.
|
[2017]
|
Abad, F. J., Garcia-Garzon, E., Garrido, L. E., & Barrada, J. R.. (2017).
Iteration of partially specified target matrices: Application to the bi-factor case. Multivariate Behavioral Research, 52, 416-429.
[Abstract]
[PDF]
The current study proposes a new bi-factor rotation method, Schmid-Leiman with iterative target rotation (SLi), based on the iteration of partially specified target matrices and an initial target constructed from a Schmid-Leiman (SL) orthogonalization. SLi was expected to ameliorate some of the limitations of the previously presented SL bi-factor rotations, SL and SL with target rotation (SLt), when the factor structure either includes cross-loadings, near-zero loadings, or both. A Monte Carlo simulation was carried out to test the performance of SLi, SL, SLt, and the two analytic bi-factor rotations, bi-quartimin and bi-geomin. The results revealed that SLi accurately recovered the bi-factor structures across the majority of the conditions, and generally outperformed the other rotation methods. SLi provided the biggest improvements over SL and SLt when the bi-factor structures contained cross-loadings and pure indicators of the general factor. Additionally, SLi was superior to bi-quartimin and bi-geomin, which performed inconsistently across the types of factor structures evaluated. No method produced a good recovery of the bi-factor structures when small samples (N = 200) were combined with low factor loadings (0.30–0.50) in the specific factors. Thus, it is recommended that larger samples of at least 500 observations be obtained.
Correa, A. B., Castro, A., Barrada, J. R., Ruiz-Gómez, P. (2017).
Sociodemographic and psychosexual characteristics of students from a Spanish university who engage in casual sex. Sexuality Research and Social Policy, 14, 445-453.
[Abstract]
[PDF]
Casual sexual relations, understood as those in which there are no expectations of affective commitment, are increasingly common among youth. The goal of this study was to analyze the casual sexual behavior of students from a Spanish university, paying special attention to its relation with sociodemographic and psychosexual variables. Participants were 659 students from a Spanish university aged between 18 and 26 years, without a partner or being in a partner relationship of less than 12 months, who completed a battery of online questionnaires. It was found that about half of the participants had engaged in casual sex in the past year, with no differences as a function of gender. Engaging in casual sex was related to being older, less religious, performing risky sexual behaviors, and other psychosocial variables such as attitudes towards condoms, sociosexuality, and measures of personal well-being. The discussion highlights the need to conduct more research on casual sexual relations, due to the possible influence of cultural aspects in youth’s sociosexuality.
Magis, D., & Barrada, J. R. (2017).
Computerized adaptive testing with R: Recent updates of the package catR. Journal of Statistical Software, 76.
[Abstract]
[PDF]
The purpose of this paper is to list the recent updates of the R package catR. This package allows for generating response patterns under a computerized adaptive testing (CAT) framework with underlying item response theory (IRT) models. Among the most important updates, well-known polytomous IRT models are now supported by catR; several item selection rules have been added; and it is now possible to perform post-hoc simulations. Some functions were also rewritten or withdrawn to improve the usefulness and performances of the package.
Nieto, M. D., Abad, F. J., Hernández-Camacho, A., Garrido, L. E., Barrada, J. R., Aguado, D., & Olea, J. (2017).
Calibrating a new item pool to adaptively assess the Big Five. Psicothema, 29, 390-395.
[Abstract]
[PDF]
Background: Even though the Five Factor Model (FFM) has been the dominant paradigm in personality research for the past two decades, very few studies have measured the FFM adaptively. Thus, the purpose of this research was the building of a new item pool to develop a computerized adaptive test (CAT) for personality assessment. Method: A pool of 480 items that measured the FFM facets was developed and applied to 826 participants. Facets were calibrated separately and item selection was performed being mindful of the preservation of unidimensionality of each facet. Then, a post-hoc simulation study was carried out to test the performance of separate CATs to measure the facets. Results: The final item pool was composed of 360 items with good psychometric properties. Findings reveal that a CAT administration of four items per facet (total length of 120 items) provides accurate facets scores, while maintaining the factor structure of the FFM. Conclusions: An item pool with good psychometric properties was obtained and a CAT simulation study demonstrated that the FFM facets could be measured with precision using a third of the items in the pool.
Roncero, M., Barrada, J. R., & Perpiñá, C. (2017).
Measuring orthorexia nervosa: Psychometric limitations of the ORTO-15. Spanish Journal of Psychology, 20, E41.
[Abstract]
[PDF]
Orthorexia nervosa has recently been defined as excessive preoccupation with healthy eating, causing significant nutritional deficiencies and social and personal impairments. The ORTO-15 is the most widely used instrument to evaluate orthorexia nervosa, although previous studies obtained inconsistent results about its psychometric properties, and there are no data on the Spanish version. Thus, the main objective of the present study was to analyze the psychometric properties of the Spanish adaptation of the ORTO-15. In order to cross-validate the results, two independent samples were used (Sample 1: n = 807, 74.1% women; Sample 2: n = 242, 63.2% women). The results did not support the original recoding and reversal of the items; thus, the original scores were maintained. The analysis of the internal structure showed that the best interpretable solution was unidimensional, and due to low loadings, four items were removed. The internal consistency (α = .74) and temporal stability (r = .92) of the final ORTO-11 version were adequate, higher than the 15-item version. The questionnaire showed significant associations with eating psychopathology (EAT-26 and SR-YBC-EDS; range r = .64 - .29; p < .05). However, this result should be interpreted with caution due to the redundancy observed between the ORTO-15 and the EAT-26. Our results suggest that the psychometric properties of the Spanish version of the ORTO-15 are not adequate. Moreover, the instrument detects people who are on diets, but it is not efficient in detecting the severity of orthorexic behaviors and attitudes. New instruments are needed to continue the study of orthorexia nervosa.
Sayans-Jiménez, P., Cuadrado, I., Rojas, A. J., & Barrada, J. R. (2017).
Extracting the evaluations of stereotypes: Bi-factor model of the stereotype content structure. Frontiers in Psychology, 8, 1692.
[Abstract]
[PDF]
Stereotype dimensions —competence, morality and sociability— are fundamental to studying the perception of other groups. These dimensions have shown moderate/high positive correlations with each other that do not reflect the theoretical expectations. The explanation for this (e.g., halo effect) undervalues the utility of the shared variance identified. In contrast, in this work we propose that this common variance could represent the global evaluation of the perceived group. Bi-factor models are proposed to improve the internal structure and to take advantage of the information representing the shared variance among dimensions. Bi-factor models were compared with first order models and other alternative models in three large samples (300–309 participants). The relationships among the global and specific bi-factor dimensions with a global evaluation dimension (measured through a semantic differential) were estimated. The results support the use of bi-factor models rather than first order models (and other alternative models). Bi-factor models also show a greater utility to directly and more easily explore the stereotype content including its evaluative content.
Sorrel, M. A., Abad, F. J., Olea, J., de la Torre, J., & Barrada, J. R. (2017).
Inferential item-fit evaluation in cognitive diagnosis modeling. Applied Psychological Measurement, 41, 614-631.
[Abstract]
[PDF]
Research related to the fit evaluation at the item level involving cognitive diagnosis models (CDMs) has been scarce. According to the parsimony principle, balancing goodness of fit against model complexity is necessary. General CDMs require a larger sample size to be estimated reliably, and can lead to worse attribute classification accuracy than the appropriate reduced models when the sample size is small and the item quality is poor, which is typically the case in many empirical applications. The main purpose of this study was to systematically examine the statistical properties of four inferential item-fit statistics: S-X2, the likelihood ratio (LR) test, the Wald (W) test, and the Lagrange multiplier (LM) test. To evaluate the performance of the statistics, a comprehensive set of factors, namely, sample size, correlational structure, test length, item quality, and generating model, is systematically manipulated using Monte Carlo methods. Results show that the S-X2 statistic has unacceptable power. Type I error and power comparisons favor LR and W tests over the LM test. However, all the statistics are highly affected by the item quality. With a few exceptions, their performance is only acceptable when the item quality is high. In some cases, this effect can be ameliorated by an increase in sample size and test length. This implies that using the above statistics to assess item fit in practical settings when the item quality is low remains a challenge.
|
[2016]
|
Barrada, J. R., van Strien, T., & Cebolla, A. (2016).
Internal structure and measurement invariance of the Dutch Eating Behavior Questionnaire (DEBQ) in a (nearly) representative Dutch community sample. European Eating Disorders Review, 24, 503-509.
[Abstract]
[PDF]
The Dutch Eating Behavior Questionnaire is a widely used instrument for assessment of emotional, external and restrained eating. The aim of the present study is to (i) analyse its internal structure using exploratory structural equation modelling; (ii) to assess its measurement invariance with respect to sex, BMI, age and level of education; and (iii) to evaluate the relations of the factors with these variables. Except that women were slightly over-represented, the sample (n?=?2173) closely followed the sociodemographic characteristics of the overall Dutch population. The three theoretical factors that emerged from the analysis were in close correspondence with the three scales for emotional, external and restrained eating. Only two items (item 3 — ‘desire to eat when nothing to do…’ and item 21 — ‘resist delicious food...’) presented problematic loadings. The questionnaire showed satisfactory measurement invariance, and expected patterns of mean differences and relations were found. All in all, the results highlight the adequate psychometric properties of the Dutch Eating Behavior Questionnaire.
Osma, J., Barrada, J. R., García-Palacios, A., Navarro-Haro, M. V., & Aguilar, A. (2016).
Internal structure and clinical utility of the Anxiety Control Questionnaire-Revised (ACQ-R) Spanish version. Spanish Journal of Psychology, 19, e63.
[Abstract]
[PDF]
Perceived control has shown predictive value for anxiety severity symptoms as well as cognitive-behavior therapy outcomes. The most commonly used measure of perceived control is the Anxiety Control Questionnaire (ACQ), and more recently the ACQ Revised (ACQ-R). However, both questionnaires have shown structural inconsistencies among several studies. Also, although the ACQ and ACQ-R seem to be multidimensional instruments, a single total score have been commonly used. This study examined the internal structure of the ACQ-R Spanish version using exploratory factor and exploratory bi-factor analysis in a sample of 382 college students and 52 people diagnosed of panic disorder (with or without agoraphobia). Also, in this study we assessed the preliminary diagnostic value of the ACQ-R scores. The results indicated that the ACQ-R Spanish version structure consisted of two factors: one related with perceived control of internal emotional reactions (Emotion Control) and another related with perceived control of external events (Threat and Stress Control). Both specific factors can be adequately summarized by a general factor (General Anxiety Perception of Control; CFI = .973, TLI = .954, RMSEA = .039; p = .002), which accounted for 70% of the common explained variance. The correlations between the ACQ-R scores and with variables like anxiety (r = -.66) or anxiety sensitivity (r = -.50) presented the expected pattern of results. Either the two dimensions structure or the total score have proved to be a good tool to distinguish between participants with panic disorder and non-clinical samples (area under the curve = 0.79).
Osma, J., Barrada, J. R., García-Palacios, A., & Botella, C. (2016).
Influence of vulnerability factors in panic disorder severity: Personality, anxiety sensitivity, and perceived control. Psicothema, 28, 167-173.
[Abstract]
[PDF]
Background: We studied herein the predictive value for panic severity of three well-based vulnerability factors: personality traits (neuroticism and extraversion; NEO-PI-R), anxiety sensitivity (ASI), and perceived control (ACQ-R). Method: The sample was composed of 52 participants diagnosed with panic disorder, with or without agoraphobia, according to DSM-IV-TR criteria. Results: Our results revealed that the anxiety facet is a better predictor of panic severity than neuroticism. Anxiety sensitivity increases the predictive value for panic severity and, finally, perception of control of emotions is the only perception control subscale that increases the predictive value for panic severity more than the anxiety facet and anxiety sensitivity. Conclusions: This finding supports the assumption of the importance of taking into account the assessment of the lower order dimensions of the vulnerability factors in the field of psychopathology studies. Furthermore, the predictive value of perception of control of emotions indicates the importance of this specific vulnerability factor in the etiology of panic disorder (with or without agoraphobia) and, thus, shows the necessity to include emotion regulation strategies in the psychological treatments.
|
[2015]
|
Kaplan, M., de la Torre., J., & Barrada, J. R. (2015).
New item selection methods for cognitive diagnosis computerized adaptive testing. Applied Psychological Measurement, 39, 167-188.
[Abstract]
[PDF]
This paper introduces two new item selection methods, the modified posterior-weighted Kullback-Leibler index (MPWKL) and the generalized deterministic inputs, noisy “and†gate (G-DINA) model discrimination index (GDI), that can be used in cognitive diagnosis computerized adaptive testing. The efficiency of the new methods is compared with the posterior-weighted KL (PWKL) item selection index using a simulation study in the context of the G-DINA model. The impact of item quality, generating models, and test termination rules on attribute classification accuracy or test length is also investigated. The results of the study show that the MPWKL and GDI perform very similarly, and have higher correct attribute classification rates or shorter mean test lengths compared to the PWKL. In addition, the GDI has the shortest implementation time among the three indices. The proportion of item usage with respect to the required attributes across the different conditions is also tracked and discussed.
|
[2014]
|
Barrada, J. R., Abad., F. J., & Olea, J. (2014).
Optimal number of strata for the stratified methods in computerized adaptive testing. Spanish Journal of Psychology, 17, e48.
[Abstract]
[PDF]
Test security can be a major problem in computerized adaptive testing, as examinees can share information about the items they receive. Of the different item selection rules proposed to alleviate this risk, stratified methods are those that have received most attention. In these methods, only low discriminative items can be presented at the beginning of the test and the mean information of the items increases as the test goes on. To do so, the item bank must be divided into several strata according to the information on the items. To date, there is no clear guidance about the optimal number of strata into which the item bank should be split. In this study, we will simulate conditions with different numbers of strata, from 1 (no stratification) to a number of strata equal to test length (maximum level of stratification) while manipulating the maximum exposure rate that no item should surpass (rmax) in its whole domain. In this way, we can plot the relation between test security and accuracy, making it possible to determine the number of strata that leads to better security while holding constant measurement accuracy. Our data indicates that the best option is to stratify into as many strata as possible.
Cebolla, A., Barrada, J. R., van Strien, T., Oliver, E., & Baños, R. (2014).
Validation of the Dutch Eating Behavior Questionnaire (DEBQ) in a sample of Spanish women. Appetite, 73, 58-64.
[Abstract]
[PDF]
The Dutch Eating Behavior Questionnaire (DEBQ) was developed to measure eating styles that may contribute to or attenuate the development of overweight. It comprises three scales that measure emotional, external and restrained eating. The main goal of this study is to evaluate the internal structure of the Spanish version of the DEBQ using updated psychometric techniques in a sample of women. A sample of 647 Spanish females answered the questionnaire. Both exploratory structural equation modeling and confirmatory factor analysis were used to evaluate the factor structure of the DEBQ. Reliabilities were estimated with Cronbach’s alpha. The relations between the subscales of the DEBQ and age, BMI, and scores on the Eating Attitude Test-26 (EAT) and the Restrained Scale-Revised (RS) were computed with Pearson correlations. Results showed that the internal structure was similar to the theoretical proposal, although items associated with boredom and idleness presented cross-loading problems. The reliability estimates were satisfactory. The Emotional and External Eating factors correlated with the BMI, and External Eating was negatively correlated with age. The Restraint factor of the DEBQ showed significant relationships with scales of the EAT-26 and RS. The dimensional validity of the DEBQ is reproduced in a Spanish sample, and the DEBQ seems to be an effective instrument for research in Spanish females. Minor modifications to the DEBQ are recommended.
González-Betanzos, F., Abad, F. J., & Barrada, J. R. (2014).
Fixed parameter calibration for assessing differential item functioning in computerized adaptive tests. Psicológica, 35, 309-337.
[Abstract]
[PDF]
In computerized adaptive testing (CAT), pretest items are presented in conjunction with operational items to renew the item bank. Pretest items are calibrated and possible differential item functioning (DIF) is analyzed. Some difficulties arise due to the large amount of missing responses that can be avoided by the use of fixed parameter calibration (FPC) methods. In this study, we applied the multiple weights updating and multiple EM cycles method (MWUMEM) with responses imputation (as suggested by Lei, Chen, Yu, 2006) and without responses imputation for non-applied items. IRT likelihood ratio test (IRT-LRT) was used for DIF detection. The manipulated factors were the type of DIF, DIF size, impact size, test length, and sample size. The results showed that FPC method is apt for detecting large-size DIF in large samples. However, in the presence of impact, the use of imputation led to a bias in the effect-size measure of the DIF.
Luciano, J. V., Barrada, J. R., Aguado, J., Osma. J., & García-Campayo, J. (2014).
Bifactor analysis and construct validity of the HADS: A cross-sectional and longitudinal study in fibromyalgia patients. Psychological Assessment, 26, 395-406.
[Abstract]
[PDF]
The dimensionality of the Hospital Anxiety and Depression Scale (HADS) is a current source of controversy among experts. The present study integrates a solid theoretical framework (Clark & Watson’s tripartite theory) and a fine-grained methodological approach (structural equation modelling; SEM) to examine the dimensionality and construct validity of the HADS in fibromyalgia (FM) patients. Using the HADS data of 269 Spanish patients with FM, we estimated the cross-sectional, and for the first time, longitudinal fit (autoregressive model) of two competing models (oblique two-factor vs. bifactor) via confirmatory factor analysis. The pattern of relationships between the HADS latent dimensions and positive and negative affect (PA and NA) was analysed using SEM. HADS reliability was assessed by computing the omega and omega hierarchical coefficients. The bifactor model, which accounted for the covariance among HADS items with regard to one general factor (psychological distress) and two specific factors (depression and anxiety), described the HADS structure better than the original oblique two-factor model during both study periods. All latent dimensions of the bifactor model were temporally stable. The SEM analysis revealed a significant link between psychological distress and NA as well as between depression and low PA. Only the general factor of psychological distress showed adequate reliability. Although, the HADS shows a clear bifactor structure among FM patients, it does not seem recommendable to compute and report separately anxiety and depression scores because anxiety variance is tapped primarily by the broader construct of psychological distress and both specific dimensions show low reliability.
Osma, J., García-Palacios, A., Botella, C., & Barrada, J. R. (2014).
Personalidad y sensibilidad a la ansiedad como factores de vulnerabilidad en el trastorno de pánico. Psicología Conductual, 22, 185-201.
[Abstract]
[PDF]
Personality and psychopathology differences were explored among a clinical sample of 52 patients with Panic Disorder (PD), with Agoraphobia (PDA) or without Agoraphobia, and two nonclinical samples, one with 45 participants with high anxiety sensitivity (AS) scores, and 55 with low AS scores. The clinical sample was evaluated according to DSM-IV-TR (APA, 2000) criteria. The participants in nonclinical samples were assigned depending on the “Anxiety sensitivity index†(ASI; Reiss, Peterson, Gursky, & McNally, 1986) scores. The “Brief symptom inventory†(BSI; Derogatis & Melisaratos, 1983) was used to assess general psychopathology and the “NEO personality inventory-Revised†(NEO-PI-R; Costa & McCrae, 1992) was used to measure personality, both in the three samples. The results show that the only statistically significant differences between the participants with high AS scores and PD/PDA patients were in the psychopathological scales, phobic anxiety and paranoid ideation, and in the personality facet, social anxiety.
Osma, J., García-Palacios, A., Botella, C., & Barrada, J. R. (2014).
Assessment of personality disorders in panic disorder with agoraphobia and people with high and low anxiety sensitivity. Psicothema, 26, 159-165.
[Abstract]
[PDF]
Objectives: To explore the occurrence of personality psychopathology in a sample of patients with Panic Disorder (PD) and Panic Disorder with Agoraphobia (PDA), a sample with high scores in Anxiety Sensitivity (AS) without Axis I disorder, and a non-clinical sample.
Method: The total sample included 152 participants, 52 in the PD/PDA, 45 in the high AS sample, and 55 in the non-clinical sample. The participants in PD/PDA sample were evaluated with the structured interview ADIS-IV. The Brief Symptom Inventory and the MCMI-III were used in the three samples.
Results: Statistically significant differences were found between the PD/PDA and the nonclinical sample in all MCMI-III scales but Antisocial and Compulsive. No significant differences were found between PD/PDA and the sample with high scores in AS. Phobic Anxiety and Paranoid Ideation were the only scales where there were significant differences between the PD/PDA sample and the high AS sample.
Conclusions: Our findings showed that people who scored high on AS and despite not having a diagnosis of PD/PDA were similar in regard to personality pathology characteristics to individuals with PD/PDA.
Rey, J. J., Abad, F. J., Barrada, J. R., Garrido, L. E., & Ponsoda, V. (2014).
The impact of ambiguous response categories on the factor structure of the GHQ-12. Psychological Assessment, 26, 1021-1030.
[Abstract]
[PDF]
Previous research has suggested multiple factor structures for the 12-item General Health Questionnaire (GHQ-12), with contradictory evidence arising across different studies on the validity of these models. In the present research, it was hypothesized that these inconsistent findings were due to the interaction of 3 main methodological factors: ambiguous response categories in the negative items, multiple scoring schemes, and inappropriate estimation methods. Using confirmatory factor analysis with appropriate estimation methods and scores obtained from a large (n 27,674) representative Spanish sample, we tested this hypothesis by evaluating the fit and predictive validities of 4 GHQ–12 factor models—unidimensional, Hankins’ (2008a) response bias model, Andrich and Van Schoubroeck’s (1989) 2-factor model, and Graetz’s (1991) 3-factor model—across 3 scoring methods: standard, corrected, and Likert. In addition, the impact of method effects on the reliability of the global GHQ–12 scores was also evaluated. The combined results of this study support the view that the GHQ–12 is a unidimensional measure that contains spurious multidimensionality under certain scoring schemes (corrected and Likert) as a result of ambiguous response categories in the negative items. Therefore, it is suggested that the items be scored using the standard method and that only a global score be derived from the instrument.
|
[2013]
|
Burón, E., Bulbena, A., Barrada, J. R., & Pailhez, G. (2013).
EROL scale: A new behavioural olfactory measure and its relationship with anxiety and depression symptoms. Actas Españolas de Psiquiatría, 41, 2-9.
[Abstract]
[PDF]
Introduction: The main objective of this study was to develop and validate a new olfactory measure that assesses the influence of olfaction on several emotional, behavioural, and cognitive issues: The Relational Scale of Olfaction (EROL). A secondary objective was to explore the relationship between the olfactory function and the anxiety and depression symptoms by means of EROL and the Hospital Anxiety and Depression Scale (HADS). A positive relationship between anxiety symptoms and the olfactory function was hypothesized. Regarding depressive symptoms, a significant relationship with the olfactory scores was not expected. Method: Psychometric properties of EROL scale and correlations between HADS and EROL were tested in a sample from the general population. Results: EROL showed an adequate level of test-retest reliability (ICC=.748) and good internal consistency (Cronbach’s alpha=.761). Convergent validity with other olfactory measures was satisfactory. A one-factor solution was found for the scale. HADS showed a significant relationship with EROL (r=.280, p<.01), but the analysis through dimensions revealed that only the anxiety subscale correlated significantly and moderately with the olfactory measure (r=.325, p<.001), whereas the correlation with the depression subscale was non-significant (r=.146, p>.05). Conclusions: Given that EROL displayed good psychometrical properties, it appears as a suitable tool to assess the olfactory function in general population. The relationship between this olfactory scale and anxiety symptoms found in this study is an interesting issue that requires further research.
González-Perilli, F., Barrada, J. R., & Maiche, A. (2013).
Temporal dynamics of action contribution to object categorization. Psicológica, 34, 145-162.
[Abstract]
[PDF]
The presentation of a hand grasp facilitates the recognition of subsequent objects when the grasp is coherent with the object to be identified. This outcome is usually explained as the integration of two different processes: descriptive visual processes in ventral visual areas and processes in charge of the computations of action metrics in dorsal visual regions. With the aim to explore the temporal dynamics of this interaction, we conducted an experiment in which participants categorized objects preceded by congruent and incongruent hand grasp gestures under different interstimulus interval (ISI) conditions. Hand grasp gestures and target objects were separated by five different interstimulus intervals (ISI): 0, 250, 500, 1000, and 2000 ms. Results showed significant shorter response times for congruent trials than for incongruent trials for ISI conditions of 250 and 500 ms. However, no effect was found for the other ISIs (0, 1,000 and 2,000). These results suggest that the contribution of automatically driven visuomotor dorsal areas in object recognition is stronger up to 500 ms after prime offset, and that object identification is facilitated by hand gesture primes just inside this time window (250–500 ms).
Sánchez-Carracedo, D. López-Guimerà, G., Fauquet, J., Barrada, J. R., Pàmias, M., Puntí J., Querol, M., & Trepat, E. (2013).
A school-based program implemented by community providers previously trained for the prevention of eating and weight-related problems in secondary-school adolescents: The MABIC study protocol. BMC Public Health, 13:955.
[Abstract]
[PDF]
Background
The prevention of eating disorders and disordered eating are increasingly recognized as public health priorities. Challenges in this field included moving from efficacy to effectiveness and developing an integrated approach to the prevention of a broad spectrum of eating and weight-related problems. A previous efficacy trial indicated that a universal disordered eating prevention program, based on the social cognitive model, media literacy educational approach and cognitive dissonance theory, reduced risk factors for disordered eating, but it is unclear whether this program has effects under more real-world conditions. The main aim of this effectiveness trial protocol is to test whether this program has effects when incorporating an integrated approach to prevention and when previously-trained community providers implement the intervention.
Methods
The research design involved a multi-center non-randomized controlled trial with baseline, post and 1-year follow-up measures. Six schools from the city of Sabadell (close to Barcelona) participated in the intervention group, and eleven schools from four towns neighboring Sabadell participated in the control group. A total of 174 girls and 180 boys in the intervention group, and 484 girls and 490 boys in the control group were registered in class lists prior to baseline. A total of 18 community providers, secondary-school class tutors, nurses from the Catalan Government's Health and School Program, and health promotion technicians from Sabadell City Council were trained and delivered the program. Shared risk factors of eating and weight-related problems were assessed as main measures.
Discussion
It will be vital for progress in disordered eating prevention to conduct effectiveness trials, which test whether interventions are effective when delivered by community providers under ecologically valid conditions, as opposed to tightly controlled research trials. The MABIC project will provide new contributions in this transition from efficacy to effectiveness and new data about progress in the integrated approach to prevention. Pending the results, the effectiveness trial meets the effectiveness standards set down by the Society for Prevention Research. This study will provide new evidence to improve and enhance disordered eating prevention programs.
|
[2012]
|
Barrada, J. R. (2012).
Tests adaptativos informatizados: Una perspectiva general [Computerized adaptive testing: A general perspective]. Anales de Psicología, 28, 289-302.
[Abstract]
[PDF-Spanish]
Computerized adaptive testing (CAT) adapts the items to be administered to each examinee according to the responses to the previous items. In this way, more accurate trail level estimations can be obtained or test length is reduced. In the last years, several CATs have been developed in Spain and it is probably that, given the advantages of this technique, more will become available soon. The goal of this work is to offer and updated view of this topic. For doing so, the basic structure of a CAT is presented and the different steps composing it are commented. Special emphasis is given ot item selection, the fundamental part for the adaptability of the test, from the perspective of the four objectives that must be satisfied by a CAT: (a) accuracy, (b) item bank security; (c) content balance; and (d) test maintenance.
López-Guimerà, G., Fauquet, J., Sánchez-Carracedo, D., Barrada, J. R., Saldaña, C., & Masnou-Roig, A. (2012).
Psychometric properties of the Perception of Teasing Scale in a Spanish adolescent sample: POTS-S. Eating and Weight Disorders, 17, e210-e218.
[Abstract]
[PDF]
The present study examines the psychometric properties of the Spanish version of the Perception of Teasing Scale (POTS-S). Participants were 1,559 adolescents. They completed a translated version of the POTS and versions validated in Spanish population of the Rosenberg Self-Esteem Scale, the subscales Body Dissatisfaction and Drive for Thinness of the Eating Disorders Inventory-2, and the Children’s Eating Attitudes Test. The results showed that the POTS-S retains the original structure of two factors, weight and competency, with satisfactory fit indices. The POTS-S constitutes a shorter questionnaire than the original version; specifically, it consists of 9 items instead of 11. The POTS-S showed good internal consistency and satisfactory test-retest stability. The relationship between the weight subscale and the variables related to eating and weight were statistically significant. As regards the competency subscale, the correlations were all lower than those for the weight subscale, except in the case of the self-esteem variable. The POTS-S showed good psychometric properties, indicating its suitability as an instrument for assessing the perception of teasing in Spanish adolescents.
Olea, J., Barrada, J. R., Abad, F. J., Ponsoda, V., & Cuevas, L. (2012).
Computerized adaptive testing: The capitalization on chance problem. Spanish Journal of Psychology, 15, 424-441.
[Abstract]
[PDF]
This paper describes several simulation studies that examine the effects of capitalization on chance in the selection of items and the ability estimation in CAT, employing the 3-parameter logistic model. In order to generate different estimation errors for the item parameters, the calibration sample size was manipulated (N = 500, 1000 and 2000 subjects) as was the ratio of item bank size to test length (banks of 197 and 788 items, test lengths of 20 and 40 items), both in a CAT and in a random test. Results show that capitalization on chance is particularly serious in CAT, as revealed by the large positive bias found in the small sample calibration conditions. For broad ranges of θ, the overestimation of the precision (asymptotic Se) reaches levels of 40%, something that does not occur with the RMSE(θ). The problem is greater as the item bank size to test length ratio increases. Potential solutions were tested in a second study, where two exposure control methods were incorporated into the item selection algorithm. Some alternative solutions are discussed.
Sánchez-Carracedo, D., Barrada, J. R., López-Guimerà, G., Fauquet, J., Almenara, C. A., & Trepat, E. (2012).
Analysis of the factor structure of the Sociocultural Attitudes Towards Appearance Questionnaire (SATAQ-3) in Spanish secondary-school students through exploratory structural equation modeling. Body Image, 9, 163-171.
[Abstract]
[PDF]
The aims of the present study were: (1) to assess the factor structure of the SATAQ-3 in Spanish secondary-school students by means of exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) models; and (2) to study its invariance by sex and school grade. ESEM is a technique proposed for the analysis of internal structure and which addresses some of the limitations of EFA and CFA. Participants were 1,559 boys and girls in grades seven to ten. The results support the four-factor solution of the original version, and reveal that the best fit was obtained with ESEM, excluding item 20 and with correlated uniqueness between reverse-keyed items. Our version shows invariance by sex and grade. The differences between scores of different groups are in the expected direction, and support the validity of the questionnaire. We recommend a version excluding item 20 and without reverse-keyed items.
|
[2011]
|
Barrada, J. R., Abad., F. J., & Olea, J. (2011).
Varying the valuating function and the presentable bank in computerized adaptive testing. Spanish Journal of Psychology, 14, 500-508.
[Abstract]
[PDF]
In computerized adaptive testing, the most commonly used valuating function is the Fisher information function. When the goal is to keep item bank security at a maximum, the valuating function that seems most convenient is the matching criterion, valuating the distance between the estimated trait level and the point where the maximum of the information function is located. Recently, it has been proposed not to keep the same valuating function constant for all the items in the test. In this study we expand the idea of combining the matching criterion with the Fisher information function. We also manipulate the number of strata into which the bank is divided. We find that the manipulation of the number of items administered with each function makes it possible to move from the pole of high accuracy and low security to the opposite pole. It is possible to greatly improve item bank security with much fewer losses in accuracy by selecting several items with the matching criterion. In general, it seems more appropriate not to stratify the bank.
Olea, J., Abad, F. J., Ponsoda, V., Barrada, J. R., & Aguado, D. (2011).
eCAT-Listening: Design and psychometric properties of a computerized adaptive test on English Listening. Psicothema, 23, 802-807.
[Abstract]
[PDF]
In this study, eCAT-Listening, a new computerized adaptive test for the evaluation of English Listening, is described. Item bank development, anchor design for data collection, and the study of the psychometric properties of the item bank and the adaptive test are described. The calibration sample comprised 1,576 participants. Good psychometric guarantees: the bank is unidimensional, the items are satisfactorily fi tted to the 3-parameter logistic model, and an accurate estimation of the trait level is obtained. As validity evidence, a high correlation was obtained between the estimated trait level and a latent factor made up of the diverse criteria selected. The analysis of the trait level estimation by means of a simulation led us to fi x the test length at 20 items, with a maximum exposure rate of .40.
Prieto, G., Torres, M. T., Francés, L., Falguera, G., Vila, L., Manresa, J. M., Casamitjana, R., Barrada, J. R., Acera, A., Guix, D., Torrent, A., Grau, J., Torán, P. & the IODEGEST study group. (2011).
Nutritional status of iodine in pregnant women in Catalonia (Spain): Study on hygiene-dietetic habits and iodine in urine. BMC Pregnancy and Childbirth, 11, 17.
[Abstract]
[PDF]
Background
It is a priority to achieve an adequate nutritional status of iodine during pregnancy since iodine deficiency in this population may have repercussions on the mother during both gestation and post partum as well as on the foetus, the neonate and the child at different ages. According to the WHO, iodine deficiency is the most frequent cause of mental retardation and irrreversible cerebral lesions around the world. However, few studies have been published on the nutritional status of iodine in the pregnant population within the Primary Care setting, a health care level which plays an essential role in the education and control of pregnant women. Therefore, the aim of the present study is: 1.- To know the hygiene-dietetic habits related to the intake of foods rich in iodine and smoking during pregnancy. 2.- To determine the prevalence of iodine deficiency and the factors associated with its appearance during pregnancy.
Methods/design
We will perform a cluster randomised, controlled, multicentre trial. Randomisation unit: Primary Care Team. Study population: 898 pregnant women over the age of 17 years attending consultation to a midwife during the first trimester of pregnancy in the participating primary care centres. Outcome measures: consumption of iodine-rich foods and iodine deficiency. Points of assessment: each trimester of the gestation. Intervention: group education during the first trimester of gestation on healthy hygiene-dietetic habits and the importance of an adequate iodine nutritional status. Statistical analysis: descriptive analysis of all variables will be performed as well as multilevel logistic regression. All analyses will be done carried out on an intention to treat basis and will be fitted for potential confounding factors and variables of clinical importance.
Discussion
Evidence of generalised iodine deficiency during pregnancy could lead to the promotion of interventions of prevention such as how to improve and intensify health care educational programmes for pregnant women.
|
[2010]
|
Barrada, J. R., Olea, J., Ponsoda, V., & Abad, F. J. (2010).
A method for the comparison of item selection rules in computerized adaptive testing. Applied Psychological Measurement, 34, 438-452.
[Abstract]
[PDF]
In a typical study of the relative efficiency of two competing item selection rules in computerized adaptive testing, the common result is that they simultaneously differ in accuracy and security, making it difficult to reach a conclusion on which is the more appropriate rule. This study proposes a strategy to conduct a global comparison of two or more selection rules. A plot showing the performance of each selection rule for several maximum exposure rates is obtained and the whole plot is compared with other rule plots. The strategy has been applied in a simulation study with fixed length CATs for the comparison of 6 item selection rules: point Fisher information, Fisher information weighted by likelihood, Kullback-Leibler weighted by likelihood, maximum information stratification method with blocking, progressive method and proportional method. Our results show that there is no optimal rule for any overlap value or RMSE. The fact that a rule, for a given level of overlap, has lower RMSE than another does not imply that this pattern holds for another overlap rate. A fair comparison of the rules requires extensive manipulation of the maximum exposure rates. The best methods were Kullback-Leibler weighted by likelihood, proportional method, and maximum information stratification method with blocking.
Abad, F. J., Olea, J., Aguado, D., Ponsoda, V., & Barrada, J. R.. (2010).
Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT [Item parameter drift in computerized adaptive testing: Study with eCAT]. Psicothema, 22, 340-347.
[Abstract]
[PDF-Spanish]
This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N = 7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English theta estimates. It is then recommended to replace the original estimates by the new set.
Olea, J., Abad, F. J., & Barrada, J. R.. (2010).
Tests informatizados y otros nuevos tipos de tests [Computerized tests and other new types of testing]. Papeles del Psicólogo, 31, 94-107.
[Abstract]
[PDF-Spanish]
[PDF-English]
The paper provides a short description of some test types that are earning considerable interest in both research and applied areas. The main feature of a computerized adaptive test is that in despite of the examinees receiving different sets of items, their test scores are in the same metric and can be directly compared. Four other test types are considered: a) model-based tests (a model or theory is available to explain the item response process and this makes the prediction of item difficulties possible), b) ipsative tests (the examinee has to select one among two or more options with similar social desirability; so, these tests can help to control faking or other examinee’s response biases), c) behavioral tests (personality traits are measured from non-verbal responses rather than from self-reports), and d) situational tests (the examinee faces a conflictive situation and has to select the option that best describes what he or she will do). The paper evaluates these types of tests, comments on their pros and cons and provides some specific examples.
|
[2009]
|
Barrada, J. R., Abad, F. J., & Veldkamp, B. P. (2009).
Comparison of methods for controlling maximum exposure rates in computerized adaptive testing. Psicothema, 21, 313-320.
[Abstract]
[PDF]
This paper has two objectives: (a) to provide a clear description of three methods for controlling the maximum exposure rate in computerized adaptive testing, the Symson-Hetter method, the restricted method and the item-eligibility method, showing how all can be interpreted as methods for constructing the variable sub-bank of items from which each examinee receives the items in his test; (b) to indicate the theoretical and empirical limitations of each method and to compare their performance. With the three methods, we obtain basically indistinguishable results in overlap rate and RMSE (differences in the third decimal place). The restricted method is the best method for controlling exposure rate, followed by the item-eligibility method. The worst is the Sympson-Hetter method. The restricted method presents problems of sequential overlap rate. Our advice is to use the item-eligibility method, as it saves time and satisfies the objectives of restricting maximum exposure.
Barrada, J. R., Olea, J., Ponsoda, V., & Abad, F. J. (2009).
Item selection rules in computerized adaptive testing: Accuracy and security. Methodology, 5, 7-17.
[Abstract]
[PDF]
The item selection rule (ISR) most commonly used in CATs is to select the item with maximum Fisher information for the current trait estimation (PFI). Alternative ISRs have been proposed. Fisher information considered in an interval (FI*I), Fisher information weighted with the likelihood function (FI*L), Kullback-Leibler information in an interval (KL*I) and Kullback-Leibler weighted with the likelihood function (KL*L) have shown a greater precision of trait estimation at the early stages of CAT. A new ISR is proposed, Fisher information by interval with geometric mean (FI*IG), which tries to rectify some detected problems in FI*I. We evaluate for these six ISRs accuracy and item bank security. FI*IG is the only ISR which outperforms simultaneously PFI in both variables. For the other ISRs there seems to be a trade-off between accuracy and precision, being PFI the one with worse accuracy ang greater security, and the ISRs using the likelihood function the reverse.
Barrada, J. R., Veldkamp, B. P., & Olea, J. (2009).
Multiple maximum exposure rates in computerized adaptive testing. Applied Psychological Measurement, 33, 58-73.
[Abstract]
[PDF]
Computerized adaptive testing is subject to security problems, as the itembank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose amaximum exposure rate (rmax) that no itemshould exceed. Several methods have been proposed with this aim. All of thesemethods establish a single value of rmax throughout the test. This study presents a new method, themultiple-rmax method, that defines asmany values of rmax as the number of items presented in the test. In this way, it is possible to impose a high degree of randomness in item selection at the beginning of the test, leaving the administration of items with the best psychometric properties to the moment when the trait level estimation is most accurate. The implementation of themultiple-rmax method is described and is tested in simulated itembanks and in an operative bank. Comparedwith a single maximumexposuremethod, the new method has a more balanced usage of the itembank and delays the possible distortion of trait estimation due to security problems, with either no or only slight decrements of measurement accuracy.
|
[2008]
|
Barrada, J. R., Olea, J., & Abad., F. J. (2008).
Rotating item banks versus restriction of maximum exposure rates in computerized adaptive testing. Spanish Journal of Psychology, 11, 618-625.
[Abstract]
[PDF]
If examinees were to know, beforehand, part of the content of a computerized adaptive test their estimated trait levels would then have a marked positive bias. One of the strategies to avoid this consists of dividing a large item bank into several sub-banks and rotating the sub-bank employed (Ariel, Veldkamp & van der Linden, 2004). This strategy permits substantial improvements in exposure control at little cost to measurement accuracy. However, we do not know whether this option provides better results than using the master bank with greater restriction in the maximum exposure rates (Sympson & Hetter, 1985). In order to investigate this issue, we worked with several simulated banks of 2100 items, comparing them, for RMSE and overlap rate, with the same banks divided in two, three... up to seven sub-banks. By means of extensive manipulation of the maximum exposure rate in each bank, we found that the option of rotating banks slightly outperformed the option of restricting maximum exposure rate of the master bank by means of the Sympson-Hetter method.
Barrada, J. R., Olea, J., Ponsoda, V. & Abad., F. J. (2008).
Incorporating randomness in Fisher information for improving item exposure control in CATs. British Journal of Mathematical and Statistical Psychology, 61, 493-513.
[Abstract]
[PDF]
The most commonly employed item-selection rule in a Computerized Adaptive Test is that of selecting the item with the maximum Fisher information for the estimated trait level. This means a highly unbalanced distribution of item exposure rates, a high overlap rate among examinees and, for item bank management, strong pressure to replace items with a high discrimination parameter in the bank. An alternative for mitigating these problems involves, at the beginning of the test, basing item selection mainly on randomness. As the test progresses, the weight of information in the selection increases. In the present work we study, for two selection rules, the progressive method (Revuelta & Ponsoda, 1998) and the proportional method (Segall, 2004a), different functions that define the weight of the random component according to the position in the test of the item to be administered. The functions were tested in simulated item banks and in an operative bank. We found that both the progressive method and the proportional method tolerate a high weight of the random component with minimal or zero losses of accuracy, while bank security and maintenance is improved.
|
[2007]
|
Barrada, J. R., Olea, J., & Ponsoda, V. (2007).
Methods for restricting maximum exposure rate in computerized adaptative testing. Methodology, 3, 14-23.
[Abstract]
[PDF]
The Sympson-Hetter (1985) method provides a means of controlling maximum exposure rate of items in Computerized Adaptive Testing. Through a series of simulations, control parameters are set that mark the probability of administration of an item on being selected. This method presents two main problems: it requires a long computation time for calculating the parameters and the maximum exposure rate is slightly above the fixed limit. Van der Linden (2003) presented two alternatives which appear to solve both of the problems. The impact of these methods in the measurement accuracy has not been tested yet. We show how these methods over-restrict the exposure of some highly discriminating items and, thus, the accuracy is decreased. It also shown that, when the desired maximum exposure rate is near the minimum possible value, these methods offer an empirical maximum exposure rate clearly above the goal. A new method, based on the initial estimation of the probability of administration and the probability of selection of the items with the restricted method (Revuelta & Ponsoda, 1998), is presented in this paper. It can be used with the Sympson-Hetter method and with the two van der Linden's methods. This option, when used with Sympson-Hetter, speeds the convergence of the control parameters without decreasing the accuracy.
|
[2006]
|
Barrada, J. R., Mazuela, P., & Olea, J. (2006).
Maximum information stratification method for controlling item exposure in computerized adaptive testing. Psicothema, 18, 156-159.
[Abstract]
[PDF]
The proposal for increasing the security in Computerized Adaptive Tests that has received most attention in recent years is the a-stratified method (AS - Chang and Ying, 1999): at the beginning of the test only items with low discrimination parameters (a) can be administered, with the values of the a parameters increasing as the test goes on. With this method, distribution of the exposure rates of the items is less skewed, while efficiency is maintained in trait-level estimation. The pseudo-guessing parameter (c), present in the three-parameter logistic model, is considered irrelevant, and is not used in the AS method. The Maximum Information Stratified (MIS) model incorporates the c parameter in the stratification of the bank and in the item-selection rule, improving accuracy by comparison with the AS, for item banks with a and b parameters correlated and uncorrelated. For both kinds of banks, the blocking b methods (Chang, Qian and Ying, 2001) improve the security of the item bank.
Barrada, J. R., Olea, J., Ponsoda, V. & Abad., F. J. (2006).
Estrategias de selección de items en un Test Adaptativo Informatizado para la evaluación de inglés escrito [Item selection rules in a Computerized Adaptive Test for the assessment of written English]. Psicothema, 18, 828-834.
[Abstract]
[PDF-Spanish]
e-CAT is a Computerized Adaptive Test for the evaluation of written English knowledge, using the item selection rule most commonly employed: the maximum Fisher information criterion. Some of the problems of this criterion have a negative impact in the estimation accuracy and in the item bank security. In this study, the performance of this item selection rule is compared, by means of simulation, with two other rules: selecting the item with maximum Fisher information in an interval (Veerkamp y Berger, 1997) and a new criterion, called "maximum Fisher information in an interval with geometric mean". In general, this new rule shows smaller measurement error and smaller item overlap rates. It seems, thus, recommendable, as it allows the simultaneous improvement of estimation accuracy and the maintenance of the item bank security of e-CAT.
|
[2003]
|
Arend, I., Botella, J., & Barrada, J. R. (2003).
Emotional load and the formation of illusory conjunctions in the time domain. Psicothema, 15, 446-451.
[Abstract]
[PDF]
The effect of emotional load of the stimuli on its processing has been interpreted in terms of overautomaticity or as permanently lowered threshold for recognition. This special characteristic of emotional stimuli has been used to study how our cognitive system process information. In the present research the emotional/neutral manipulation has been used to test the model of Botella, Barriopedro & Suero (2001) for the formation of illusory conjunctions in the time domain. Results of three experiments are analyzed within this context. It is concluded that, in general, they support the general architecture of the model.
|
Book Chapters
[2001]
|
Barrada, J. R., & Botella, J. (2001).
Efectos aditivos de dos distractores en un paradigma de compatibilidad con presentaciones PRSV.
In C. Méndez, D. Ponte, L. Jimenez y M. J. Sampedro (eds.) La Atención: Un enfoque pluridisciplinar Vol. 2 (pp. 251-260).
Valencia: Promolibro.
|
| | | |