When Eating Correctly is not so Healthy: Factor Analysis of the ORTO-15 in University Students from Mexico City

Research Article

Austin J Nutr Metab. 2021; 8(1): 1100.

When Eating “Correctly” is not so Healthy: Factor Analysis of the ORTO-15 in University Students from Mexico City

Tena A¹*, Parra A², Barajas M³, Bilbao GM², Diaz MC¹, Flores I², Ruiz A¹

¹Department of Psychology, University of Ibeoamerican, Mexico

²Department of Health, University of Ibeoamerican, Mexico

³National Autonomous University of Mexico, Complexity Science Center, Mexico

*Corresponding author: Antonio Tena Suck, Department of Psychology, University of Ibeoamerican, Mexico

Received: December 22, 2020; Accepted: January 26, 2021; Published: February 02, 2021

Abstract

Background: The objective of this study was to analyze the psychometric properties of the ORTO-15 questionnaire, in Mexican university students. This questionnaire was designed to assess the presence of Orthorexia Nervosa (ON).

Method: The sample consisted of 911 Mexican university students (65.4% women) aged between 18 and 28 years (M=21±1.9) who answered the Spanish version of the ORTO-15.

Results: The results of the factor analysis with a varimax rotation yielded a structure of 14 test items made up of four factors, which explained 52.4% of the variance. Likewise, an adequate internal consistency was obtained (Cronbach’s alpha=0.78).

Conclusion: The psychometric properties of the Spanish version of the ORTO-15 are supported as a reliable tool for the evaluation of orthorexia nervosa in the Mexican population; however, it is important to consider the influence of the Mexican culture. Its use is expected to contribute significantly to a better understanding of the impact these behaviors have on Mexican population.

Keywords: ORTO-15; Orthorexia Nervosa; Eating Disorders; Mexican Population; University Students

Introduction and Background

Being overweight and obese are considered major public health problems in Mexico, representing a combined prevalence of 36% in the adolescent population and 72.5% in adults 20 years of age or older, according to the Halfway Health and Nutrition National Survey 2016 (Midway National Health and Nutrition Survey, 2016), carried out by the National Institute of Public Health (ENSANUT-MC). This is the reason why the primary strategies of many public health policies have been directed at promoting a healthy diet, to reduce the negative health consequences relating to obesity [1]. However, along with the increase in overweight and obesity, there has been an increase in the prevalence of Eating Disorders (ED) and Risky Eating Behaviors (REB), which can be represented in the rise of eating disorders in adolescents of 1.3%. This is a number higher by half of the percentage obtained by the ENSANUT in 2006 [2].

There is a thin line between wanting to eat healthily and have a pathological concern for eating healthily [3]. In some cases, the selfimposition of eating rules to improve one´s health can be harmful. This search for the “perfect healthy diet” becomes an exaggerated and pathological concern, a condition currently known as Orthorexia Nervosa (ON) [4].

The word orthorexia is a neologism from the Greek Orthos (correct) and Orexia (appetite, nutrition), which alludes to the atypical need to “eat properly”. It constitutes a new eating disorder, which main symptom is an obsessive and pathological approach to eating foods that are perceived as healthy [5]. Likewise, physician Steven Bratman coined the term Orthorexia Nervosa (ON) in 1997 and defined it as “having a pathological obsession for eating a healthy diet” [4]. In recent years, many articles that refer to orthorexia have been published; however, currently there is still no universally accepted definition of orthorexia. A short literature review of current articles on the topic of orthorexia revealed the following themes:

A pathological obsession with correct nutrition characterized by a restrictive diet, a ritualized and rigid eating pattern, avoiding the consumption of certain foods that are considered impure or unhealthy [3,6,7]. A fixation with consuming healthy food [8-11]. An excessive concern with eating healthy food [12-15]. An obsession with the consumption of healthy foods, which can lead to restrictive diets, sometimes with a deficiency of essential nutrients and a modification of social relationships [16].

ON is defined using different terms such as obsession, fixation, and concern, which are further emphasized with terms such as excessive or pathological. Food is classified by the individual based on quality levels (as healthy or as unhealthy or impure), while the diet is described as restrictive or rigid, with behavioral aspects such as modifications in social relationships [5]. Despite the increase in interest over ON, the concept remains controversial. Therefore, it is not yet recognized as a disorder by the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders) or by the International Classification of Disease (ICD-11). This is the reason why, just as there is no consensus in its definition, neither is there any diagnostic criteria and evaluation instruments as potent as those which measure ED, but for ON [6,17]. However, there are attempts to establish the diagnostic criteria of ON by various researchers [18-21]. Established that two main characteristics must be present for ON to be diagnosed [5]. Primarily, an obsessive approach in eating practices, which aim to promote an optimal well-being through healthy eating. Examples include inflexible diets, persistent and recurrent worry with food, and compulsive behavior. Secondarily, significant clinical deterioration, represented in medical or psychological complications, great anguish and/or deterioration in important areas of functioning [5]. Among the characteristics that have been observed in patients with ON, they present similar features than individuals with eating disorders, and obsessive-compulsive disorder [17]. Specifically, the similarities with anorexia nervosa have led to a debate over whether ON is a unique disorder, a subtype of AN or an Obsessive-Compulsive Disorder (OCD) [5,6,17,22].

Some of the similarities between ON and Anorexia Nervosa (AN) include perfectionism, high levels of anxiety, a need to exercise control, viewing adhering to a healthy diet as a marker of selfdiscipline, limited vision of their condition, and a denial of functional impairments associated with the disorder. The similarities between ON and OCD include recurrent and intrusive thoughts about food and health, an exaggerated concern around pollution and impurity, and a great need to organize food and eat in a ritualized way, as well as having limited time for other activities, since the adherence to a strict eating style interferes with normal routines [5,6,17,22]. However, despite the similarities, ON presents significant differences with these disorders. As for AN, the main difference is the motivation to eat in a disorderly manner. Given that, while individuals with AN alter their eating patterns to lose weight due to their concern with body image and fear of gaining weight, individuals with ON alter their eating patterns in order to improve their health, without the fear of gaining weight. ON is focused on the quality of the food and not on the quantity. Likewise, while individuals with AN tend to hide their behavior, individuals with ON are more likely to exhibit their habits. Finally, regarding OCD, the most significant difference is that the content of the obsessions in ON is perceived as ego-syntonic instead of ego-dystonic [5,6,17,22].

There is also no consensus on which evaluation instrument professionals should use to measure the psychometric characteristics of ON, which is problematic because an evaluation instrument is an indispensable part of research; it is crucial to have valid and reliable instruments for its assessment. So far the instruments that have been developed with this objective in mind are the Bratman Test (BOT) without validation studies; the ORTO-15 test, the Eating Habits Questionnaire (EHQ) [17] and the Dusseldorf Ortorexia Scale (DOS) [5].

However, so far, the ORTO-15 is the most widely used instrument in studies related to ON. In a way, it has been considered the golden standard in the evaluation of ON, regardless of its psychometric properties [3,9,17,23-25].

The ORTO-15 [26] was developed based on the test proposed by Bratman Test (BOT) and the Minnesota Multiphasic Personality Inventory (MMPI). It is made up of 15 questions in a four-point answer format ranging from “always” to “never.” The questions address three dimensions that are: a) rational cognitive area (questions: 1, 5, 6, 11, 12 and 14), b) clinical area (questions: 3, 7, 8, 9 and 15) and c) emotional area (questions: 2, 4, 10 and 13). The total scale score ranges from 15 to 60 points, where lower scores are indicative of ON, while higher scores indicate a normal eating pattern. Some authors have used a cut-score below 35 points [24,27,28], but a score below 40 has shown a better predictive capacity [26]. On the other hand, the English version has also been used for validation in other languages [3,23,29]. The ORTO-15 has been translated and validated in several languages: Turkish, Portuguese, Hungarian, Polish, German, and Spanish [5,17,30]. On the other hand, studies have been conducted to analyze the internal structure of the instrument with different results among them, showing inconsistencies with respect to the validity and internal reliability [3,17].

For example, Arusoglu and collaborators (2008) applied the ORTO-15 in a sample composed of 994 university students, obtaining a weak internal consistency with a Chronbach’s Alpha equal to 0.62, which derived in the elimination of various items from the original questionnaire and ended up with a final unidimensional version made up of 11 elements. On the other hand, Varga and collaborators (2014) tested this instrument in 819 Hungarian university students, resulting in the elimination of 4 items and an acceptable internal consistency (Chronbach’s Alpha=0.82). In the same sense, the ORTO-15 was used in a sample of 1029 German individuals, with a unidimensional version of the scale as a result, made up of 9 elements and a moderate consistency equal to 0.67. Also, [29], obtained a version conformed by 9 items in a sample of 400 students, with a Chronbach’s Alpha equal to 0.64. In general, all the translated versions of the ORTO- 15 have eliminated one or more questions to increase the validity and internal reliability of the original questionnaire, which has led to shortened versions ranging from 9 to 14 items [17,31]. Regarding this structure and item quantity variety, various authors consider that this variation has its origin in sociocultural differences, as well as the diverse customs regarding food [32]. Given that the relative data of the epidemiology for any disease is determined by the sensitivity and specificity of the evaluation instruments, it has been difficult to obtain reliable estimates of the prevalence of ON, since, as mentioned above; there is still no consensus on the evaluation instrument to use [6]. The objective of this study was to validate and obtain the reliability of the Orthorexia Nervosa Questionnaire (ORTO-15) in Mexican university students. Parra-Fernandez and her collaborators (2018) previously validated this instrument in Spanish. It consists of 15 questions on a Likert scale with 4 answer options that are: “always, often, sometimes, never”. A score of 40 points or less means that there is a presence of a pathological behavior characterized by a strong concern for healthy eating; however, the score does not imply having a mental health disorder. Finally, the test items assess the obsessive attitude of people to choose, buy, prepare, and consume food that they consider healthy. A cut-point of less than 35 has been shown to increase specificity and improve diagnostic trends [24,26]. In this study, ON refers to the phenomenon of obsessive and sensitive behavior towards health and nutrition [27].

Methods

Participants

911 university students participated in the study (65.4% women and 34.6% men) with an age range between 18 and 28 years (M=21 and SD=1.9), belonging to different undergraduate careers. Out of these, 27.8% are enrolled in nutrition degrees, 20.5% in social sciences, 16.9% in arts and humanities, 15.6% in engineering, 9.9% in economic-administrative careers, and 9.4% in health sciences.

Instrument

ORTO-15 questionnaire: The ORTO-15 questionnaire was originally developed in Italy by [27]; in its original form, it consists of three factors that measure thoughts, emotions and behaviors related to food. The ORTO-15 consists of 15 test items in the Likert format, which objective is to examine the obsessive behavior of a person with respect to the selection of foods, their preparation and consumption habits, as well as attitudes towards food considered “healthy”. Test items are included such as: “Whenever you eat something, do you check how many calories does it contain? Would you be willing to spend more for a healthy diet?” In this questionnaire the value of 1 is assigned to the answer that is more indicative of orthorexia and 4 to the response that indicates a normal feeding behavior, diagnosing those individuals with a score lower than 40 with orthorexia for the general population.

Procedure

A non-experimental cross-sectional investigation was carried out to analyze the psychometric properties of the ORTO-15 questionnaire in Mexican university students. Prior to the application, a process of validation by judges was conducted (with the help of experts in the topic) to verify that the translation into Spanish was understandable and measured the orthorexia variable appropriately. Once this version was reviewed, it was applied in a group after receiving prior consent from the subjects. The University’s Ethics Committee for Research approved the study.

To protect the confidentiality of the participants, they were informed that their answers would be treated anonymously, confidentially, and for statistical purposes only. Finally, they were asked to choose the answer they considered most appropriate to their attitudes on the subject. For ethical reasons, the participants did not receive any financial compensation in exchange for their participation in the study.

Results

After having captured the data, an initial analysis of test item´s discrimination was carried out, in order to analyze if all of them met the necessary methodological requirements, considering three criteria: a) frequency distribution, b) differences between the means of extreme groups for each test item and c) correlation between each test item and the total scale. Further on, a Principal Component Analysis with a Varimax rotation was used to identify subjacent dimensions from the ORTO-15 Questionnaire. In the original solution, the eigenvalues superior to 1 showed the existence of four factors, converged in eleven iterations that explained 49.9% of the total variance. The antiimage matrix was also obtained to observe which test items could be decreasing the total variance explained by the set of test items. As the result of this matrix, the test item number 5 was eliminated: “In your opinion, is the taste of the food the main criterion when determining its quality?”. With said chance, the total variance explained increased from 49.9% to 52.5%. With the remaining 14 items, the internal consistency of the scale was obtained, measured by Cronbach’s Alpha, which resulted in 0.78; this is an acceptable value. To investigate if any of the test items was decreasing the total alpha of the scale, the correlation between each item and the total scale was analyzed. Consequently, it was observed that there was no significant change in the alpha if any of the test items were eliminated. Therefore, the decision was made to keep the 14 test items, as shown in (Table 1). On the other hand, the Bartlett’s Sphericity test, which evaluates the applicability of the factorial analysis in each of the studied variables and its statistical significance (2329.59, gl=105, Sig<0.001). This implies that the Principal Component Analysis is an adequate tool to factorize this specific group of data. Similarly, the Keizer-Meyer- Olkin index was applied (0.829) with a positive result. This indicates the existence of an adequate test in relation to the sample’s size.