Digital Tools and Personal Learning Environments: An Analysis in Higher Education

: The e ﬀ ective use of Information and Communications Technology (ICT) and the discussion surrounding its educational contributions in formal settings are key elements in the analysis of personal learning environments (PLE). The aim of this study was to analyze the tools that students use to access information, create content, and share and interact in the framework of higher education. The study took a quantitative approach, using an ex post facto, transactional design. Data collection was via the application of a questionnaire to a stratiﬁed probabilistic sample (n = 1187) of university students on di ﬀ erent courses at the National University (Costa Rica). Analysis of the data showed moderate use of tools in students’ PLEs. Students made more frequent use of resources aimed at accessing information, followed by applications for sharing and interacting, and, to a lesser extent, content creation. We also found signiﬁcant di ﬀ erences in the use of tools depending on sex, previous education in technology, and academic performance. We recommend the inclusion of open, ﬂexible learning strategies in university education which incorporate the various technological resources available in the digital era to ensure the development of PLEs and lifelong learning.


Introduction
Formal education in general, and higher education in particular, are witnessing a technological revolution resulting in significant changes to pedagogical processes and to the way education is conceived and organized in line with the current demands of the knowledge society [1]. The inclusion of Information and Communications Technology (ICT) in higher education may produce a deep transformation [2] that would be beneficial in a variety of aspects: on the one hand, the development of new metacognitive skills [3] in response to the dynamic learning styles required of current university students, and on the other, in line with the paradigm of sustainable development, the encouragement of growth in all aspects and areas of society [4].
Access to and effective use of ICT can promote the democratization of education, supporting teaching processes that encourage equality and integration of less advantaged social groups, to construct a fairer, more sustainable society. Factors which contribute to this include access to and management of information, content creation, the possibility of sharing information quickly and free of charge, and the ease of online iteration [5]. However, despite the many studies on this topic, use of ICT in higher education does not guarantee that the benefits these tools may produce in the teaching/learning process will be taken advantage of [6]. In some cases, this is due to poor teacher training [7] as well as a lack of instructional design linking teaching strategies, tools, and underlying pedagogical theory [8].
Various international bodies, such as the Organization for Economic Cooperation and Development (OECD) and the United Nations Educational, Scientific and Cultural Organization (UNESCO), have proposed breaking the paradigm of higher education institutions in order to move the axis of learning from the educational institution to the student, promoting an active, conscious process on the part of the learner [9]. In this regard, the effective use of ICT may facilitate the development of skills and abilities for self-directed, lifelong, and life-wide learning [10,11] which may help reduce the various gaps between different levels in society and help address some of the current challenges in the work environment [12] which are largely based on the knowledge economy [13].

Personal Learning Environment
The development of ICT-especially web 2.0-has made a great expansion of knowledge possible, now that people have been able to move from a merely receptive role and become active agents in the creation and diffusion of content. Learning is an activity that continues throughout life, nourished by various sources of knowledge in formal, non-formal, and informal settings. Nowadays, thanks to the ease of access and the huge development and spread of ICT, technological mediation is a common resource in learning processes regardless of the level, environment, or system in which they take place. It is in this framework that higher education institutions must face the challenges of transforming and reassessing education and training programs for their students in response to society's demands [14]. Although we can find antecedents from several decades ago, technological proliferation makes a reawakening of what some authors consider a new educational approach [15], called the Personal Learning Environment (PLE).
In recent years, the idea of the PLE has given rise to much debate, and has had a significant impact in the field of educational technology [16]. Consequently, there is no consensus in the scientific community regarding the definition [17]. On the one hand, there are the authors who defend the position of a pedagogical approach, and on the other those who advocate a more technical meaning, as a set of tools. In the framework of this research, a more holistic perspective corresponded in which the PLE is composed of tools, activities, and connections [15] that are used to learn, from a perspective that is inseparably both pedagogical and technological. In other words, a PLE allows one to make the most of the potential of ICT and incorporate it into both formal and informal learning processes [16], giving prominence to student learning [18].
There have also been discussions about the components of PLE. For this study, we considered the structure proposed in [15], which defined three PLE components: tools and strategies for accessing information, content creation, and interaction and information exchange.

The Components of PLE
Given the amount of online information we are exposed to nowadays, as well as the many formats that are adapted to different learning styles [19], information access is a particularly important component in PLEs. Effective searching, along with filtering and information management are essential for university students, particularly in order to produce more autonomous, lifelong, learning processes which can and should be continued after university. Various studies have indicated that this is one of the most helpful components for university students' PLEs [20][21][22]. Results of those studies noted that the most commonly used tools were general search engines and video channels, whereas podcasts, newsletters, RSS readers, and microblogging were used less frequently [20].
Content generation tools and strategies are another PLE component. Nowadays, students have an enormous range of applications (many of which are free) for creating their own content. In this regard, the multiplicity of resources allows skills to be developed which are related to reflection, summarizing ability, structuring ideas, and creativity, among others [15]. Given the individual nature of PLEs, there are no absolutely required tools for them; however, some studies [23,24] refer to resources such as blogs, wikis, and social networks, among others, as useful resources for developing PLEs. Other studies [21,25,26] indicate that this component (focused on content creation) is less well-developed in university student PLEs due to students not being aware of many web 2.0 resources, as well as the use of traditional desktop tools that make interaction, collaborative working, and rapid content diffusion difficult [25].
Lastly, the most social component of PLEs is about sharing information and interacting with other users [27]. In this regard, the nodes that can be created between various connection options are important, giving rise to personal knowledge networks (PKN) which transcend formal education, and provide autonomous, lifelong learning [28]. As with the previous components, there are many resources that allow interaction, exchange of content, and collaborative learning [5,29]. Previous studies have indicated that the most commonly-used tools for communication and publishing focus on social networks and video channels [30], particularly via mobile phones [31], although they also note that the use of these tools is not necessarily linked to formal education or educational aims [32].

Higher Education and PLE
As noted above, PLEs support self-directed and lifelong learning, and one characteristic of this educational approach is the decentralization of learning from the higher education institute towards the student [33]. PLEs can be included in formal and informal educational settings; however, right from the start, they can lead to a path that means including ICT through appropriate teaching design [8] which benefits various subject curricula and has a positive impact on the students.
Various studies have linked the use of ICT with academic performance, with students making more frequent and effective use of it having higher grades [34]. Similarly, [35] related talented students with familiarization with digital data, along with the conscious design of their PLEs, characterized by interest in sharing and discussing their knowledge during the educational process. However, the construction and development of PLEs is not without obstacles which may be technical or pedagogical [8]. Students need new skills and abilities [36] to make the most of the potential of ICT in their PLEs, and these skills may be affected if the students do not see the benefits, or if their teachers lack training [7,22].
In addition, some studies have warned that traditional mediation strategies in the teaching/learning process in formal settings, and particularly universities, may be at the detriment of student PLEs due to poor inclusion of ICT [37]. In contrast, there is a range of ICT possibilities that can complement formal education which may be realized via the development of PLEs, characterized by being practical, open, dynamic, and allowing socialization and collaborative working [18].

Methodology
This study is part of a broader project analyzing PLEs in university students. The study was undertaken from a quantitative perspective. We used a non-experimental [38], transactional design, as we did not manipulate variables, and data were collected at a single timepoint [39].

Objective and Hypothesis
Bearing in mind the above, our overall study objective is to analyze Costa Rican university students' PLEs based on the tools they use in the context of higher education in each of the PLE components (accessing information, content creation, and communication). We hypothesize the following: 1.
There will be significant differences with respect to sex in the frequency of ICT use in each of the PLE components.

2.
Education in ICT will produce significant differences in the development of student PLEs.

3.
There will be significant differences in student academic performance in accordance with the development of PLEs.

Population and Sample
The overall population (N = 3165) comprised final-year university students carrying out either bachelor's or licentiate degrees at the Costa Rica National University (UNA) on the Omar Dengo and Benjamin Núñez campuses.
The sample (n = 1187) was stratified and probabilistic [39], with the strata being the faculties making up the UNA. To calculate the sample, we used the finite population formula [40]: error 3%, 95% confidence level, and the expected proportion (p = 5%). We also considered representativeness, gathering data from 51 courses in the seven knowledge areas in the UNA.
The age of the students in the sample ranged from 20 to 57 years old, with a mean of 24 years (SD = 4.18). Almost two-thirds (64.1%) were women; the remaining 35.9% were men. In terms of academic performance, 30.0% had never failed a course and had a mean grade over 9; 26.6% had never failed a course but had a mean grade below 9; and 43.5% had failed at least one course.

Data Collection Instruments and Techniques
We used a survey to collect data via a questionnaire created ad hoc following a thorough review of the literature and bearing in mind the theoretical and methodological guidelines for creating these types of instruments [41]. The instrument was constructed in different blocks of closed questions. In this study, we present data from the block related to ICT in formal education, which had 30 Likert-type items measuring the three PLE components: finding, creating, and sharing information. Each item had 5 response options (from 1 = never to 5 = always). Internal consistency testing via Cronbach's alpha gave a coefficient of α = 0.83.

Procedure and Data Analysis
To ensure content validity, we submitted the questionnaire for expert validation. It was reviewed by 20 professionals in higher education, research methodology, and educational technology. Based on their assessment, we created the first version of the scale. That was submitted to a pilot study with 45 students with similar characteristics to the final sample. The results of that test allowed us to confirm that the scale functioned in that context. A printed version of the questionnaire was given out in classrooms, and students were given 20 min to complete it. The first page of the instrument informed students of the research objectives; the procedures for handling data; and the voluntary, anonymous, and confidential nature of the study, as well as informing them that they could drop out of the study at any time without giving any explanation. As they were all adults, we obtained oral informed consent, and them handing in the completed questionnaire implied their consent for us to use the data for the study objective.
Once we had collected the information, we produced a database using SPSS v.21. We performed descriptive tests about position and distribution. Following that, we carried out Pearson correlations between the study variables. Finally, we performed comparisons between groups using MANOVA, ANOVA, and the Student t test, following confirmation of normality (using the Kolmogorov-Smirnov test for different groups) and equality of variance (using Levene's test).

Descriptive Analysis of the ICT Tools in Formal Learning Scale
First, we calculated statistics of central tendency and distribution of the items making up the scale (Table 1). In the accessing information component, the most often-used tools were general search engines with a mean  Note: n = 1187; response options 1 = "never"; 2 = "almost never"; 3 = "occasionally"; 4 = "almost always"; 5 = "always"; M = mean; SD = standard deviation. We calculated Pearson correlations between the overall scale and the components. Table 2 gives the coefficients, which were positive and high, ranging between 0.57 and 0.87. With regard to internal consistency, Cronbach alpha coefficients were satisfactory. Finally, it is worth noting that the highest scoring component was information access (M = 3.34; SD = 0.62), followed by sharing information (M = 3.04; SD = 0.59), and lastly content generation (M = 2.97; SD = 0.59). The mean in the overall scale was M = 3.00 (SD = 0.50). Note: ** The correlation is significant at the level of 0.01 (bilateral). 1 = "access"; 2 = "creation"; 3 = "sharing"; 4 = "overall scale"; Alfa = Cronbach alpha coefficient; M = mean; SD = standard deviation; Sk = skewness; Rku = kurtosis.

Analysis of Sex-Related Differences in the Use of ICT
We used the Student t test to identify sex-related differences in the use of ICT. We first tested normality, using the Kolmogorov-Smirnov test (p > 0.05) for both groups (men and women), and the equality of variance using Levene's test (p value > 0.05). As Table 3 shows, women had higher mean scores, with significant differences in the overall scale and its three components.

Analysis of Differences Related to the Variable Education in ICT
The majority of students (80.9%) reported having carried out specific courses in ICT, while 19.1% had not. Of those who had received ICT training, 38% had done so as part of their degree curriculum, while the other 62% had done so in informal settings. Only 13.4% reported having carried out a virtual course, formal or otherwise.
First, we tested normality using the Kolmogorov-Smirnov test, giving a non-significant "p" level (p > 0.05) for the two groups (with and without ICT training). We also performed Levene's test (p-value > 0.05) to test the equality of variances. The results of the Student t test (Table 4) comparing the means between groups showed that students who had previously been educated in ICT had higher scores in the overall scale as well as in each of the components. This confirms that there were differences in the use of each of the PLE components with regard to the variable education in ICT.

Analysis of Differences in the Use of ICT in Higher Education in Relation to the Variable Academic Performance
We performed a unidirectional multivariate analysis of variance between groups to examine the differences in students' academic performance (independent variable) in regard to the ICT use scale, using the components of that scale as the dependent variables. Before carrying out the MANOVA for the academic performance variable, we examined the homogeneity of covariance using Box's M test, the result of which (Box M = 247.9 F = 12.3 p = 0.000) showed that the assumption was not met. Due to that, we chose to use Pillai's Trace to analyze the multivariate significance of the main effects, following the recommendations from [42]. The MANOVA showed a significant main effect for academic performance: Pillai's Trace = 0.064, F (8,2346) = 9.727, p = 0.000, η2 = 0.032. Subsequent univariate ANOVA tests demonstrated that students who had not failed any courses and who had mean grades above 9 scored significantly higher in the use of ICT (F (2,1175) = 29.65, p = 0.000) than those who had not failed any courses but had mean grades below 9, and those who had failed courses. We found the same for each of the components: accessing information (F (2,1175) = 6.506, p = 0.002), content creation (F (2,1175) = 30.73, p = 0.000), and sharing information (F (2,1175) = 6.438, p = 0.002). As Table 5 shows, we found differences in both the overall scale and each of the PLE components. The results show greater use of ICT resources by students who have mean grades above 9 than either of the other two groups.

Discussion and Conclusions
Bearing in mind the changes in educational processes from the inclusion of ICT [1,2], it is important to analyze the PLEs of university students-who will soon be joining the labor force-to understand the contribution of higher education. In this regard, developing PLEs can stimulate and strengthen skills that modern society needs [3,36], in addition to what it can contribute to various areas of society [4].
Our results show how university students use different tools in their PLEs during the formal learning process during higher education. Students had moderate scores in the overall scale, in line with indications from some authors [7] about the use of ICT in higher education not necessarily leading to improvements to the educational process [32]. In this regard, it is necessary for the university to encourage the development of PLEs via designs that include strategies, tools, and emerging theories [8], and which also facilitate autonomous, lifelong, and life-wide learning [10,11].
Specifically, we found the highest scores in the accessing information component, although they were moderate, in line with other similar studies [21,22]. The most commonly-used tools were general search engines, advanced search engines, and video channels, while the least-commonly used were MOOCs, information management applications, and institutional archives. This is consistent with the results of previous studies [20]. The lack of awareness and scant use of resources such as podcasts, newsletters, RSS readers, or professional networks shows that students were not making the most of the potential of ICT in searching for and accessing information in higher education. This is an important aspect considering the vast amount of information available to students, the many formats that align with different learning styles [19], and the need to filter and manage it in order to properly incorporate it into the learning process [18].
Content generation produced the lowest scores, as previous research has also reported [21,25,26]. This may be detrimental to activities within the PLE such as reflection, summary, creativity, and organization [15], and is something that should be reinforced in formal educational settings. Within content generation, the most commonly-used resources were text processors, applications for producing presentations, and resources for collaborative working. Little-used resources included digital task management and programs for management and analysis of data. Although PLEs are characterized by being flexible, dynamic, and individual, some authors [23,24] have suggested resources that would facilitate their construction and reinforcement. It is notable how students only used web 2.0 resources aimed at creating collaborative content, and were much more likely to use desktop resources that make it harder to share information or interact with other users, which is in line with findings from other studies [25]. This may be reinforced by traditional higher education practices in which ICT hardly features [37] despite the many possibilities it offers.
As with the other components, we found moderate scores in sharing information, something which affects the social structure of PLEs [27]. Students were not making the most of the strengths of ICT for interaction and exchange of content, with the idea that no one learns alone, and they were failing to take advantage of collaborative learning opportunities [5,15]. The most commonly-used resources were email managers, and resources aimed at cloud storage and information exchange, and mobile applications, which is similar to results from other studies [30,31]. The scant use of social bookmarking, microblogging, and professional networks may negatively affect the creation of PKNs [28] outside the university setting. This may lead to stagnation of students' autonomous learning in the different areas of performance [13].
Our analysis confirmed all of our hypotheses. In terms of sex, there were significant differences in the frequency of use of ICT tools in each of the PLE components, with women making more use of them. This finding supports the results of other similar studies [43]. However, it is important to highlight what is more controversial from our analysis in the face of a lack of conclusive studies, and the conflicting results in that regard.
Our data analysis confirmed that education in ICT produced significant differences in students' PLEs. More specifically, students who had received some training in ICT scored higher in the overall PLE scale and in each of the components. The competencies needed to effectively use ICT are changing as the tools proliferate [36], especially web 2.0 and the semantic web 3.0 [37]. Given that, and as long as higher education does not integrate open, flexible strategies with study plans [18], it becomes necessary to provide training through specific courses which address technical, and particularly pedagogical, aspects [37].
There were also significant differences in students' academic performance according to the development of PLEs. Students who made more use of ICT in their PLEs had higher mean grades. This is in line with findings from other studies [34,35] which also note the importance of conscious construction and development of PLEs, and that their potential lies, beyond the resources used, in a comprehensive, pedagogical approach to the idea [15,37].
It is worth noting that to address some of the limitations of this study, it would be useful to broaden the sample to other universities and higher education institutions in Costa Rica, and even to extend the research to other countries, to allow comparisons to be made. It would also be interesting to implement a longitudinal study that would allow us to see how student use of ICT tools changes over time in formal learning environments. In addition, complementing this study with a more qualitative study would allow us to triangulate data, producing richer, more valid results.