Education is one of the most pivotal services in societal development as it cultivates a wide variety of skills, especially numeracy and literacy skills. However, students may have varying masteries of these two aptitudes. Some attribute this to students’ intrinsic efforts while others attribute this to students’ capabilities and affiliated environments. In this work, I explore the numeracy and literacy aptitude patterns of students from various cultures based on a dataset that contains various demographic information, from which I deduced some preliminary trends. After the comparison of numerous machine learning algorithms, the optimal algorithm or combination of a few algorithms predicts students’ performances by classifying students of different backgrounds into various potential outcomes. The results suggest that proper resources and supports are necessary for enhanced learning.
At school, subjects like math, reading, and writing constitute numeracy and literacy skills, which are fundamental in people’s everyday life. Numeracy skills enable people to think critically, calculate, and thus, make decisions [
Good students usually share some characteristics. For instance, most of them are self-disciplined, allowing them to handle their course works. They are generally responsible as well, making them reliable people. Therefore, other factors, which may not be as simplistic as singular traits, might similarly impact students’ learning outcomes. To find out about this potential phenomenon, a dataset of ten thousand public school students’ information is used [
In order to systematically approach this task, my work incorporates machine learning. As a popular tool frequently utilized for all purposes, machine learning benefits analysis by holistically treating all data inputs with a standardized set of criteria. One of its most prominent advantages in this project is its ability to handle multi-dimensional data [
Each student, who will have a data value in each factor, is a data point, and to classify, a student will be drawn based on the training data to a group of data points that they are similar to. As a result, several most commonly used supervised classification algorithms and ensemble methods are used. Whereas some algorithms, such as K-Nearest Neighbors (KNN) and Support Vector Machine (SVM), work independently, others are ensemble learning methods, including Gradientboosting and Voting Classifier. The models are compared under different tasks by their confusion matrix and accuracy scores. Each kind has its unique advantage due to the different mechanisms and thus, is useful in the project.
Along with the predictive power of the project, exploratory analysis of subgroups of different factors reveals certain patterns of how learning is impacted. People in some subgroups do have an edge over others in learning, confirming the trend people have suspected. For instance, females have generally higher literacy levels. Despite that there are far more complex conditions behind the mere factors intertwining students’ comprehensions, the discovered patterns could be good starting points and should be carefully considered.
The rest of the paper is organized as follows: Section 2 details the designs, results, and inquiries as well as the machine learning algorithms. Section 3 presents several related works to my project to draw parallels. Finally, Section 4 concludes the remarks of this research.
Boran Sekeroglu et al. [
Abdelmajid Chaffai et al. [
Nikola Tomasevic et al. [
As aforementioned, numeracy and literacy skills are indispensable in almost every aspect of people’s daily lives. However, not all students can competently understand the relevant knowledge. Thus, for students, especially those needing assistance, to improve the two skills, mechanisms of efficient studying should be explored. Prominently, good students’ social-cultural backgrounds provide them exclusive resources in addition to in-school support that’s also available to those in need.
The dataset includes valuable information for this investigation. The subgroups of each cultural factor are as follows: Gender (Male/Female), Ethnicity (Group A-E), Parents’ Education Level (Some High School/High School/Associate’s Degree/Bachelor’s Degree/Master’s Degree), Lunch (Standard/Reduced Quality), and Test Preparation Course (Completed/None).
Due to the inherent limitation of the dataset, students’ performances on exams—math, reading, and writing scores—are the references to infer numeracy (Math) and literacy (Reading + Writing) skills.
To comprehensively examine the influences of different subgroups, the exploratory analysis is divided into subsections of inquiries.
As the first inquiry, finding the general trend gives a standard to judge students’ scores for the following steps.
As shown in
Thus, students generally have better literacy skills than numeracy skills. There are also students that significantly study worse than others.
Part of our hypothesis acknowledges the different influences subgroups have on learning. Total scores are the metric to begin with.
As shown in
As shown in
Thereby, a higher parental education level is the most conducive to overall aptitude development.
Similarly, students’ overall aptitude level positively correlates with ethnicity group letter (with the mean scores of students in Group C and higher above all students’ mean score), lunch quality, and test preparation course participation.
While the overall aptitude level is explored, how the subgroups affect each subject is equally important, if not more. Finding the better subgroups at each subject helps determine the most efficient improvement method.
As shown in
However, not all subject score patterns among the two genders follow the total score patterns.
As shown in
Thereby, males should be models in math while following how females learn reading and writing. Males as an entire group may also emulate how females score consistently.
Subject score trends among subgroups of other demographic factors are consistent with the total score trend among them.
In education, two goals are almost the most significant ones pursued: developing elite students and the least, equipping everyone with basic knowledge. Elite students would become the most competent to innovate for society while others,
who have enough knowledge to perform certain jobs, could contribute to society by realizing the innovations. As a result, both groups are resources integral to development. The demographic status of both groups is explored for students in need to refer to. In my work, elite students are defined as those scoring 90% or higher while the passing cutoff is 60%.
Further confirming the trends previously discussed, the trends at the two thresholds provide more details. A commonality between all trends in this inquiry is that in the same score area, students in subgroups that are more advantaged to become elites are also more advantaged to have the basic knowledge. Moreover, the extent that subgroups affect students is greater in excelling than in passing each subject.
For instance, comparing the reading scores of two genders, females have an almost three times higher likelihood to earn a high score (as shown in
Besides, as shown in
Lastly, lunch turns out to have even more significant subgroup differences. As shown in
Therefore, certain demographic status does increase students’ likelihood to both pass and, particularly, excel in an aptitude.
In this paper, several machine learning algorithms are implemented to either determine the significance of each factor or, more importantly, predict every student’s learning outcome.
To start with, Principal Component Analysis (PCA) is a dimensionality reduction method that maintains as much information as possible [
Additionally, numerous classification algorithms are incorporated—including K-Nearest Neighbors (KNN), Support Vector Machine (SVM), Decision Trees, Random Forest Classifier (RFC), Gaussian Naive Bayes (GNB), Gradient Boost Classifier (GBC), and Voting Classifier.
KNN is a supervised machine learning algorithm that can perform classification and regression [
SVM is a classic supervised machine learning algorithm that helps classification. Data points are mapped out in a high-dimension space, and a decision surface is constructed to classify the input data.
Decision Trees is a classification model that makes decisions based on possible consequences from a tree-like flow model [
RFC is an ensemble learning method that can deal with classification problems [
GNB is a supervised classification algorithm based on the Bayes Theorem, specifically assuming a Gaussian distribution [
GBC is another ensemble method, which builds on many predictive algorithms. It modifies weaker methods and creates a new decision mechanism.
Voting Classifier is also an ensemble method and allows customized machine learning algorithms in the parameter for prediction. The decision is the highest probability output from the input algorithms chosen by the majority vote. In this paper, Voting Classifier consists of the aforementioned algorithms.
In training and testing each model, a 10% testing ratio is applied, and accuracies along with confusion matrixes are generated. Accuracy is calculated by (TP + TN)/(TP + TN + FP + FN) × 100%, where TP and TN are True Positive and True Negative, and FP and FN are False Positive and False Negative.
In this paper, the two principal components account for 88.7% of the variance, as shown in
In theory, PCA would compensate accuracy for simplicity. However, in my work, PCA, applied with 90% of the variance, does not have much lower accuracies and even, in some cases, has higher accuracies. Thus, PCA is useful tool in providing insights and predictions.
As shown in
Interestingly, the confusion matrixes of the same model with and without PCA complement each other; the same model with PCA may predict more TP in one class than it without PCA may.
| Algorithms | Without PCA | With PCA | ||
|---|---|---|---|---|
| Accuracy | Confusion Matrix | Accuracy | Confusion Matrix | |
| KNN | 59.6% | [ 281 43 21 105 223 67 42 126 92 ] | 59.6% | [ 281 43 21 105 223 67 42 126 92 ] |
| GNB | 61% | [ 307 30 8 133 199 63 47 109 104 ] | 61% | [ 307 30 8 133 199 63 47 109 104 ] |
| SVM | 60.9% | [ 305 31 9 132 199 64 46 109 105 ] | 62% | [ 294 43 8 109 226 61 40 119 101 ] |
| Voting Classifier | 61.5% | [ 298 39 8 119 222 54 42 124 94 ] | 61.5% | [ 298 39 8 119 222 54 42 124 94 ] |
| Decision Trees | 61.8% | [ 294 42 9 111 224 60 43 117 100 ] | 61.8% | [ 294 42 9 111 224 60 43 117 100 ] |
| RFC | 61.9% | [ 294 42 9 110 224 61 43 117 100 ] | 62% | [ 294 42 9 109 224 62 42 115 103 ] |
| GBC | 62.2% | [ 291 47 7 111 221 63 41 109 110 ] | 62.2% | [ 291 47 7 111 221 63 41 109 110 ] |
| Algorithms | Without PCA | With PCA | ||
|---|---|---|---|---|
| Accuracy | Confusion Matrix | Accuracy | Confusion Matrix | |
| KNN | 71% | [ 563 114 176 147 ] | 71.4% | [ 560 117 169 154 ] |
| GNB | 71.1% | [ 585 92 197 126 ] | 71.1% | [ 585 92 197 126 ] |
| SVM | 72% | [ 613 64 216 107 ] | 71.3% | [ 577 100 187 136 ] |
| GBC | 72% | [ 569 108 172 151 ] | 72% | [ 569 108 172 151 ] |
| Voting Classifier | 71.6% | [ 631 46 238 85 ] | 72.1% | [ 591 86 193 130 ] |
| RFC | 72.7% | [ 576 101 172 151 ] | 72.6% | [ 577 100 174 149 ] |
| Decision Trees | 72.8% | [ 579 98 174 149 ] | 72.8% | [ 579 98 174 149 ] |
Moreover, whereas some models overall better fit for some prediction areas, other models have their own advantages. For example, despite that GBC with PCA has higher accuracy than RFC with PCA (
After training and selecting the best models, predictions are made in five areas—students’ best subject, learning outcome in math, reading, and writing, and overall aptitude level—for every student. As the outcomes of this project, the predicted status in each area acts as a reference for everyone since one can compare himself/herself to the one in my project. Everyone can find a place in the results because predictions are made for every possible, unique background, which is found by the permutation tool itertools.
The prediction results align with the findings identified in the previous section. If students’ background is mixed with the more advantaged subgroups and the less advantaged ones, the larger number of advantaged subgroups there are, the more likely the student learns better.
Therefore, even though the prediction model is not perfect, students can have a general idea of their performance level and adjust accordingly. As a rule of thumb, all students should participate in test preparation courses and have standard lunch; in both aptitudes, those two qualities generally lead to better results. For the other three inherent factors, there are some controllable actions students can take. Students could learn from the better subgroups and mimic their behavior. For instance, Group E is well-performing in all subjects. If Group E has a certain study schedule, students in other groups should adapt themselves to that schedule as appropriate. Similarly, other characteristics can be observed and practiced accordingly to enhance learning.
In this paper, the influence of the students’ demographic backgrounds on their math, reading, and writing—which reflect students’ numeracy and literacy aptitudes—is examined through data exploration. The findings confirm the general trends in society. For example, females have better literacy aptitude while males have better numeracy aptitude. Students of the ethnicity of a higher letter with a higher level of parental education, lunch, and test preparation course participation are more likely to both pass and excel in all courses and thus, are more likely to have better numeracy and literacy aptitude. Those students as a whole also have less variation in their scores than other students do. More importantly, two of the inherent factors—ethnicity and parental education level, are the most principal in influencing one’s learning, despite that the exact rationale behind the discovered phenomenon is not clear.
To predict students’ aptitudes, GBC, GNB, Decision Trees, and SVC are the best in their respective areas, achieving accuracies of near 70%.
Future works are essential to refine the methods for students to improve. One of the principal jobs is exploring the learning environments of students in better subgroups. This may involve social complexions that are beyond the mere factors and helps execute the actions for improvement. For example, certain subgroups are more privileged; females have more access to test preparation courses than males do, as indicated by the positive correlation between gender and test preparation course in the PCA biplot. Similarly, students of parents with higher education levels are more likely to have standard quality lunches. If the education systems and societies that students in need are from can cater to their students by offering an environment privileged students enjoy, students could best eliminate their gaps.
In addition to intra-factor investigations, inter-factor research is also valuable. Indeed, some subgroups of a factor may be more advantaged in an aptitude, but what makes those subgroups more advantaged requires field experiments. For instance, students of parents with Master’s degrees are more likely to succeed. However, it is not that degree but the parents’ certain qualities that better the children’s learning. Once the causal relationships are found, students can benefit from leveraging the conducive qualities of bigger factor subgroups even if they are not in the prime subgroups identified in this paper.
Lastly, the accuracy of the machine learning models can be further polished. While accuracies of around 60% - 70% can be acceptable, they should certainly be improved considering if used on a bigger population, the large number of people that may have a false benchmark to refer to. To modify the models, perhaps finding a dataset of more data points and social-economic information may be beneficial. A bigger dataset usually allows models to have more inputs to learn from, and more social-economic information helps models to make more definitive predictions. At the same time, experimenting with alternative models to current ones may help as certain models may be better fits to tackle the problem.
The research presented in this paper is done with guidance from Dr. Yang Lan, a computer science professor at California Polytechnic State University, and Dr. Kong Liang, a postdoctoral researcher from the University of Kentucky.
The author declares no conflicts of interest regarding the publication of this paper.
Li, T.Y. (2022) Students’ Numeracy and Literacy Aptitude Analysis and Prediction Using Machine Learning. Journal of Computer and Communications, 10, 90-103. https://doi.org/10.4236/jcc.2022.108006