Meteorological data is useful for varied applications and sectors ranging from weather and climate forecasting, landscape planning to disaster management among others. However, the availability of these data requires a good network of manual meteorological stations and other support systems for its collection, recording, processing, archiving, communication and dissemination. In sub-Saharan Africa, such networks are limited due to low investment and capacity. To bridge this gap, the National Meteorological Services in Kenya and few others from African countries have moved to install a number of Automatic Weather Stations (AWSs) in the past decade including a few additions from private institutions and individuals. Although these AWSs have the potential to improve the existing observation network and the early warning systems in the region, the quality and capacity of the data collected from the stations are not well exploited. This is mainly due to low confidence, by data users, in electronically observed data. In this study, we set out to confirm that electronically observed data is of comparable quality to a human observer recorded data, and can thus be used to bridge data gaps at temporal and spatial scales. To assess this potential, we applied the simple Pearson correlation method and other statistical tests and approaches by conducting inter-comparison analysis of weather observations from the manual synoptic station and data from two Automatic Weather Stations (TAHMO and 3D-PAWS) co-located at KMD Headquarters to establish existing consistencies and variances in several weather parameters. Results show there is comparable consistency in most of the weather parameters between the three stations. Strong associations were noted between the TAHMO and manual station data for minimum (r = 0.65) and maximum temperatures (r = 0.86) and the maximum temperature between TAHMO and 3DPAWS (r = 0.56). Similar associations were indicated for surface pressure (r = 0.99) and RH (r > 0.6) with the weakest correlations occurring in wind direction and speed. The Shapiro test for normality assumption indicated that the distribution of several parameters compared between the 3 stations were normally distributed (p > 0.05). We conclude that these findings can be used as a basis for wider use of data sets from Automatic Weather Stations in Kenya and elsewhere. This can inform various applications in weather and climate related decisions.
Meteorological data is useful for varied applications across many socio-economic sectors. They can be used in weather and climate forecasting, disaster risk reduction and water resources management, landscape planning, and many others. However, the availability of meteorological data requires a good network of manual observation stations at the surface, upper-air, and on the ocean as well as other support systems which facilitate the collection, recording, processing, archiving, and other data management operations. In sub-Saharan Africa, such networks are limited due to low investment and capacity (Dupar et al., 2021). Such situations constrain the development, provision, and maintenance of quality climate services and their application.
In Kenya and the East African region, meteorological data is a very important resource considering that weather and climate variability are driven by several global influences including the El Niño and La Niña phenomena in the tropical Pacific, the Congo air mass, the Inter-Tropical Convergence Zone, the Indian Ocean temperatures and local climatic-factors such as the lake circulation effects among others (Marchant et al., 2007; Berhane & Zaitchik, 2014) which require regular monitoring and evaluation. The region has had its fair share of severe weather and extreme climate impacts such as flooding, hailstorms, droughts which have caused loss of human life, and other adverse socio-economic and environmental impacts. To monitor and evaluate the weather patterns in Kenya, the National Meteorological Service (KMD) operates and controls 40 Synoptic Stations spread across the country (
recommended practice regarding the spacing between neighboring stations of 20 km. Although the KMD has in the last few years installed a number of Automatic Weather Stations (AWS), the data is not yet fully integrated into meteorological applications or shared globally through the Global Telecommunication System (GTS) of the World Meteorological Organisation (WMO) as required. This is mainly because the quality of the AWS datasets is not yet well known.
Most studies have carried out inter-comparisons of meteorological data but focused more on satellite based weather parameters and gridded data (Ayasha, 2021; Rivoire et al., 2021; Schumacher et al., 2020; Ford & Quiring, 2019; Zeng et al., 2018). These have largely ignored the significant biases that can be addressed by data from Automatic weather stations relative to surface observation stations.
The key advantage of comparisons between ground station observations and datasets from AWSs is that the datasets can provide more coverage in time and space and hence a better description of the weather and climate of a given area. Further, since ground station observations may have some uncertainties (especially when some data are missing) comparing with AWS data may bridge the gap and hence improve its quality and use. This study, therefore, provides the means to enhance the quality and quantity of available observational datasets through the calibration of the AWS data leading to improvements in early warning services. Recently in 2019, the WMO’s HIGH Impact Weather LAke SYstem (HIGHWAY) project funded by the United Kingdom (UK) Department for International Development (DFID) have been promoting early warning systems (EWS) to improve resilience to weather and climate extremes for the local communities around the Lake Victoria region by exploring the potential of using AWS data sets in Kenya.
Within the above context, this study aims at 1) Inter-comparison of the ground based observational data sets (rainfall, temperature, wind speed and direction, surface pressure, and relative humidity) from a KMD synoptic weather station with data from the Trans-African Hydro-Meteorological Observatory (TAHMO) AWS and the 3D-Printed Automatic Weather Station (3D-PAWS), co-located at KMD; 2) Carrying out inter-comparison of data between the two AWSs (TAHMO and 3D-PAWS).
This study is organized as follows. Section 2 describes the data sets used in the study including details of the study area. In section 3 statistical methods used in the analysis and comparison of the different data sets are presented. The results from the analyses are given in Section 4 while the discussion of the results is in Section 5.
The datasets used in this study are from the Dagoretti Corner Meteorological Station which is located in Nairobi Kenya. All three stations are located in separate sites within the Meteorological Station compound. The manual synoptic weather station is located at Lon. 36.75˚E and Lat. 1.3˚S. The TAHMO AWS is at Lon. 36.7602˚E and Lat. 1.3018389˚S. The 3D-PAWS AWS is located at Lon. 36.7601˚E and Lat. 1.30172˚S. The three stations are located at an average altitude of 1790 m above mean sea level. The geographic positions of the AWSs and the synoptic weather stations clearly show that these stations are more or less collocated.
The weather regime of the study area is semi-humid tropical with average annual rainfall of 1060 mm mean annual temperature of 17.8˚C, and maximum temperatures reaching about 25.5˚C. The rainfall distribution is bimodal occurring in two seasons: March-May (long rains) and October-December (short rains) season. The January-February period is generally dry while June-September is cool and dry with occasional rains.
The data sets used in this study are from the manual synoptic weather station, TAHMO AWS and the 3D-PAWS at the Dagoretti Corner Meteorological Station in Nairobi. The manual synoptic station data sets of daily rainfall, daily temperature at 06Z and 12Z, daily minimum and maximum temperature, daily relative humidity, hourly wind speed, hourly wind direction, surface pressure and solar radiation were acquired from the National Climate Database at KMD. Thus the data observations from the manual synoptic weather station are on daily and hourly intervals. The TAHMO observations were obtained from KMD and are at 5 minutes intervals while 3D-PAWS observations at 1-minute intervals were obtained from the University Corporation for Atmospheric Research (UCAR).
Quality controls and checks were carried out on the data from the three sources and examined for consistency. Subsequently, the parameters selected for the comparative analysis were Rainfall, Temperature, Pressure, Relative Humidity, Solar Radiation, Wind speed and Direction. The data used in the analysis covered the period 2016 to 2018 and part of 2019.
Data sets for all the parameters from the manual station were prepared in a single “.csv” file with daily values in a cross tab format while the TAHMO data were organized in five-minute values in a list in multiple files summarized in one “.csv” file per day. The 3D-PAWS data in ASCII format were stored in separate files for each sensor (e.g., humidity and temperature, rainfall, wind direction and speed, and surface pressure) with a resolution of 1-min records. All the AWS data from 3D-PAWS and TAHMO were processed to match the temporal resolution of the manual station by aggregating the minute and hourly data into daily values using the R-statistical software (R Core Team, 2017) and Excel. To enable the analysis, the specific parameters were prepared as follows.
To match the daily observation period (24 hours) of the manual synoptic weather station, the rainfall data from TAHMO and 3D-PAWS were accumulated to daily values starting from 0600Z of the current day to 0600Z of the next day and cast back by one day.
The observed surface pressure from the manual synoptic station is at hourly timescale and therefore the AWSs surface pressure data from TAHMO and 3D-PAWS were processed to extract the observation from the top of each hour to match the observation time of the manual synoptic station.
The manual synoptic weather station data were at 0600Z and 1200Z and therefore AWSs observations from TAHMO and 3D-PAWS were matched for the 0600Z and 1200Z times to match the observations from the manual synoptic weather station.
The hourly manual synoptic weather station daily total radiation data were not considered in the analysis since they could not be matched with the observations from the 1-minute and 5-minute temporal resolutions from the 3D-PAWS and TAHMO stations.
The wind speed data for the manual synoptic weather station was at the hourly time stamp and hence the AWSs data from TAHMO and 3DPAWS were matched at the top of each hour with the manual synoptic station observations. However, due to its structure, the 3D-PAWS data were aggregated to average the 10-minute observations before the top of the hour so as to match the procedure used for the manual observations.
Similar to other hourly data sets the wind direction data from the manual synoptic weather station were matched with the AWSs data from TAHMO and 3D-PAWS at the top of the hour. The 3D-PAWS data were also processed to match the manual observations using similar procedure as that of the wind speed.
The dry bulb temperature data from the manual synoptic weather station were at 0600Z and 1200Z where maximum (Tmax) and minimum (Tmin) temperature data were extracted as single values for each day. To match, the AWSs temperature observations from TAHMO and 3D-PAWS were extracted at 0600Z and 1200Z on each day of the inter-comparison. Similar to solar radiation, the AWSs Tmax and Tmin were extracted from the 1-minute and 5-minute temperature values from 3D-PAWS and TAHMO, respectively for any given day. However, the Tmax and Tmin values for the TAHMO and 3D-PAWS were only extracted and matched with the manual data if a complete record was available for a given day.
Missing data were not indicated after the initial extraction of the different parameters from the 3 data sources, leading to data sets of varying lengths. To correct this, identification and insertion of gaps were done in all the parameters until they all had equal lengths. However, the rainfall data from the manual synoptic station was in a cross tab table format (
Further, the 3D-PAWS data files were in “.xml” format which was converted to the “.csv” format prior to extraction and aggregation. In addition, the 3D-PAWS data posed some challenges in aggregating and selecting the right values since they contained multiple values for each top of the hours. This led to
the 3D-PAWS data being reprocessed into consistent, continuous ASCII formatted files that included missing records and bad data flags. Once this was achieved, it was possible to consistently compare the reformatted 3D-PAWS data (see
To address the objectives of this study, we used several statistical methods to assess and carry out inter-comparison analyses. Graphical methods were used to visualize the data through line and scatter plots. To visually define a matching point between the different distributions of a data series from the three data sources, we checked on concurrent points that did not overlap. To gain better comparisons, each variable (e.g. rainfall) was plotted for all the three sources (TAHMO, 3D-PAWS and Manual) on one graph.
We used the simple Pearson correlation method to assess the strength of association between the variables from the three sources (Zou et al., 2003). The Pearson correlation method measures the linear correlation between two variables X and Y using the correlation coefficient (r) and is given by the equation:
r X Y = N ∑ X i Y i − ∑ X i ∑ Y i N ∑ X i 2 − ( ∑ X i ) 2 N ∑ Y i 2 − ( ∑ Y i ) 2 (1)
where, rXY or r is the correlation coefficient, N is the number of observations, and ΣX is the sum of x scores (values), ΣY is the sum of y scores (values), while ΣXY is the sum of the products of x and y values. The values of r range between +1 and −1, with 1 showing that there is a perfect/positive linear correlation, 0 showing no linear correlation, and −1 showing there is a negative linear correlation. The higher the value of r is, the stronger the association between two variables.
We tested the statistical significance of the correlation coefficients (r) using the Shapiro-Wilk normality test (Emerson, 2015) and the Anderson-Darling normality test (Liebscher, 2016). Shapiro-Wilk’s method is based on the correlation between the data and the corresponding normal scores and is widely
used and recommended for normality tests because it provides better estimates compared to the Kilmogorov-Smirnov method. However, the Anderson-Darling method is efficient in analysis of samples with N > 5000 compared to the Shapiro Wilk method (N < 5000).
These normality tests are done with the assumptions that for a test that is not significant it satisfies the condition of the null hypothesis for normally distributed sample (p value > 0.05). Alternatively, if the test is significant, the distribution is considered to be non-normal. All correlations are considered to be significant at the 0.05 level.
To support the analysis of normality tests we used the graphical method to visualize the associations between the variables.
In particular, we used Q-Q (quantile-quantile) plots to assess how best the compared data set samples associated with the normal distribution. Overall, we summarized and dispalyed the coefficients from the comparisons using a correlation matrix.
Lastly, we used regression method to estimate the best line of fit from the correlations between the variables from the three data sources.
The initial analysis of the 3 datasets for the period 2017-2018, indicated that there was good agreement between the temperatures readings of the manual station and TAHMO but comparatively lower agreement with the 3D-PAWS. Comparisons for rainfall and relative humidity were largely variable. One reason for this might be that the TAHMO AWS had a broken rain-gauge sensor, for a brief period between 2017 and June 2018.
Modestly higher correlations were observed for the minimum temperature between TAHMO and manual station (r = 0.65) and for the maximum temperature (r = 0.61 to r = 0.86) (
The Shapiro Wilk normality test showed that the distributions of the minimum and maximum temperatures are not significantly different from normal distribution and hence normally distributed (p-value < 0.05). For example, the maximum temperature for the manual station had the best normal distribution pattern compared to the other data sets.
Most of the other meteorological variables from the 3 different stations indicated positive correlations. Strong correlations were indicated in the relative humidity at 1200Z between the manual and 3D-PAWS (r = 0.59) with lowest correlations being observed at 0600Z. The surface pressure and relative humidity displayed normal distribution compared to the other variables such as rainfall which is not normally distributed for all the 3 stations and can be described using non-linear distribution (
The correlations for wind speed and direction for the manual, 3D-PAWS and TAHMO were fairly strong. To validate this, the wind rose between 3D-PAWS and the manual station indicated consistent and strongly NE winds at the manual station location (
Some earlier results had indicated that there was a very strong positive correlation for surface pressure between manual and TAHMO (r = 0.67), between TAHMO and 3D-PAWS (r = 0.96) and between manual and 3D-PAWS (r = 0.65) (
| Variable | W | p-value |
|---|---|---|
| Dagoretti daily rainfall | 0.32531 | <2.2e−16 |
| 3D-PAWS daily rainfall | 0.18067 | <2.2e−16 |
| Dagoretti surface pressure | 0.98414 | 0.0004962 |
| 3D-PAWS surface pressure | 0.35564 | <2.2e−16 |
| Dagoretti relative humidity at 006Z | 0.94811 | 5.348e−14 |
| 3D-PAWS relative humidity at 006Z | 0.96837 | 0.0008388 |
| Dagoretti wind direction at 006Z | 0.81444 | <2.2e−16 |
| 3D-PAWS wind direction at 006Z | 0.81444 | <2.2e−16 |
| Dagoretti wind speed at 006Z | 0.84307 | <2.2e−16 |
| 3D-PAWS wind speed at 006Z | 0.87698 | 5.147e−13 |
| Parameter (variable) | Correlation variables | Correlation coefficient (r) |
|---|---|---|
| 1) Minimum temperature | Manual vs TAHMO AWS | 0.651 |
| Manual vs 3D-PAWS | 0.180 | |
| TAHMO AWS vs 3D-PAWS | 0.270 | |
| 2) Maximum temperature | Manual vs TAHMO AWS | 0.610 |
| Manual vs 3D-PAWS | 0.610 | |
| TAHMO AWS vs 3D-PAWS | 0.560 | |
| 3) Relative humidity at 06Z | Manual vs TAHMO AWS | 0.832 |
| Manual vs 3D-PAWS | 0.220 | |
| TAHMO AWS vs 3D-PAWS | 0.621 | |
| 4) Relative humidity at 12Z | Manual vs TAHMO AWS | 0.765 |
| Manual vs 3D-PAWS | 0.590 | |
| TAHMO AWS vs 3D-PAWS | 0.858 | |
| 5) Wind direction | Manual vs TAHMO AWS | 0.0793 |
| Manual vs 3D-PAWS | 0.0004 | |
| TAHMO AWS vs 3D-PAWS | 0.495 | |
| 6) Wind speed | Manual vs TAHMO AWS | 0.0054 |
| Manual vs 3D-PAWS | 0.3636 | |
| TAHMO AWS vs 3D-PAWS | 0.0144 | |
| 7) Surface pressure | Manual vs TAHMO AWS | 0.6713 |
| Manual vs 3D-PAWS | 0.6500 | |
| TAHMO AWS vs 3D-PAWS | 0.9859 | |
| 8) Rainfall | Manual vs 3D-PAWS | 0.3764 |
Rainfall and other meteorological parameters such as temperature are invaluable for not only the monitoring and forecasting of the weather but also management of climate related disasters. However, sparseness of observation stations for measurements and collection of these data especially in sub-Saharan Africa and other developing countries is a major challenge. National Meteorological and Hydrological Services globally have been the main meteorological data collecting institutions. There is a need for enhancement of the observation network, through establishment of more automatic weather stations in most countries, as well as improved monitoring and prediction of weather and climate patterns.
Our study of manual and AWS data sets has demonstrated that the two modes of weather observations compare well and can therefore guide decision making. The analyses of meteorological data and comparisons between the manual station and AWSs revealed considerable agreements between most of the weather parameters inspite of the low correlations found between the rainfall and wind observations compared to the other variables (
Whereas the surface pressure was highly correlated between the three stations, some studies have found uncertainties in the comparisons between on ground station pressure and the reference data, e.g. (Dombrowski et al., 2021). The high variability between some meteorological variables at different stations could be due to several factors such as instrument error, change of location, damages or lack of station maintenance (Ford et al., 2020).
Overall, comparison of the manual station data and the TAHMO and 3D-PAWS observations showed that there was potential for concurrences between the different variables even at some small spatial co-locations of the different measurement instruments (
Despite the strong correlations between the different variables, anomalies were present when assessing some parameters such as wind speed and solar radiation due to complexities in aggregating such observations between the manual and automatic stations. This provides a challenge where such parameters may be required to complement monitoring and forecasting of the weather.
Based on our findings, the different meteorological parameters compared reasonably well between the three stations. The correlation coefficients between the parameters from the manual station and the AWSs were within acceptable levels and can be used as a basis for validation and application of the data in forecasting and other uses. There is high potential from the findings that observations from the 3D-PAWS and TAHMO stations compared well when both were in operation and relative to the manual station.
In conclusion, manual station datasets can be used alongside observations from AWS after adequate assessment of the quality and agreements between the data sets have been done.
In addition to the WMO HIGHWAY project for facilitating the two workshops that enabled the organisation and analysis of the datasets, we recognize the UK Aid (UK Met Office) support. We would also like to thank the Kenya Meteorological Department, Trans African Meteorological and Hydrological Observatories (TAHMO), and the University Corporation for Atmospheric Research/National Centre for Atmospheric Research (UCAR/NCAR) for providing the data that was used in this study.
The authors declare no conflicts of interest regarding the publication of this paper.
Muita, R., Kucera, P., Aura, S., Muchemi, D., Gikungu, D., Mwangi, S., Steinson, M., Oloo, P., Maingi, N., Muigai, E., & Kamau, M. (2021). Towards Increasing Data Availability for Meteorological Services: Inter-Comparison of Meteorological Data from a Synoptic Weather Station and Two Automatic Weather Stations in Kenya. American Journal of Climate Change, 10, 300-316. https://doi.org/10.4236/ajcc.2021.103014