Open-access Computational system for geostatistical analysis

Sistema computacional para análise geoestatística

Abstracts

Geostatistics identifies the spatial structure of variables representing several phenomena and its use is becoming more intense in agricultural activities. This paper describes a computer program, based on Windows Interfaces (Borland Delphi), which performs spatial analyses of datasets through geostatistic tools: Classical statistical calculations, average, cross- and directional semivariograms, simple kriging estimates and jackknifing calculations. A published dataset of soil Carbon and Nitrogen was used to validate the system. The system was useful for the geostatistical analysis process, for the manipulation of the computational routines in a MS-DOS environment. The Windows development approach allowed the user to model the semivariogram graphically with a major degree of interaction, functionality rarely available in similar programs. Given its characteristic of quick prototypation and simplicity when incorporating correlated routines, the Delphi environment presents the main advantage of permitting the evolution of this system.

spatial variability; semivariogram; software


O uso da geoestatística como técnica para identificação da estrutura espacial de vários fenômenos vem crescendo em aplicações agrícolas. Este trabalho apresenta um sistema computacional implementado em ambiente Windows (Borland Delphi), voltado à análise espacial de dados por meio de ferramentas, como estatísticas descritivas, modelagem de semivariogramas médios, direcionais e cruzados, auto-validação (Jack-Knifing) e krigagem. A fim de avaliar a acurácia dos resultados, o sistema foi testado por meio de um conjunto de dados de carbono e nitrogênio publicados em literatura. O sistema foi eficiente no processo de análise geoestatística para manipulação da rotina computacional num ambiente MS-DOS. A tentativa de desenvolvimento no Windows permitiu ao usuário modelar graficamente o semivariograma com maior grau de interação, sendo esta funcionalidade raramente disponível em programas similares. Devido a sua rápida prototipação e simplicidade após a incorporação de rotinas correlatas, o ambiente Delphi apresenta a principal vantagem de permitir a evolução do sistema.

variabilidade espacial; semivariograma; tecnologias de informação


NOTE

Computational system for geostatistical analysis

Sistema computacional para análise geoestatística

Laurimar Gonçalves VendrusculoI*; Paulo Sérgio Graziano MagalhãesII; Sidney Rosa VieiraIII; José Ruy Porto de CarvalhoI

IEmbrapa Informática Agropecuária, C.P. 6041 - 13083-970 - Campinas, SP - Brasil

IIUNICAMP/Faculdade de Engenharia Agrícola, C.P. 6011 - 13083-970 - Campinas, SP - Brasil

IIIIAC - Centro de Solos e Recursos Agroambientais, C.P. 28 - 13001-970 - Campinas, SP - Brasil

ABSTRACT

Geostatistics identifies the spatial structure of variables representing several phenomena and its use is becoming more intense in agricultural activities. This paper describes a computer program, based on Windows Interfaces (Borland Delphi), which performs spatial analyses of datasets through geostatistic tools: Classical statistical calculations, average, cross- and directional semivariograms, simple kriging estimates and jackknifing calculations. A published dataset of soil Carbon and Nitrogen was used to validate the system. The system was useful for the geostatistical analysis process, for the manipulation of the computational routines in a MS-DOS environment. The Windows development approach allowed the user to model the semivariogram graphically with a major degree of interaction, functionality rarely available in similar programs. Given its characteristic of quick prototypation and simplicity when incorporating correlated routines, the Delphi environment presents the main advantage of permitting the evolution of this system.

Key words: spatial variability, semivariogram, software

RESUMO

O uso da geoestatística como técnica para identificação da estrutura espacial de vários fenômenos vem crescendo em aplicações agrícolas. Este trabalho apresenta um sistema computacional implementado em ambiente Windows (Borland Delphi), voltado à análise espacial de dados por meio de ferramentas, como estatísticas descritivas, modelagem de semivariogramas médios, direcionais e cruzados, auto-validação (Jack-Knifing) e krigagem. A fim de avaliar a acurácia dos resultados, o sistema foi testado por meio de um conjunto de dados de carbono e nitrogênio publicados em literatura. O sistema foi eficiente no processo de análise geoestatística para manipulação da rotina computacional num ambiente MS-DOS. A tentativa de desenvolvimento no Windows permitiu ao usuário modelar graficamente o semivariograma com maior grau de interação, sendo esta funcionalidade raramente disponível em programas similares. Devido a sua rápida prototipação e simplicidade após a incorporação de rotinas correlatas, o ambiente Delphi apresenta a principal vantagem de permitir a evolução do sistema.

Palavras-chave: variabilidade espacial, semivariograma, tecnologias de informação

INTRODUCTION

Geostatistics is consolidated as an useful tool applied to various scientific fields. Combined with classical statistics, this technique aims increasing the knowledge over a dataset to identify and quantify the spatial structure of studied phenomena. In addition to knowing the spatial continuity, it is important to locate the sources of any variation. In agriculture, such variations may originate from geological and/or pedological natural processes or from management practices. Whenever human activities cause excess or lack of any mineral element in the soil, farmers may look for a solution to this problem using spatial analysis. To define a more precise spatial variation of form in a mining area, Matheron (1963) developed a theory named Regionalized Variables. Geostatistics considers the randomized and structured nature of spatial variables and the spatial distribution of the samples (Oliver, 1987).

The semivariogram is the main instrument of the theory of Regionalized Variables. It quantifies the scale and intensity of the spatial variation, provides a basis for an optimum interpolation through the kriging method, and assist applications to optimize sampling plans. Various computational systems were built to implement the geostatistical concepts either in an isolated way or integrating them to other tools, using pre-existing routines. There is an increasing trend to implement these techniques in Geographical Information Systems (GIS).

As for Geostatistics, one of the most complete routine sets is called Geostatistical Software LIBrary (GSLIB), developed by Deutsch & Journel (1998), at the University of Stanford. It comprises a library of programs written in ANSI (American National Standard Institute) Fortran 77. ANSI allows GSLIB to run on various computational platforms. Camargo (1997) added a geostatistical module to the Geographical Information System called SPRING (SPRING, 2002) using the GSLIB routines. A Windows version (WinGslib) is available on the site http://www.gslib.com(GSLIB, 2001).

Also using FORTRAN, Vieira et al. (1983) developed and validated computational programs for geostatistical calculations, based on routines making direct calls to DOS. An input of specific parameters generates an output file in ASCII format. Although these programs are handled in a modular form, making it difficult for users to interpret the results, they provide considerable help to the geostatistical analysis allowing to choose the theoretical model best suited to the experimental semivariogram, according to the parameter analysis generated using a Jackknifing technique.

Developing new, user-friendly packages of spatial statistics using graphic interfaces and visual resources is quite necessary. This work presents a computational tool developed from the routines of Vieira et al. (1983), which allows a spatial analysis of data. In addition to the interpolation process using simple kriging, tools to model average, cross and directional semivariograms and modules to treat the infinite dispersion of data (nonstationarity) were implemented. Authors as Isaaks & Srivastava (1989), Journel (1989) and Vieira (2000) made a complete report of the geostatistical theory. This work also uses a case study to validate this tool and the implemented techniques.

MATERIAL AND METHODS

The methodology used to develop this system is based on principles and paradigms of the Software Engineering and on the sequence of steps of the Traditional Life Cycle approach to system development (Pressman, 1982) combined with the Software Reuse techniques. This application, developed for a Windows environment, uses mainly two computational tools:

• Geostatistical routines previously developed by Vieira et al. (1983) – a set of executable programs written in Fortran 77. The open source codes and the cross-validation routine were decisive when choosing a library to integrate the tool presented here;

• Environment and programming language Borland Delphi 5 (Inprise Corporation, 1999).

Figure 1 illustrates the modules developed in the current version of the system.


The system first verifies the possible lack of input parameters (name of the data file, maximum distance, LAG, etc.) and, if necessary, generates error messages or warnings. These data are then recorded in a text file, called parameter file (Figure 2c), which informs the actions to be performed by the Fortran Program. Internally, the Delphi system evokes the Fortran Program. Next, the command line shows this call to the Fortran Program, which calculates the values of an experimental semivariogram (avar.exe):

WinExec(' avar.exe', SW–HIDE );


The avar.exe program is executed within the DOS environment, producing a result text file. The Delphi system then reads the resulting file and presents it in a graphic and/or tabular form. Figure 2 depicts an example of the interaction between the Delphi system modules and the text files generated executing the FORTRAN routines. The kriging step used the Surfer software 7.0 to produce the soil maps.

Notions of continuity and of spatial dependence are associated to the semivariogram (Clark, 1979). Two regional variables, X and Y, where X = Z(xi) and Y = Z(xi + h), are then considered and associated as coordinate pairs, (x1,y1) and (x2,y2), respectively, and separated by the lag or distance vector h (module and direction). The semivariogram is defined as:

that is, half of the mathematical expectation (E) of the square of the difference between the values of the points in a field, separated by a distance vector h. The equation for the estimation g* is given by:

where N(h) is the number of pairs of measured values Z(xi) and Z(xi+h), separated by the vector h and Z(xi); Z(xi+h) are values of observations of the regionalized variable sampled at the points xi and xi+h.

A semivariogram that is practically uniform for all directions of the vector h denotes the presence of isotropy within the spatial variability. Conversely, if the semivariogram is not the same for all directions, this characterizes an anisotropic distribution. Figure 3 exemplifies a geometrical anisotropy where, for the same sill, directions 45º and 135º present ranges with different values.

Figure 3

• Nugget Effect (Co): when a semivariogram tends to zero (g (h) = 0) a value Co is observed, which reveals the discontinuity of the phenomenon for values smaller than the least distance between samples.

• Range (a): distance within samples are spatially correlated.

• Sill (C): value of g which corresponds to the range (a) on the graph of the semivariogram. It is considered that, from this point on, there is no more spatial dependence between the samples.

The next step is to adjust a mathematical model that best represents the configuration of the curve of the experimental semivariogram. The spherical (Sph), exponential (Exp) and Gaussian (Gau) models are represented in Figure 4. These are basic models, which Isaaks & Srivastava (1989) called isotropic models with sill. Models with sill are known as transitive, that is, after a certain distance, the model reaches a maximum and constant value. Other models reach the sill (C) asymptotically. There are also models with no sill, which correspond to the possibility of infinite dispersion of a phenomenon. These phenomena do not have finite variance and their covariance may not be defined (Vieira, 2000).


Since the whole geostatistical analysis process involves uncertainty and subjectivity, one must assess the performance of the estimation in points where the values are known. This estimation error assessment may be performed using the procedure known as Jackknifing or cross-validation. Vieira (2000) discusses the concepts involved in this technique in details.

Matheron (1963) pays a tribute to the South-African mining engineer Daniel G. Krige and his interpolation method, called kriging, which allows the interpolation of values in any position of the field studied, without bias and with minimum variance. Because of its weighed moving average, the kriging method resembles the interpolation method, but, since it determines the weights according to the spatial analysis provided by the experimental semivariogram, it diverges from the simple linear interpolation and Inverse Square of Distance methods. The kriging estimator supplies unbiased estimations, that is, on the average, there is no distortion between the estimated and actual values of a same point. Another important characteristic is the minimum variance, which means that, although there may be differences between the estimated and measured values from point to point, these differences are very low.

As a linear estimator, a kriging procedure may be represented by the weighed linear combinations of measured data, or a moving average that considers a variability structure of the measured variable, expressed by the semivariogram and by the localization of known values. In this concept, the points closest to the position that will be interpolated have a major weight in relation to the most distant ones.

The kriging estimator is formulated as follows:

where N is the number of measured values Z(xi) used in the prediction, and li is the weight associated to each measured value Z(xi). The simple and ordinary krigings are the most used techniques. For further details, see Journel (1989).

Data used in this study came from Waynick & Sharp (1919), which were later also used by Vieira (2000). The observations concern two fields in California, USA, with almost invariant slope, one in the so-called University Farm, in Davis (clay loamy soil) and the other in the city of Oakley (sandy soil). One hundred soil samples were collected in each field.

The case study presented in this work is an analysis of Carbon (C), Nitrogen (N) and of the Carbon/Nitrogen relationship in a rectangular grid (63.99 m x 81.89 m) with different densities in its edges and central parts. According to the authors, sampling sought to assess the variability of C and N in two apparently homogenous, alluvial soils.

The spatial distribution of the sampled points is illustrated in Figure 5.


RESULTS AND DISCUSSION

The highest means and the maximum and minimum values of Carbon and Nitrogen correspond to the field in Davis (Table 1). Except for the variable C/N - Oakley, all other present low variance values, which means that most of the values are close to the mean.

The high values of the kurtosis coefficient represent a more peaked frequency curve than the normal curve, which confirms the concentration of values close to the mean value. The 0.7637 index, between the measures of Carbon and Nitrogen in the Oakley field, and the 0.6268 index between Carbon and Nitrogen in Davis, denote mean positive correlations between these two variables (Table 2).

Modeling average semivariogram

Figure 6 presents the scaled semivariograms of the Carbon and Nitrogen variables for the fields in Davis and Oakley. Scaling is obtained dividing each semivariogram point of the variables by its respective variance. This procedure allows to compare the spatial structure of the variables on a same scale, as used in Vieira et al. (1991). A preliminary visual analysis of Figure 6 shows that the semivariance values between both variables (carbon and nitrogen) in the two sites, throughout the distance axis, are very close.


In the present study, the Carbon and Nitrogen variables in Oakley were chosen to perform a geostatistical analysis, since they presented the highest index of correlation among the studied variables (Table 2). From a distance of 60 meters on, the variables do not present a stable sill beyond the range (Figure 7). The present study sought to find the semivariogram that satisfied the intrinsic, less restrictive hypothesis, that is, one whose data obeyed both the mean independence and the existence of semivariance, independently of the spatial position (Vieira, 2000). Under this hypothesis, the Carbon and Nitrogen variables in Oakley were bias subtracted using polynomial-surfaces. In a broader sense, the Carbon and Nitrogen variables in the Oakley field, with sandy soil, presented higher semivariances than the loamy clayey soil of Davis.


Treatment of data stationarity

In this step, the parabolic trend surface was applied to the unscaled semivariogram of the Carbon and Nitrogen variables in Oakley, as to subtract the effect of the infinite dispersion of the data. This operation resulted in a residue curve (Figure 8), which consists of the difference between the values of the experimental semivariogram and the values of the trend surface. As it presents a graphic behavior similar to that of an ideal semivariogram, this curve is used, from now on, to adjust the theoretical models, and in the cross-validation and kriging processes. Once interpolated, the values of the trend surface are summed up to the residues to reconstitute the data set that will yield the maps.


Adjusting the mathematical models

The system implements five kinds of mathematical models to adjust the experimental semivariogram: spherical, exponential, Gaussian, Hole Effect and pentaspherical. Through the input of the theoretical model parameters (nugget effect – Co, structural variance – C1, and range – a), the respective curve is superimposed to the points of the experimental semivariogram.

The spherical model provided the best Multiple correlation coefficient (R2) – close to one – and Weighed Regression Sum of Square (WRSS) – least value (Figure 9). For Carbon, the values following parameters were obtained: nugget (Co) = 0.25; structural variance (C1) = 0.43; sill = 19.5 meters. The model best fitted to the semivariogram of Nitrogen residues was the spherical, with the following parameters: C0 = 0.0; C1= 0.003, and sill = 19 meters. In this step, the system reproduced a non-scaled experimental semivariogram. This approach allows the adjusted parameters to be in the natural scale of each variable semivariance.


Application of the of Cross-validation – JackKnifing module

Using C0, C1 and range values of the section: "Adjusting the mathematical models", one obtains the estimates of the cross-validation parameters presented in Tables 3 and 4. The neighborhoods that best estimated the parameters, according to the ideal parameters of each variable, were the 16 and 8 neighborhoods for Carbon and Nitrogen, for Oakley, respectively. These neighborhoods are considered as ideal for the kriging process.

Kriging

The system generated a text file with the estimated values in a one-meter square grid, to which the respective values of the estimate variance were added. The interpolated map for Carbon for Oakley (Figure 10) shows its major continuity or variability of value classes for the direction – 45ºQ, a direction that presents the least continuity for the Nitrogen variable (Figure 8). The 0.3 to 0.35 values represent the class of major occurrence in the studied area (Figure 11).



CONCLUSIONS

The system was useful for the geostatistical analysis process, for the manipulation of the computational routines in a MS-DOS environment, and since it was carried out in a one an integrated environment, facilitated this process. The Windows development approach allowed the user to model the semivariogram graphically with a major degree of interaction, functionality rarely available in similar programs. Moreover, the option to adjust automatically the parameters of the mathematical model is also thought off as a future activity, in this system, to provide a comparison basis for the manual adjustment. Given its characteristic of quick prototypation and simplicity when incorporating correlated routines, the Delphi environment presents the main advantage of permitting the evolution of this system. The analysis of the dataset of Waynick & Sharp (1919) constituted an initial study and did not intend to deepen the results as for the agronomic issue. Still, the results obtained, mainly as regards to the interpolated maps, resemble those found by Vieira (2000). Further information on the use of this system may be found at: http://www.cnptia.embrapa.br.

Received April 08, 2002

Accepted October 23, 2003

References

  • CAMARGO, E.C.G. Desenvolvimento, implementação e teste de procedimentos geoestatísticos (krigeagem) no sistema de processamento de informações georreferenciadas (SPRING). São José dos Campos: INPE, 1997. 146p. (Dissertação - Mestrado).
  • CLARK, I. Practical geostatistics London: Applied Science Publishers, 1979. 130p.
  • DEUTSCH, C.V.; JOURNEL A.G. GSLIB: geostatistical software library and user's guide. New York: Oxford University Press, 1998. 369p.
  • GEOSTATICAL SOFTWARE LIBRARY. http://www.gslib.com. (13 nov. 2001).
  • INPRISE CORPORATION. Borland Delphi 5 for Windows 98, Windows 95, & Windows NT: developer's guide. Scotts Valley, 1999.
  • ISAAKS, E.H.; SRIVASTAVA, R.M. An introduction to applied geostatistics. New York: Oxford University Press, 1989. 561p.
  • JOURNEL, A.G. Fundamentals of geostatistics in five lessons. Short Course in Geology. Washington: American Geophysical Union, 1989. 40 p.
  • MATHERON, G. Principles of geostatistics. Economic Geology, v.58, p.1246-1266, 1963.
  • OLIVER, M.A Geostatistics and its application to soil science. Soil Use and Management, v.3, p.8-20, 1987.
  • PRESSMAN, R.S. Software engineering: a practitioner's approach. New York: McGraw-Hill, 1982. 352p.
  • SPRING. http://www.dpi.inpe/spring. (4 fev. 2002).
  • VIEIRA, S.R. Geoestatística em estudos de variabilidade espacial do solo. In: NOVAIS, R.F. de; ALVAREZ V., V.H.; SCHAEFER, C.E.G.R. (Ed.) Tópicos em ciência do solo Campinas: Sociedade Brasileira de Ciência do Solo, v.1, p.1-54, 2000.
  • VIEIRA, S.R.; LOMBARDI NETO, F.; BURROWS, I.T. Mapeamento da chuva máxima provável para o Estado de São Paulo. Revista Brasileira de Ciência do Solo, v.15, p.93-98, 1991.
  • VIEIRA, S.R.; HATFIELD, T.L.; NIELSEN, D.R.; BIGGAR, J.W. Geostatistical theory and application to variability of some agronomical properties. Hilgardia, v.51, p.1-75, 1983.
  • WAYNICK, D.D.; SHARP, L.T Variability in soils and its significance to past and future soil investigations. II. Variation in nitrogen and carbon in field soils and their relation to the accuracy of field trials. Agricultural Science, v.4, p.121-139, 1919.
  • *
    Corresponding author <
  • Publication Dates

    • Publication in this collection
      13 Feb 2004
    • Date of issue
      Feb 2004

    History

    • Accepted
      23 Oct 2003
    • Received
      08 Apr 2002
    location_on
    Escola Superior de Agricultura "Luiz de Queiroz" USP/ESALQ - Scientia Agricola, Av. Pádua Dias, 11, 13418-900 Piracicaba SP Brazil, Phone: +55 19 3429-4401 / 3429-4486 - Piracicaba - SP - Brazil
    E-mail: scientia@usp.br
    rss_feed Acompanhe os números deste periódico no seu leitor de RSS
    Acessibilidade / Reportar erro