lithologic cross validation
lithologic cross validation performs cross validation of lithology indicator kriging. It evaluates how well a lithologic model predicts materials by systematically withholding subsets of the lithology samples, re-running the indicator kriging on the remaining samples, and comparing the predicted material at each withheld sample against the observed material. Two methods are supported: K-Fold, which divides the data into K subsets that each take a turn as the validation set, and Leave One Out, which validates each individual sample or boring one at a time.
The module accepts lithologic kriging options from an upstream module such as lithologic modeling and outputs a field containing the per-sample results. Model quality is summarized by the Brier score (the error between the predicted material probabilities and the observed material), the hit rate (how often the most probable material matches the observed material), and the mean probability assigned to the observed material. After a run, the Inputs and Outputs sections of the Properties panel report the settings that were used and the resulting statistics. These values are read-only.
Ports
| Direction | Name | Type | Description |
|---|---|---|---|
| Input | Interpolation Options Input | Interpolation Options | The lithologic kriging options used for the cross-validation. |
| Output | Output Field | Field | The field containing the results of the cross-validation. |
Properties
| Property | Type | Description |
|---|---|---|
| Allow Run | Boolean | Controls whether the module will run when applications are loaded or data changes. When on, the module runs when applications are loaded or the Execute button is pushed. When off, the module will not run unless Execute is pressed. |
| Execute | Button | Forces the module to run even if Allow Run has been turned off, allowing a number of changes to be made before updating. |
| Cross Validation Method | Choice: K-Fold, Leave One Out | Specifies how the dataset is partitioned for evaluation. K-Fold divides the data into K subsets (folds); the model is trained on K-1 folds and validated on the remaining fold, repeating until each fold has served once as the validation set. Leave One Out is a special case of K-Fold where the number of folds equals the number of units, so each unit is left out and validated individually. |
| Fold Unit | Choice: Sample, Boring | Specifies how samples are grouped into folds. Sample treats each individual measurement point as its own unit. Boring groups all measurements from the same borehole together, so entire borings are divided into folds. |
| Number Of Folds | Integer | The number of folds to use in K-Fold cross-validation (minimum 2). Only applicable when the K-Fold method is selected. A common choice is 5 or 10 folds, but the optimal number depends on the size and characteristics of the dataset. |
| Random Seed | Integer | The random seed used to partition data into folds during K-Fold cross-validation. A specific seed guarantees the same data splits each run, which is important for consistent comparison. A value of -1 uses a seed based on the current system time, producing different splits each run. |
| Update Information Window | Boolean | When on, a report is sent to the Information window every time the module is run. |
Processing Settings
| Property | Type | Description |
|---|---|---|
| Gpu Settings | GPU Options | GPU acceleration settings. The default for these options can be changed in the global application options menu. |
Export
| Property | Type | Description |
|---|---|---|
| Write As Csv | File | Exports the lithologic cross-validation results as a CSV file containing the per-sample true material, predicted material, and per-material probabilities. |
Inputs
| Property | Type | Description |
|---|---|---|
| File Name | String | The lithology data file used for the cross-validation. |
| Samples | Integer | The total number of sample points used in the cross-validation. |
| Borings | Integer | The number of distinct borings represented in the sample points used for the cross-validation. |
| Folds | Integer | The effective number of folds used. For Leave One Out, this equals the number of units (samples or borings). |
| Materials | Integer | The number of distinct lithology materials represented in the sample points used for the cross-validation. |
| Method | String | The cross-validation method that was used (K-Fold or Leave One Out) and the fold unit (Sample or Boring). |
| Number Of Folds | Integer | The number of folds requested for K-Fold cross-validation. For Leave One Out, the effective fold count is reported as Folds. |
| Random Seed | Integer | The random seed used to partition data into folds for K-Fold cross-validation. -1 means a time-based seed. |
| Model Type | String | The variogram model type used by the calculation (Spherical, Exponential, Gaussian, or Circular). |
| Range | Double | The variogram range used by the calculation. When fitting was enabled this is the post-fit value; otherwise it is the user-specified range. |
| Sill | Double | The variogram sill used by the calculation. When fitting was enabled this is the post-fit value; otherwise it is the user-specified sill. |
| Nugget | Double | The variogram nugget used by the calculation. When fitting was enabled this is the post-fit value; otherwise it is the user-specified nugget. |
| Variogram Autofitted | Boolean | True when automatic variogram fitting was performed for this run. When true, the Range, Sill, and Nugget values are the post-fit values rather than user-specified inputs. |
| Anisotropy Mode | String | The anisotropy parameterization mode (Simple or Advanced). |
| Vertical Anisotropy | Double | The vertical anisotropy ratio used in Simple anisotropy mode. Only meaningful when Anisotropy Mode is Simple. |
| Heading | Double | The anisotropy heading angle. Only meaningful in Advanced anisotropy mode. |
| Dip | Double | The anisotropy dip angle. Only meaningful in Advanced anisotropy mode. |
| Roll | Double | The anisotropy roll angle. Only meaningful in Advanced anisotropy mode. |
| Primary Ratio | Double | The anisotropy primary-axis ratio (HR). Only meaningful in Advanced anisotropy mode. |
| Secondary Ratio | Double | The anisotropy secondary-axis ratio (HV). Only meaningful in Advanced anisotropy mode. |
Outputs
| Property | Type | Description |
|---|---|---|
| Mean Brier | Double | The mean squared error between the predicted material probabilities and the actual material, averaged over all samples. Ranges from 0 (perfect predictions) to 1 (full confidence in the wrong material); lower is better. |
| Hit Rate | Double | The fraction of samples for which the most probable predicted material matched the observed material. |
| Mean True Probability | Double | The average predicted probability assigned to the observed material across all samples. |
| Per Material Report | String | A per-material breakdown of sample count, mean Brier score, and hit rate. |
| Copy For Excel | Button | Copies the output statistics to the clipboard in tab-separated format, with or without headers. |