Custom Pipeline Errors

A summary of the custom errors that are experienced through running the pipeline.

exception pipeline.errors.ArchiveConnectError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Connection to the CEDA Archive could not be established

exception pipeline.errors.BlacklistProjectCode(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

The project code you are trying to run for is on the list of project codes to ignore.

exception pipeline.errors.ChunkDataError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Overflow Error from pandas during decoding of chunk information, most likely caused by bad data retrieval.

exception pipeline.errors.ConcatFatalError(var=None, chunk1=None, chunk2=None, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Chunk sizes differ between refs - files cannot be concatenated

exception pipeline.errors.ConcatenationError(message='Variables could not be concatenated over time and are not duplicates - no known solution', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Variables could not be concatenated over time and are not duplicates - no known solution

exception pipeline.errors.ExpectMemoryError(required='', current='', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

The process is expected to run out of memory given size estimates.

exception pipeline.errors.ExpectTimeoutError(required=0, current='', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

The process is expected to time out given timing estimates.

exception pipeline.errors.FilecapExceededError(nfiles=0, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

During scanning, could not find suitable files within the set of files specified.

exception pipeline.errors.FullsetRequiredError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

This project must be validated using the full set of files.

exception pipeline.errors.IdenticalVariablesError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

All variables found to be suitably identical between files as to not stack or concatenate

exception pipeline.errors.KerchunkDecodeError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Decoding of Kerchunk file failed - likely a time array issue.

exception pipeline.errors.KerchunkDriverFatalError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

All drivers failed (NetCDF3/Hdf5/Tiff) - run without driver bypass to assess the issue with each driver type.

exception pipeline.errors.KerchunkException(proj_code, groupdir)

Bases: Exception

exception pipeline.errors.MissingKerchunkError(message='No suitable kerchunk file found for validation.', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Kerchunk file not found.

exception pipeline.errors.MissingVariableError(type='$', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

A variable is missing from the environment or set of arguments.

exception pipeline.errors.NaNComparisonError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

When comparing NaN values between objects - different values found

exception pipeline.errors.NoOverwriteError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Output file already exists and the process does not have forceful overwrite (-f) set.

exception pipeline.errors.NoValidTimeSlicesError(message='Kerchunk', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Unable to find any time slices to test within the object.

exception pipeline.errors.PartialDriverError(filenums=None, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

All drivers failed (NetCDF3/Hdf5/Tiff) for one or more files within the list

exception pipeline.errors.ProjectCodeError(verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Could not find the correct project code from the list of project codes for this run.

exception pipeline.errors.RemoteProtocolError(filenums=None, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

All drivers failed (NetCDF3/Hdf5/Tiff) for one or more files within the list

exception pipeline.errors.ShapeMismatchError(var={}, first={}, second={}, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Shapes of ND arrays do not match between Kerchunk and Xarray objects - when using a subset of the Netcdf files.

exception pipeline.errors.SoftfailBypassError(message='Kerchunk validation failed softly with no bypass - rerun with bypass flag', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Validation could not be completed because some arrays only contained NaN values which cannot be compared.

exception pipeline.errors.SourceNotFoundError(sfile=None, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Source File could not be located.

exception pipeline.errors.TrueShapeValidationError(message='Kerchunk', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Shapes of ND arrays do not match between Kerchunk and Xarray objects - when using the complete set of files.

exception pipeline.errors.ValidationError(message='Fatal comparison failure for Kerchunk/NetCDF', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

One or more checks within validation have failed - most likely elementwise comparison of data.

exception pipeline.errors.VariableMismatchError(missing={}, verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

During testing, variables present in the NetCDF file are not present in Kerchunk

exception pipeline.errors.XKShapeToleranceError(tolerance=0, diff=0, dim='', verbose=0, proj_code=None, groupdir=None)

Bases: KerchunkException

Attempted validation using a tolerance for shape mismatch on concat-dims, shape difference exceeds tolerance allowance.