SCC Documentation: docs/data_processing/pre_exit_codes.rst@58bd0b5b6632 (annotated)

docs/data_processing/pre_exit_codes.rst@58bd0b5b6632 (annotated)

docs/data_processing/pre_exit_codes.rst

Thu, 15 Jul 2021 13:13:38 +0200

author: Giuseppe D'Amico <giuseppe.damico@imaa.cnr.it>
date: Thu, 15 Jul 2021 13:13:38 +0200
changeset 130: 58bd0b5b6632
parent 129: a059b0d40a80
permissions: -rw-r--r--

Added documentation on new optional raw data file global attributa Cloudnet_Station_ID

 Preprocessor exit codes
 =======================
 After a measurement is processed by the preprocessor, an exit code is provided
 that can help you understand if everything went OK, and if not, what was the problem.
 The implemented exit codes are the following.
 
    Finished without errors
 
    Failure in memory allocation
 
    Configuration file not found
 
    Configuration file error: INPUT_DIR not defined
 
    Configuration file error: OUTPUT_DIR not defined
 
    Configuration file error: Cannot read in INPUT_DIR
 
    Configuration file error: Cannot write on OUTPUT_DIR
 
    Configuration file error: Cannot read in SOUNDINGS_DIR
 
    Configuration file error: Cannot read in OVERLAP_DIR
 
    Configuration file error: Cannot read in LIDARRATIO_DIR
 
    Configuration file error: Cannot write on LOG_DIR
 
    Wrong usage in calling the script
 
    Cannot create output directory
 
    An internal error occurred
 
    Configuration file error: Cannot read in CLOUDMASK_DIR
 
    Configuration file error: Cannot read in CLOUDNET_DIR
 
    Configuration file error: Cannot write on RAW_SKIPPING_DIR
 
    Cannot create cloudnet output directory
 
    Cannot read CA file
 
    Found one or more channels defined in the product definition but not linked to the used system configuration. Please check that all the channels in your products are also linked to the used system configuration
 
    Cannot connect to SCC_DB
 
    Failed in quering SCC_DB
 
    Failed in fetching query of SCC_DB
 
    Found error(s) in SCC_DB for the submitted Measurement_ID
 
    Measurement ID not found in the selected database
 
    Measurement_ID not unique in the selected database
 
    Unknown usecase in SCC_DB
 
    One or more mandatory datetime field(s) are not set into the database
 
    Found mismatch among usecase, product type and given channels
 
    All the products associated to a system configuration should be processed with the same processor module.
 
    Unknown product type in SCC_DB
 
    Cannot open NetCDF input file
 
    Dimension "time" not found in NetCDF input file
 
    Dimension "channels" or "channel" not found in NetCDF input file
 
    Dimension "points" not found in NetCDF input file
 
    Dimension "scan_angles" not found in NetCDF input file
 
    Global attribute "Measurement_ID" not found or not correctly defined in NetCDF input file
 
    Incorrect definition of global attribute "Measurement_ID" in NetCDF input file
 
    Global attribute "RawData_Start_Date" not found in NetCDF input file
 
    Global attribute "RawData_Start_Time_UT" not found in NetCDF input file
 
    Global attribute "RawData_Stop_Time_UT" not found in NetCDF input file
 
    Variable "Laser_Pointing_Anlge" not found and/or not  defined correctly in NetCDF input file
 
    "Laser_Pointing_Angle" variable cannot be undefined and should be between 0 and 90.
 
    Variable "Laser_Pointing_Angle_of_Profiles" not found and/or not defined correctly in NetCDF input file
 
    Variable "Laser_Shots" not found and/or not  defined correctly in NetCDF input file
 
    Found negative or not defined value in "Laser_Shots" array
 
    Cannot write intermediate NetCDF file
 
    Variables "Pol_Calib_Range_Min" and/or "Pol_Calib_Range_Max" not found and/or not  defined correctly in NetCDF input file
 
    Invalid values for variables "Pol_Calib_Range_Min" and/or "Pol_Calib_Range_Max" in NetCDF input file
 
    Generic NetCDF error
 
    Dimension "time" cannot be zero
 
    Dimension "channels" cannot be zero
 
    Dimension "points" cannot be zero
 
    Natural cubic spline interpolation not possible
 
    lfit: no parameters to be fitted
 
    gaussj: Singular Matrix
 
    Not correct type in NetCDF variable definition
 
    Not correct number of dimensions in NetCDF variable definition
 
    Not correct type in NetCDF global attribute definition
 
    Found invalid value of latitude. Check the database value or the value reported in the raw NetCDF input file
 
    Found invalid value of longitude. Check the database value or the value reported in the raw NetCDF input file
 
    Found invalid value of altitude. Check the database value or the value reported in the raw NetCDF input file
 
    Found invalid value of emission wavelength. Check the database value or the value reported in the raw NetCDF input file
 
    Found invalid value of detection wavelength. Check the database value or the value reported in the raw NetCDF input file
 
    Found wrong value for integration time in SCC_DB
 
    Overlap file not registered in the database. Please register it and then re-run the SCC
 
    Lidarratio file not registered in the database. Please register it and then re-run the SCC
 
    Sounding file not registered in the database. Please register it and then re-run the SCC
 
    Not all required depolarization calibrations is available in SCC_DB. Please submit at least one depolarizatio calibration measurement for each required calibration and link them to the product to be calibrated
 
    Found no valid values for depolarization constant in the SCC_DB
 
    Unkown depolarization calibration calculation method
 
    No depolarization cross-talk correction factors (G and H) are available in SCC_DB for the depolarization channels. Please submit them
 
    Found no valid values for depolarization cross-talk correction factors in the SCC_DB
 
    No correction factor (K) for depolarization calibration is available in SCC_DB. Please provide at least one value for correction factor and link it to the product to be calibrated
 
    Found no valid values for depolarization constant correction factor in the SCC_DB
 
    Unkown depolarization correction factor calculation method
 
    Found SCC_DB inconsistencies in the definition of transmitted depolarization channels. Please be sure that all the products containing the reflected depolarization channel includes the corresponding transmitted depolarization channel as well. Check also the signal type and the scattering type are set correctly.
 
    Found SCC_DB inconsistencies in the definition of reflected depolarization channels. Please be sure that all the products containing the transmitted depolarization channel includes the corresponding reflected depolarization channel as well. Check also the signal type and the scattering type are set correctly.
 
    For one or more polarization calibration parameters you have selected to use the option "Use the most recent available calibration previous to the measurement date". No calibrations according to this criteria has been found. So please select another calibration options of provide at least one calibration measurements with a date previous to the current measurement date.
 
    Dimension "nb_of_time_scales" not found in NetCDF input file
 
    Incorrect definition of global attribute "RawData_Start_Date" in NetCDF input file
 
    Incorrect definition of global attribute "RawData_Start_Time_UT" in NetCDF input file
 
    Incorrect definition of global attribute "RawData_Stop_Time_UT" in NetCDF input file
 
    Variables "channel_string_ID" and/or "channel_ID" not found and/or not  defined correctly in the NetCDF input file
 
    Missing one or more channels in NetCDF input file
 
    Found wrong value(s) in variable "Background_Low" end/or "Background_High"
 
    Variable "Background_Low" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Background_High" not found and/or not  defined correctly in NetCDF input file
 
    Variable "id_timescale" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Raw_Data_Start_Time" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Raw_Data_Stop_Time" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Raw_Lidar_Data" not found and/or not  defined correctly in NetCDF input file
 
    Found not integer values in photoncounting signal
 
    Variable "Molecular_Calc" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Molecular_Calc" has not valid value
 
    Variable "Pressure_at_Lidar_Station" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Temperature_at_Lidar_Station" not found and/or not  defined correctly in NetCDF input file
 
    Found wrong value(s) for channel first signal range bin. Please check your SCC channels configuration of the variable "First_Signal_Rangebin" in NetCDF input file
 
    Variable "DAQ_Range" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Raw_Bck_Start_Time" not found and/or not  defined correctly in NetCDF input file
 
    Variable "Raw_Bck_Stop_Time" not found and/or not  defined correctly in NetCDF input file
 
    Global attribute "RawBck_Start_Date" not found in NetCDF input file
 
    Global attribute "RawBck_Start_Time_UT" not found in NetCDF input file
 
    Global attribute "RawBck_Stop_Time_UT" not found in NetCDF input file
 
    Found not compatible values of variable "id_timescale". All the values of "id_timescale" should be less then the dimension "nb_of_time_scales"
 
    Global attribute "Sounding_File_Name" not found in NetCDF input file
 
    Sounding NetCDF input file not found
 
    Dimension "points" not found in Sounding NetCDF input file
 
    Global attribute "Sounding_Start_Date" not found in the Sounding NetCDF input file
 
    Global attribute "Sounding_Start_Time" not found in the Sounding NetCDF input file
 
    Global attribute "Latitude_degrees_north" not found in the Sounding NetCDF input file
 
    Global attribute "Longitude_degrees_east" not found in the Sounding NetCDF input file
 
    Global attribute "Altitude_meter_asl" not found in the Sounding NetCDF input file
 
    Variable "Altitude" not found and/or not  defined correctly in the Souding NetCDF input file
 
    Variable "Temperature" not found and/or not  defined correctly in the Souding NetCDF input file
 
    Variable "Pressure" not found and/or not  defined correctly in the Souding NetCDF input file
 
    Sounding file error: "Altitude" array should contain altitudes in ascendent order (from the lowest point to the highest one)
 
    Cannot found variable "LR_Input" within NetCDF input file. This variable is mandatory for elastic backscatter retrievals
 
    Found invalid value(s) for Variable "LR_Input"
 
    Global attribute "LR_File_Name" not found in NetCDF input file
 
    Lidar ratio NetCDF input file not found
 
    Dimension "points" not found in lidar ratio NetCDF input file
 
    Dimension "products" not found in lidar ratio NetCDF input file
 
    Global attribute "Lidar_Station_Name" not found in the lidar ratio NetCDF input file
 
    Variable "Altitude" not found and/or not  defined correctly in the lidar ratio NetCDF input file
 
    Variable "product_ID" not found and/or not  defined correctly in the lidar ratio NetCDF input file
 
    Variable "Lidar_Ratio" not found and/or not  defined correctly in the lidar ratio NetCDF input file
 
    Variable "product_id" in the lidar ratio NetCDF input file contains data that are not consistent with the SCC database values
 
    Variable "Lidar_Ratio" in the lidar ratio NetCDF input file contains undefined values within the valid altitude range defined by the corresponding product. Please remove them.
 
    Lidarratio file error: "Altitude" array should contain altitudes in ascendent order (from the lowest point to the highest one)
 
    Overlap NetCDF input file not found
 
    Dimension "points" not found in Overlap NetCDF input file
 
    Dimension "channels" not found in Overlap NetCDF input file
 
    Global attribute "Lidar_Station_Name" not found in the Overlap NetCDF input file
 
    Global attribute "Overlap_Measurement_Date" not found in the Overlap NetCDF input file
 
    Variable "Altitude" not found and/or not  defined correctly in the Overlap NetCDF input file
 
    Variable "channel_ID" not found and/or not  defined correctly in the Overlap NetCDF input file
 
    Variable "Overlap_Function" not found and/or not  defined correctly in the Overlap NetCDF input file
 
    Overlap file error: "Altitude" array should contain altitudes in ascendent order (from the lowest point to the highest one)
 
    Sounding file error: "Temperature" array should contain atmospheric temperature values in degrees Celsius
 
    Sounding file error: "Pressure" array should contain atmospheric pressure values in hPa
 
    Lidar ratio file error: "Lidar_Ratio" array should contain valid lidar ratio values in sr
 
    Overlap file error: "Overlap_Function" array should contain valid overlap correction values
 
    Variable "Lidar_Ratio_Error" not  defined correctly in the lidar ratio NetCDF input file
 
    Dimension "time" is zero in the output file. This may be due to few cloud-free profile within integration time or the integration time is too small. Please check that thare are enought (>2) cloud-free profiles within the integration time in the submitted timeseries
 
    Unable to use Poisson statistic in Montecarlo simulation. Found not integer values
 
    Found wrong value(s) for "Background_Mode" in NetCDF file or in SCC_DB
 
    Found wrong value(s) for variable "Dead_Time_Corr_Type" in NetCDF file or in SCC_DB
 
    Cannot apply dead time correction. Please check the dead time value and the your photoncouning raw data
 
    Found negative number of counts in lidar data!
 
    Found wrong value(s) in variable "Raw_Bck_Start_Time" end/or "Raw_Bck_Stop_Time" and/or in laser repetition rate value
 
    Background profiles don"t contain the same number of valid data point of the corresponding lidar profile
 
    Cannot calculate errors using Montecarlo simulation within trigger delay correction
 
    Linear interpolation not possible
 
    Too few cloud-free lidar profiles within the integration time. Please check the integration time is not too small or/and there are enought cloud-free regions in the submitted timeseries
 
    Cannot calculate the errors after time integration
 
    Found timescales not syncronized
 
    Cannot calculate errors using Montecarlo simulation within interpolation routine
 
    Gluing between near range and far range signals not possible. No suitable overlap region can found
 
    Gluing between near range and far range signals not possible. Poor linear correlation
 
    Gluing between near range and far range signals not possible. Too noisy signal(s)
 
    Gluing between near range and far range signals not possible. Slope test not passed
 
    All the profiles within the submitted timeseries seem contaminated by low clouds. Cannot calculate aerosol optical properties
 
    Found wrong value(s) for scattering type id
 
    Found wrong value(s) for detection type id
 
    Found wrong value(s) for range type id
 
    Too few lidar points to calculate atmospheric background. At least 10 lidar rangebins are required within the background subtraction range.
 
    Raw time resolution is greater than the selected integration time
 
    Gluing between near range and far range signals not possible. Too large difference between signals in gluing point
 
    Unkown interpolation type.
 
    Found wrong value(s) for signal type id or product channel(s) missing in system channel connections
 
    Found range resolution in raw lidar data greater than the value in SCC_DB
 
    Error in calculating molecular depolarization ratio
 
    Error in getting interferencial filter information for depolarization channels
 
    Found too few valid datapoints. Please check the variable "Raw_Lidar_Data" in the raw input file contains at least 15 valid points for all the channels
 
    Found not physical values after the interpolation of the sounding file. Try to change the interpolation type (to linear) to fix the problem.
 
    Found not physical values after the interpolation of the lidar ratio file. Try to change the interpolation type (to linear) to fix the problem.
 
    Found not physical values after the interpolation of the overlap file. Try to change the interpolation type (to linear) to fix the problem.
 
    Found incompatible value for the emission wavelength in one or more lidar channels
 
    Found not physical values after the interpolation of the model data. Try to change the interpolation type (to linear) to fix the problem.
 
    Polarization calibration product and the corresponding product to calibrate refer to different stations!
 
    Found invalid value of laser repetition rate. Check the database value or the value reported in the raw NetCDF input file
 
    All negative heights above lidar station in sounding file. Please be sure that the heights above sounding station and the sounding station altitude are reported correctly in the sounding file. Check also that your lidar station altitude is correct.
 
    All negative heights above lidar station in GDAS file. This shouldn"t happen! Try to force another model or use standard atmosphere or external sounding.
 
    Found invalid value of detection wavelength fwhm. Check the database value or the value reported in the raw NetCDF input file
 
    Found invalid value of range resolution. Check the database value or the value reported in the raw NetCDF input file
 
    Cannot open cloud mask NetCDF file
 
    Dimension "time" not found or not defined correctly in the cloudmask NetCDF file
 
    Dimension "level" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "time" and/or "time_bounds" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "altitude" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "latitude" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "longitude" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "station_altitude" not found or not defined correctly in the cloudmask NetCDF file
 
    Variable "automatic_cloud_mask" or "manual_cloud_mask" not found or not defined correctly in the cloudmask NetCDF file
 
    No cloud mask found for this measurement id. Please be sure the cloudmaks module ran succesfully
 
    Global attribute "measurement_ID" not found or not defined correctly in the cloudmask NetCDF file
 
    Cloud mask data not consistent with raw lidar data!
 
    Unknown distribution type for MonteCarlo simulation
 
    Polarization calibration: found inconsistency between wavelengths to calibrate and calibration wavelengths
 
    Error in getting model data from CloudNet
 
    It seems your station is not enabled to get model data from CloudNet. So please set Molecular_Calc=0 or 1 in your raw input file.
 
    CloudNet model data have been downloaded succesfully but it seems it contains invalid height value (null or negative values).
 
    General error (most probably segmentation fault)
 
    Timeout

Mercurial > public > sccdocs / annotate

docs/data_processing/pre_exit_codes.rst@58bd0b5b6632 (annotated)

docs/data_processing/pre_exit_codes.rst