Tue, 25 Feb 2014 16:59:52 +0200
Added tag 1.0.0 for changeset b747e9fcd2b1
binietoglou@23 | 1 | Frequently asked questions |
binietoglou@23 | 2 | ========================== |
binietoglou@23 | 3 | |
binietoglou@24 | 4 | Clouds in the data |
binietoglou@24 | 5 | ~~~~~~~~~~~~~~~~~~ |
binietoglou@23 | 6 | |
binietoglou@29 | 7 | Q: Is it necessary to provide only measurement periods with cloud free conditions and |
binietoglou@29 | 8 | homogeneous atmosphere or is this part of ELDA or the pre-processing of the data? |
binietoglou@24 | 9 | For example in cases with scattered low cumulus clouds. |
binietoglou@24 | 10 | |
binietoglou@24 | 11 | A: At moment you should provide cloud free data because the automatic cloud screening |
binietoglou@23 | 12 | is not yet implemented in the SCC. We are working on this issue and hopefully the new |
binietoglou@23 | 13 | module will be implemented at the end of ACTRIS project . |
binietoglou@23 | 14 | |
binietoglou@23 | 15 | |
binietoglou@24 | 16 | High/low range channels |
binietoglou@24 | 17 | ~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@24 | 18 | Q: What is the definition of low range, ultra near range and high range channels? |
binietoglou@24 | 19 | Are there any threshold values? |
binietoglou@24 | 20 | |
binietoglou@24 | 21 | A: There are no threshold values defined for the different range types. This information |
binietoglou@23 | 22 | is used only in the gluing procedures just to identify which channel should be taken |
binietoglou@23 | 23 | as low range and which one as far range. If no gluing is applied by the SCC the range |
binietoglou@23 | 24 | id flags are not taken into account. |
binietoglou@23 | 25 | |
binietoglou@24 | 26 | Variable depolarization factor |
binietoglou@24 | 27 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@24 | 28 | |
binietoglou@29 | 29 | Q: Due to changes in the settings of our lidar system, the depolarization factor can |
binietoglou@24 | 30 | change during the measurement. Is it necessary to provide one SCC-file for each settings |
binietoglou@24 | 31 | or is it possible to set the Depolarization_Factor variable time dependent? |
binietoglou@23 | 32 | |
binietoglou@24 | 33 | A: Unfortunately it is not possible to have time dependence on Depolarization_Factor variable. |
binietoglou@23 | 34 | So if this parameter changes you should provide different SCC files for each setting. |
binietoglou@23 | 35 | |
binietoglou@24 | 36 | Extra netcdf parameters |
binietoglou@24 | 37 | ~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@24 | 38 | Q: Is it possible for documentation purposes to put own parameters in the SCC-NetCDF file? |
binietoglou@24 | 39 | For example who created the file.... Are there any reasons against this? |
binietoglou@23 | 40 | |
binietoglou@24 | 41 | A: Technically as long as you use not standard SCC variables for your own parameters there are |
binietoglou@23 | 42 | no problems for the SCC. It will just ignore these not standard variables. |
binietoglou@23 | 43 | |
binietoglou@23 | 44 | |
binietoglou@24 | 45 | Netcdf version |
binietoglou@24 | 46 | ~~~~~~~~~~~~~~ |
binietoglou@24 | 47 | Q: Which NetCDF version is to use? NetCDF3, NetCDF3 Classic, NetCDF4, NetCDF4 Classic? |
binietoglou@24 | 48 | |
binietoglou@24 | 49 | A: The NetCDF libraries 4.1.3 are used in all the SCC modules. So all the NetCDF formats you |
binietoglou@23 | 50 | have indicated should be compatible with the SCC (we have tested NetCDF3 and NetCDF4). |
binietoglou@23 | 51 | |
binietoglou@24 | 52 | Lidar ratio |
binietoglou@24 | 53 | ~~~~~~~~~~~ |
binietoglou@24 | 54 | Q: What are the values for the lidar ratio used in the SCC_DB? |
binietoglou@23 | 55 | |
binietoglou@24 | 56 | A: The values of (fixed) lidar ratio used by the SCC in the elastic retrieval can be set by |
binietoglou@23 | 57 | the user using the SCC web interface. In particular you can define a lidar ratio value for |
binietoglou@24 | 58 | each elastic backscatter product: in the product page there is the section "Elastic Backscatter |
binietoglou@24 | 59 | options" in which there is the field "Fixed lr". In case you want to use a lidar ratio profile |
binietoglou@23 | 60 | you should set LR_Input accordingly and provide an external LR profile NetCDF file |
binietoglou@23 | 61 | (see documentation on SCC file format). |
binietoglou@23 | 62 | |
binietoglou@29 | 63 | Calculation of Raman and elastic backscatter |
binietoglou@29 | 64 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@24 | 65 | Q: In cases of measurements where Raman channels are available, the SCC will calculate the Raman |
binietoglou@24 | 66 | backscatter profile. If I want to retrieve Klett-retrievals for this channel, too (e.g 532nm) |
binietoglou@24 | 67 | is it sufficient to set the value in LR_input(channels) to 1 or 0 plus a LR-profile to get |
binietoglou@24 | 68 | both retrievals? |
binietoglou@23 | 69 | |
binietoglou@24 | 70 | A: No. In general, for each lidar configuration you can define a set of optical products to be calculated |
binietoglou@23 | 71 | for that configuration using the SCC web interface. So suppose you have a system with 532nm and 607nm |
binietoglou@23 | 72 | channels. In this case you have 2 options: |
binietoglou@24 | 73 | |
binietoglou@24 | 74 | 1. Raman backscatter and extinction in the e532 file and Raman backscatter (full resolution) in the b532 |
binietoglou@24 | 75 | file. In this case you should associate to the configuration a product of type "lidar ratio and will |
binietoglou@24 | 76 | produce the e532 file and a product of type "Raman backscatter" which will produce the b532 file |
binietoglou@24 | 77 | 2. Raman backscatter and extinction in the e532 file and elastic backscatter in the b532 file. |
binietoglou@24 | 78 | In this case you should associate to the configuration a product of type "lidar ratio and extinction" |
binietoglou@24 | 79 | which will produce the e532 file and a product of type "elastic backscatter" which will produce the b532 file |
binietoglou@23 | 80 | |
binietoglou@23 | 81 | Note: you cannot calculate a b532 file containing the Raman and elastic backscatters at the same time. |
binietoglou@23 | 82 | The reason is that the 2 products will produce an output file with the same name (according to the EARLINET rules). |
binietoglou@23 | 83 | Moreover in general, it makes no sense to calculate the elastic backscatter when you can calculate the Raman |
binietoglou@23 | 84 | one which usually is better. |
binietoglou@23 | 85 | |
binietoglou@24 | 86 | Filename conventions |
binietoglou@24 | 87 | ~~~~~~~~~~~~~~~~~~~~ |
binietoglou@29 | 88 | A: What are the conventions for the filenames for the various files that need to be uploaded? |
binietoglou@23 | 89 | |
binietoglou@24 | 90 | Q: The following definitions apply: |
binietoglou@23 | 91 | |
binietoglou@29 | 92 | SCC raw lidar data file |
binietoglou@29 | 93 | ^^^^^^^^^^^^^^^^^^^^^^^ |
binietoglou@29 | 94 | |
binietoglou@29 | 95 | This file should be named as measID.nc. For example if your measurement had a measurement ID of 20130101cc00 the corresponding NetCDF file should be named 20130101cc00.nc |
binietoglou@23 | 96 | |
binietoglou@24 | 97 | Sounding file |
binietoglou@24 | 98 | ^^^^^^^^^^^^^ |
binietoglou@23 | 99 | |
binietoglou@23 | 100 | The file should be named as rs_measID.nc. Considering the above example the sounding file should be named rs_20130101cc00.nc |
binietoglou@23 | 101 | |
binietoglou@29 | 102 | In this case you should also set the global attribute Sounding_File_Name in the raw lidar data file as:: |
binietoglou@23 | 103 | |
binietoglou@29 | 104 | Sounding_File_Name=rs_20130101cc00.nc |
binietoglou@23 | 105 | |
binietoglou@24 | 106 | Lidar ratio file |
binietoglou@24 | 107 | ^^^^^^^^^^^^^^^^ |
binietoglou@23 | 108 | The file should be named as lr_measID.nc. Considering the above example the sounding file should be named lr_20130101cc00.nc |
binietoglou@23 | 109 | |
binietoglou@29 | 110 | In this case you should also set the global attribute LR_File_Name in the raw lidar data file as:: |
binietoglou@23 | 111 | |
binietoglou@29 | 112 | LR_File_Name=lr_20130101cc00.nc |
binietoglou@23 | 113 | |
binietoglou@24 | 114 | Overlap file |
binietoglou@24 | 115 | ^^^^^^^^^^^^ |
binietoglou@23 | 116 | The file should be named as ov_measID.nc. Considering the above example the sounding file should be named ov_20130101cc00.nc |
binietoglou@23 | 117 | |
binietoglou@29 | 118 | In this case you should also set the global attribute Overlap_File_Name in the raw lidar data file as:: |
binietoglou@29 | 119 | |
binietoglou@29 | 120 | Overlap_File_Name=ov_20130101cc00.nc |
binietoglou@29 | 121 | |
binietoglou@29 | 122 | |
binietoglou@29 | 123 | Photocounting values should be integers |
binietoglou@29 | 124 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@29 | 125 | Q: In one of my measurements I get an error concerning the photoncounting values:: |
binietoglou@29 | 126 | |
binietoglou@29 | 127 | Pre processing (177): Found no integer values in photoncounting signal |
binietoglou@29 | 128 | |
binietoglou@29 | 129 | The Raw_Lidar_Data variable in the NetCDF-file is defined as double. So is it necessary for Photoncounting signals to only provide integer values? |
binietoglou@29 | 130 | |
binietoglou@29 | 131 | A: Two important considerations: |
binietoglou@23 | 132 | |
binietoglou@29 | 133 | 1. The Raw_Lidar_Data array should contain your *real* raw data. |
binietoglou@29 | 134 | This means that *no corrections/operations* should be made on your signals |
binietoglou@29 | 135 | before filling the Raw_Lidar_Data array. This is particularly important because *all* |
binietoglou@29 | 136 | the operations and corrections should be applied by the SCC and not by the user before |
binietoglou@29 | 137 | the submission. In this way we can keep track of all the operations made on the signals |
binietoglou@29 | 138 | (for QA purposes) and moreover we are sure that all the corrections are applied in a |
binietoglou@29 | 139 | correct order (this is particularly important for non linear operations, think for example to the dead time correction). |
binietoglou@29 | 140 | |
binietoglou@29 | 141 | 2. The analog signals should be expressed in mV and the photoncounting signals in raw counts |
binietoglou@29 | 142 | |
binietoglou@29 | 143 | So if your photoncounting values are not integers they are not expressed in raw counts (which of course should be integers). |
binietoglou@29 | 144 | So the point here is not how to convert them in integers but to submit the right quantity in the right units. |
binietoglou@29 | 145 | |
binietoglou@29 | 146 | So please check carefully your converter and be sure to really submit raw counts for photoncounting channels and raw mV for the analog ones. |
binietoglou@29 | 147 | |
binietoglou@29 | 148 | |
binietoglou@29 | 149 | Preprocessing failed but no Exit code is provided |
binietoglou@29 | 150 | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ |
binietoglou@29 | 151 | Q: The preprocessing of one of my measurements failed (I get a status -127). However, when I check the Exit codes |
binietoglou@29 | 152 | to see the description of the problem, I get an empty value (-). What does this mean? |
binietoglou@29 | 153 | |
binietoglou@29 | 154 | A: This means that the preprocessor crushed unexpectedly! Sorry for that! Report the problem in the forum and it will be fixed |
binietoglou@29 | 155 | soon. |