| 1 .. _netcdf_file: |
1 .. _netcdf_file: |
| 2 |
2 |
| 3 The SCC input netCDF file format |
3 The SCC input netCDF file format |
| 4 ================================ |
4 ================================ |
| 5 |
5 |
| 6 A more detailed version of this document can be found in this :download:`pdf file <../files/NetCDF_input_file_v3_5.pdf>`. |
6 A more detailed version of this document can be found in this :download:`pdf file <../files/NetCDF_input_file_v3_6.pdf>`. |
| 7 |
7 |
| 8 .. note:: |
8 .. note:: |
| 9 |
9 |
| 10 You can check the format of the files you create using the linked `script <https://gitlab.com/ioannis_binietoglou/scc-netcdf-checker>`_ . |
10 You can check the format of the files you create using the linked `script <https://gitlab.com/ioannis_binietoglou/scc-netcdf-checker>`_ . |
| 11 |
11 |
| 117 +----------------------+-------------------------------------------+ |
117 +----------------------+-------------------------------------------+ |
| 118 | Stop Time UT | 00:05:01 | |
118 | Stop Time UT | 00:05:01 | |
| 119 +----------------------+-------------------------------------------+ |
119 +----------------------+-------------------------------------------+ |
| 120 | Station Name | Dummy station | |
120 | Station Name | Dummy station | |
| 121 +----------------------+-------------------------------------------+ |
121 +----------------------+-------------------------------------------+ |
| 122 | Earlinet call-sign | cc | |
122 | Earlinet call-sign | ccc | |
| 123 +----------------------+-------------------------------------------+ |
123 +----------------------+-------------------------------------------+ |
| 124 | Pointing angle | 5 degrees with respect to the zenith | |
124 | Pointing angle | 5 degrees with respect to the zenith | |
| 125 +----------------------+-------------------------------------------+ |
125 +----------------------+-------------------------------------------+ |
| 126 |
126 |
| 127 |
127 |
| 811 |
811 |
| 812 Global attributes |
812 Global attributes |
| 813 ~~~~~~~~~~~~~~~~~ |
813 ~~~~~~~~~~~~~~~~~ |
| 814 |
814 |
| 815 - | ``Measurement_ID`` |
815 - | ``Measurement_ID`` |
| 816 | This mandatory global attribute defines the measurement ID |
816 | The submission of a raw data file to the SCC is possible only if it contains |
| 817 corresponding to the actual lidar measurement. It is a string |
817 this global attribute which, in general, can be set to any alphanumeric string |
| 818 composed by 12 characters. The first 8 characters give the start |
818 composed by 12 or 15 characters. The raw data file can be registered into the SCC database only |
| 819 date of measurement in the format YYYYMMDD. The next 2 characters |
819 if the corresponding measurement ID string is not already used by any other raw data file |
| 820 give the Earlinet call-sign of the station. The last 2 characters |
820 (of any station). To ensure the unicity of the measurement ID string the following format is highly recommened:: |
| 821 are used to distinguish between different time-series within the |
821 |
| 822 same date. In our example we have to set: |
822 <start\_date><station\_code><start\_time> |
| 823 |
823 |
| 824 :: |
824 where: |
| 825 |
825 |
| 826 Measurement_ID= "20090130cc00" ; |
826 +-----------------------+------------------------------------------------------------------+ |
| |
827 | *<start\_date>* | 8 digits measurement start date: YYYYMMDD (for example 20220620) | |
| |
828 +-----------------------+------------------------------------------------------------------+ |
| |
829 | *<station\_code>* | 3 digits code (for example pot) | |
| |
830 +-----------------------+------------------------------------------------------------------+ |
| |
831 | *<star\_time>* | 4 digits measurement start time (UTC): HHMM (for example 2226) | |
| |
832 +-----------------------+------------------------------------------------------------------+ |
| |
833 |
| |
834 In our example we have to set: |
| |
835 |
| |
836 :: |
| |
837 |
| |
838 Measurement_ID= "20090130ccc0000" ; |
| 827 |
839 |
| 828 - | ``RawData_Start_Date`` |
840 - | ``RawData_Start_Date`` |
| 829 | This mandatory global attribute defines the start date of lidar |
841 | This mandatory global attribute defines the start date of lidar |
| 830 measurements in the format YYYYMMDD. In our case we have: |
842 measurements in the format YYYYMMDD. In our case we have: |
| 831 |
843 |
| 918 double Raw_Lidar_Data(time, channels, points) ; |
930 double Raw_Lidar_Data(time, channels, points) ; |
| 919 double Background_Profile(time_bck, channels, points) ; |
931 double Background_Profile(time_bck, channels, points) ; |
| 920 double DAQ_Range(channels) ; |
932 double DAQ_Range(channels) ; |
| 921 |
933 |
| 922 // global attributes: |
934 // global attributes: |
| 923 :Measurement_ID = "20090130cc00" ; |
935 :Measurement_ID = "20090130ccc0000" ; |
| 924 :RawData_Start_Date = "20090130" ; |
936 :RawData_Start_Date = "20090130" ; |
| 925 :RawData_Start_Time_UT = "000001" ; |
937 :RawData_Start_Time_UT = "000001" ; |
| 926 :RawData_Stop_Time_UT = "000501" ; |
938 :RawData_Stop_Time_UT = "000501" ; |
| 927 :RawBck_Start_Date = "20090129" ; |
939 :RawBck_Start_Date = "20090129" ; |
| 928 :RawBck_Start_Time_UT = "235001" ; |
940 :RawBck_Start_Time_UT = "235001" ; |
| 1047 |
1059 |
| 1048 :: |
1060 :: |
| 1049 |
1061 |
| 1050 Measurement_ID.nc |
1062 Measurement_ID.nc |
| 1051 |
1063 |
| 1052 | so in the example the filename should be 20090130cc00.nc. |
1064 | so in the example the filename should be 20090130ccc0000.nc. |
| 1053 |
1065 |
| 1054 Please keep in mind that in case you submit a file like the previous |
1066 Please keep in mind that in case you submit a file like the previous |
| 1055 one all the parameters present in it will be used by the SCC even if |
1067 one all the parameters present in it will be used by the SCC even if |
| 1056 you have different values for the same parameters within the SCC\_DB. |
1068 you have different values for the same parameters within the SCC\_DB. |
| 1057 If you want to use the values already stored in SCC\_DB (this should |
1069 If you want to use the values already stored in SCC\_DB (this should |
| 1086 double Raw_Lidar_Data(time, channels, points) ; |
1098 double Raw_Lidar_Data(time, channels, points) ; |
| 1087 double Background_Profile(time_bck, channels, points) ; |
1099 double Background_Profile(time_bck, channels, points) ; |
| 1088 double DAQ_Range(channels) ; |
1100 double DAQ_Range(channels) ; |
| 1089 |
1101 |
| 1090 // global attributes: |
1102 // global attributes: |
| 1091 :Measurement_ID = "20090130cc00" ; |
1103 :Measurement_ID = "20090130ccc0000" ; |
| 1092 :RawData_Start_Date = "20090130" ; |
1104 :RawData_Start_Date = "20090130" ; |
| 1093 :RawData_Start_Time_UT = "000001" ; |
1105 :RawData_Start_Time_UT = "000001" ; |
| 1094 :RawData_Stop_Time_UT = "000501" ; |
1106 :RawData_Stop_Time_UT = "000501" ; |
| 1095 :RawBck_Start_Date = "20090129" ; |
1107 :RawBck_Start_Date = "20090129" ; |
| 1096 :RawBck_Start_Time_UT = "235001" ; |
1108 :RawBck_Start_Time_UT = "235001" ; |
| 1208 |
1220 |
| 1209 #. provide a overlap function for overlap correction |
1221 #. provide a overlap function for overlap correction |
| 1210 |
1222 |
| 1211 In this case we have to generate the following NetCDF additional files: |
1223 In this case we have to generate the following NetCDF additional files: |
| 1212 |
1224 |
| 1213 - | ``rs_20090130cc00.nc`` |
1225 - | ``rs_20090130ccc0000.nc`` |
| 1214 | The name of *Sounding Data* file has to be computed as follows: |
1226 | The name of *Sounding Data* file has to be computed as follows: |
| 1215 | ``"rs_"``\ +\ ``Measurement_ID`` |
1227 | ``"rs_"``\ +\ ``Measurement_ID`` |
| 1216 | The structure of this file is summarized in table 2 of the pdf. |
1228 | The structure of this file is summarized in table 2 of the pdf. |
| 1217 |
1229 |
| 1218 - | ``ov_20090130cc00.nc`` |
1230 - | ``ov_20090130ccc0000.nc`` |
| 1219 | The name of *Overlap* file has to be computed as follows: |
1231 | The name of *Overlap* file has to be computed as follows: |
| 1220 | ``"ov_"``\ +\ ``Measurement_ID`` |
1232 | ``"ov_"``\ +\ ``Measurement_ID`` |
| 1221 | The structure of this file is summarized in table 3 of the pdf. |
1233 | The structure of this file is summarized in table 3 of the pdf. |
| 1222 |
1234 |
| 1223 - | ``lr_20090130cc00.nc`` |
1235 - | ``lr_20090130ccc0000.nc`` |
| 1224 | The name of *Lidar Ratio* file has to be computed as follows: |
1236 | The name of *Lidar Ratio* file has to be computed as follows: |
| 1225 | ``"lr_"``\ +\ ``Measurement_ID`` |
1237 | ``"lr_"``\ +\ ``Measurement_ID`` |
| 1226 | The structure of this file is summarized in table 4 of the pdf. |
1238 | The structure of this file is summarized in table 4 of the pdf. |
| 1227 |
1239 |
| 1228 Moreover we need to apply the following changes to the *Raw Lidar Data* |
1240 Moreover we need to apply the following changes to the *Raw Lidar Data* |
| 1245 |
1257 |
| 1246 #. Add the global attribute ``Sounding_File_Name`` |
1258 #. Add the global attribute ``Sounding_File_Name`` |
| 1247 |
1259 |
| 1248 :: |
1260 :: |
| 1249 |
1261 |
| 1250 Sounding_File_Name = "rs_20090130cc00.nc" ; |
1262 Sounding_File_Name = "rs_20090130ccc0000.nc" ; |
| 1251 |
1263 |
| 1252 #. Add the global attribute ``LR_File_Name`` |
1264 #. Add the global attribute ``LR_File_Name`` |
| 1253 |
1265 |
| 1254 :: |
1266 :: |
| 1255 |
1267 |
| 1256 LR_File_Name = "lr_20090130cc00.nc" ; |
1268 LR_File_Name = "lr_20090130ccc0000.nc" ; |
| 1257 |
1269 |
| 1258 #. Add the global attribute ``Overlap_File_Name`` |
1270 #. Add the global attribute ``Overlap_File_Name`` |
| 1259 |
1271 |
| 1260 :: |
1272 :: |
| 1261 |
1273 |
| 1262 Overlap_File_Name = "ov_20090130cc00.nc" ; |
1274 Overlap_File_Name = "ov_20090130ccc0000.nc" ; |
| 1263 |
1275 |