ioannis@37: .. _uploading_ancillary: ioannis@37: ioannis@47: Ancillary files ioannis@47: =============== ioannis@47: ioannis@47: Together with your measurement data, you can submit ancillary files that will ioannis@47: be used in the processing procedure. The files that are currently supported ioannis@47: are **sounding files**, **overlap files**, and **lidar ratio files**. ioannis@47: ioannis@47: These files can be submitted either together with a measurement, using the ioannis@47: "Quick upload" form, or on their own, using the "Upload ancillary" form. Both ioannis@47: methods are equivalent and will not affect which files is used for processing ioannis@47: your measurements. The file that will be used are defined in the *measurement ioannis@47: file* using the appropriate attributes as described in the :ref:`netcdf_file` ioannis@47: section. ioannis@47: ioannis@47: If one of your measurements requires ancillary files for its processing, the ioannis@47: actual processing of the data will start only after all the required files ioannis@47: have been uploaded. The files that are missing will appear in the ancillary file ioannis@47: list with "Missing" status. When all these files have been uploaded the ioannis@47: processing of the measurement will start automatically. ioannis@47: ioannis@47: ioannis@47: Upload ancillary ioannis@47: ---------------- ioannis@47: In the "Upload ancillary" form you need to specify to submit at least one ioannis@47: ancillary file. ioannis@47: ioannis@47: Form fields ioannis@47: ~~~~~~~~~~~ ioannis@47: ioannis@47: Station (Required) ioannis@47: You need to specify the EARLINET station that is related to this file. In ioannis@47: most cases you will just have to select your station. ioannis@47: ioannis@47: Sounding file (Optional) ioannis@47: In this optional field you can submit a sounding file that will be used ioannis@47: by your measurements in the processing. The file needs to follow the netCDF ioannis@47: file format specified in the pdf file found in the :ref:`netcdf_file` section. ioannis@47: The file you submit will not be necessarily connected with the ioannis@47: submitted measurement; which sounding file will be used in the processing of ioannis@47: each measurement is specified in the measurement's file. The file you upload ioannis@47: will, nevertheless, remain on the SCC and will be used whenever needed. ioannis@47: ioannis@47: Overlap file (Optional) ioannis@47: In this optional field you can submit a overlap file that will be used ioannis@47: by your measurements in the processing. The file needs to follow the netCDF ioannis@47: file format specified in the pdf file found in the :ref:`netcdf_file` section. ioannis@47: The file you submit will not be necessarily connected with the ioannis@47: submitted measurement; which overlap file will be used in the processing of ioannis@47: each measurement is specified in the measurement's file. The file you upload ioannis@47: will, nevertheless, remain on the SCC and will be used whenever needed. ioannis@47: ioannis@47: Lidar ratio file (Optional) ioannis@47: In this optional field you can submit a lidar ratio file that will be used ioannis@47: by your measurements in the processing. The file needs to follow the netCDF ioannis@47: file format specified in the pdf file found in the :ref:`netcdf_file` section. ioannis@47: The file you submit will not be necessarily connected with the ioannis@47: submitted measurement; which lidar ratio file will be used in the processing ioannis@47: of each measurement is specified in the measurement's file. The file you ioannis@47: upload will, nevertheless, remain on the SCC and will be used whenever needed. ioannis@47: ioannis@47: Form Validation ioannis@47: ~~~~~~~~~~~~~~~ ioannis@47: ioannis@47: The aim of form validation is to detect errors in your submitted data as early ioannis@47: as possible. In this way you can save time by correcting errors before the ioannis@47: processing of your data fails. ioannis@47: ioannis@47: When the files are submitted the following checks are performed: ioannis@47: ioannis@47: * At least one file needs to be submitted. ioannis@47: ioannis@47: * The submitted measurement file should have the correct netCDF format. All ioannis@47: mandatory variables and attributes should be present in the file. All ioannis@47: variables and attributes should have the correct type (float, integer, etc). ioannis@47: ioannis@47: * A file with the same filename should not exist in the SCC or, if it exists, ioannis@47: it should have status "Missing" or "Error". If a file with the same filename ioannis@47: exists, and its status is "OK" the submitted file is rejected. ioannis@47: ioannis@47: ioannis@47: Browse ancillary files ioannis@47: ---------------------- ioannis@47: ioannis@47: You can browse existing and missing ancillary files in the "Ancillary files" ioannis@47: page of the Data processing sub menu. ioannis@47: ioannis@47: You can filter the results of the list using the **Filter** box above the form. ioannis@47: The filter searches for matches in all columns of the table, i.e you can use it ioannis@47: to filter the results by filename, stations, data, and status. ioannis@47: ioannis@47: You can view more information about the ancillary file following the link on the ioannis@47: name of the file. ioannis@47: ioannis@47: ioannis@49: .. _ancillary_details: ioannis@49: ioannis@48: View ancillary file details ioannis@48: --------------------------- ioannis@47: ioannis@47: In the ancillary file status page you can view more detailed information about ioannis@47: the selected file. The following info are provided. ioannis@47: ioannis@47: Status ioannis@47: The status of the file can have three values. **Ok** means that the file ioannis@47: has been uploaded successfully and is ready to be used in the processing. ioannis@47: **Missing** status means that one or more of the submitted measurements ioannis@47: have requested this file, but the file has not been submitted yet. An ioannis@48: **Error** status indicates that the file has been submitted but there was ioannis@47: an error while reading its content; you will need to correct its content ioannis@47: and resubmit the file. ioannis@47: ioannis@47: Interpolation ioannis@47: This indicates the interpolation type that will be used on the content of ioannis@47: the ancillary file. You can change the interpolation type in the admin ioannis@47: section following the "Edit in admin" link in the File actions sub menu. ioannis@49: The algorithms currently implemented are "Linear interpolation" and ioannis@49: "Natural Cubic Spline". If no value is selected the natural cubic spline ioannis@49: algorithm will be used. ioannis@47: ioannis@47: Station ioannis@47: The EARLINET station that is the related to this ancillary file ioannis@47: ioannis@47: Submitted on ioannis@47: The date and time that the file was submitted. If the file is missing, but is ioannis@47: required by an uploaded measurement, this date indicated the date and time ioannis@47: of the measurement upload. ioannis@47: ioannis@47: At the bottom part of the page you can see a list of **Related measurements**. ioannis@47: These are measurements that use the specific ancillary file for their ioannis@47: processing. ioannis@47: