Project

General

Profile

Support #14161

Time dependent QC questionnaire

Added by Maarten Sneep 4 months ago. Updated 2 days ago.

Status:
Feedback
Priority:
Normal
Assignee:
-
Target version:
-
Start date:
11/28/2018
Due date:
% Done:

0%


Description

Dear all,

I need your input to help us set up the time-dependent output on the level 2 quality control website. The real questions are in the attached questionnaire.docx file, which includes example pictures to show what is possible. If you want to check a certain plot for your own product, please let me know and I'll provide you with an example. You can use the attached Time-dependent-QC.xlsx file to provide your answers.

Also note the related issue #9321 which deals with the daily extractions. The time-dependent plots are based on the daily extractions.

I've set the due date to the end of this year, it would be nice is all ATBD authors can respond by then. Please forward this issue to anyone I've forgotten.

Kind regards,

Maarten

questionnaire.docx - The real details (5.67 MB) Maarten Sneep, 11/28/2018 11:08 AM

Time-dependent-QC_O3.xlsx - Updated for total ozone (27.7 KB) Klaus-Peter Heue, 12/14/2018 04:15 PM

Time-dependent-QC_CLOUD.xlsx (43.8 KB) Athina Argyrouli, 12/18/2018 04:21 PM

Time-dependent-QC_AAI.xlsx (43.3 KB) Deborah Stein Zweers, 12/19/2018 01:46 AM

Time-dependent-QC_JPV.xlsx (45.4 KB) Pepijn Veefkind, 12/19/2018 07:50 AM

Time-dependent-QC (1)_HCHO.xlsx (44.3 KB) isabelle de smedt, 12/19/2018 09:30 AM

Time-dependent-QC_CO_CH4.xlsx (45.2 KB) Tobias Borsdorff, 12/20/2018 09:32 AM

Time-dependent-QC_NO2.xlsx (10.7 KB) Jos van Geffen, 01/08/2019 12:39 PM

Time-dependent-QC_FRESCO.xlsx (27.2 KB) Ping Wang, 01/08/2019 02:51 PM

Time-dependent-QC_SO2.xlsx (44.8 KB) Nicolas Theys, 01/09/2019 09:47 AM

Time-dependent-QC.ods (24.9 KB) Maarten Sneep, 01/29/2019 04:40 PM

Time-dependent-QC_NPP.xlsx (43.5 KB) Richard Siddans, 03/20/2019 03:00 PM


Related issues

Related to PyCAMA - Support #9321: Update configuration of PyCAMA for daily extractions Closed 04/23/2018 12/31/2018
Related to PyCAMA - Support #14021: Include TM5 monitoring on the L2QC website New 11/22/2018

History

#1 Updated by Maarten Sneep 4 months ago

  • Related to Support #9321: Update configuration of PyCAMA for daily extractions added

#2 Updated by Maarten Sneep 4 months ago

  • Related to Support #14021: Include TM5 monitoring on the L2QC website added

#3 Updated by Klaus-Peter Heue 3 months ago

Dear Maarten

We internally discussed what might be useful to monitor for total ozone.
Please find our suggestion in the attached excel sheet.

In the excel sheet you asked for support for tropospheric ozone, maybe we can discuss this by email?
Klaus-Peter

#4 Updated by Maarten Sneep 3 months ago

Klaus-Peter Heue wrote:

Dear Maarten

We internally discussed what might be useful to monitor for total ozone.
Please find our suggestion in the attached excel sheet.

Thank you.

In the excel sheet you asked for support for tropospheric ozone, maybe we can discuss this by email?
Klaus-Peter

Yes, certainly. I'll send you a short message of what I'm looking for.

#5 Updated by Athina Argyrouli 3 months ago

The excel sheet for the CLOUD product is attached.

#6 Updated by Klaus-Peter Heue 3 months ago

Hi Maarten

There is one variable for the OFFL report we want to include here as well as in the daily reports (Support #9321), namely the "effective_albedo". Here may be the Zonal average would be interesting.

Klaus-Peter

#7 Updated by Deborah Stein Zweers 3 months ago

For UVAI it might be nice to have a row-time Hovmoller of scene_albedo_380 and scene_albedo_388

#8 Updated by Pepijn Veefkind 3 months ago

Attached are the inputs for the ozone profiling products.

#9 Updated by isabelle de smedt 3 months ago

Attached is the HCHO excel sheet.

Cheers

Isabelle

Maarten Sneep wrote:

Dear all,

I need your input to help us set up the time-dependent output on the level 2 quality control website. The real questions are in the attached questionnaire.docx file, which includes example pictures to show what is possible. If you want to check a certain plot for your own product, please let me know and I'll provide you with an example. You can use the attached Time-dependent-QC.xlsx file to provide your answers.

Also note the related issue #9321 which deals with the daily extractions. The time-dependent plots are based on the daily extractions.

I've set the due date to the end of this year, it would be nice is all ATBD authors can respond by then. Please forward this issue to anyone I've forgotten.

Kind regards,

Maarten

#10 Updated by Tobias Borsdorff 3 months ago

Hi Maarten,

here our suggestions for the plots of CO and CH4

Greetings

Alba and Tobias

#11 Updated by Maarten Sneep 2 months ago

  • Due date deleted (12/31/2018)

#12 Updated by Jos van Geffen 2 months ago

Here my suggestions for the NO2.

Perhaps Henk Eskes and/or Kai-Uwe Eichmann still want to add something to this.

#13 Updated by Maarten Sneep 2 months ago

Thank you all for supplying me with your feedback. I haven't received feedback for AER_LH, FRESCO, NP_BDx, and SO2___.

For AER_AI, CH4___, CO____, O3_TPR and O3__PR the provided feedback isn't clear as to which parameters are requested exactly for the line plot(s) or the rows image(s). Please clarify.

For HCHO__, NO2___, O3_TPR and O3__PR no time dependent histograms are requested, are you sure about that?

#14 Updated by Alba Lorente Delgado 2 months ago

Hi Maarten,

For CH4 line plots with mean, median, 16% and 84% percentile for all variables that are in black color (qa_value, methane_mixing_ratio,methane_mixing_ratio_precision, methane_mixing_ratio_bias_corrected, number_of_spectral_points_in_retrieval, chi_square_SWIR, chi_square_NIR, degrees_of_freedom, number_of_iterations, fluorescence). Row plot only for number_of_spectral_points_in_retrieval.

For CO, line plots with mean, median, 16% and 84% percentile for all variables that are in black color (qa_value, carbonmonoxide_total_column, carbonmonoxide_total_column_precision, number_of_spectral_points_in_retrieval, chi_square, degrees_of_freedom, number_of_iterations). Row plot only for number_of_spectral_points_in_retrieval.

Let us know if something else needs to be clarified.

Regards,

Alba and Tobias.

#15 Updated by Ping Wang 2 months ago

Hi Maarten,
I filled in the FRESCO and fluorescence variables for the time-dependent plots, see the attached file.

#16 Updated by Maarten Sneep 2 months ago

Alba Lorente Delgado wrote:

Hi Maarten,

For CH4 line plots with mean, median, 16% and 84% percentile for all variables that are in black color (qa_value, methane_mixing_ratio,methane_mixing_ratio_precision, methane_mixing_ratio_bias_corrected, number_of_spectral_points_in_retrieval, chi_square_SWIR, chi_square_NIR, degrees_of_freedom, number_of_iterations, fluorescence). Row plot only for number_of_spectral_points_in_retrieval.

I understood as much, but which parameter (minumin, maximum, ...) would you like to have plotted in the row plot?

For CO, line plots with mean, median, 16% and 84% percentile for all variables that are in black color (qa_value, carbonmonoxide_total_column, carbonmonoxide_total_column_precision, number_of_spectral_points_in_retrieval, chi_square, degrees_of_freedom, number_of_iterations). Row plot only for number_of_spectral_points_in_retrieval.

Exactly the same question again.

Thanks.

#17 Updated by Alba Lorente Delgado 2 months ago

Hi Maarten,

For both CH4 and CO the mean in the row plot.

Thanks.

#18 Updated by Maarten Sneep 2 months ago

Alba Lorente Delgado wrote:

Hi Maarten,

For both CH4 and CO the mean in the row plot.

Thank you.

I will maintain the wavelength_calibration_offset_SWIR in the extraction, as this is the only monitor of the wavelengths in the SWIR that we have. We maintain this for instrument monitoring purposes to aide the L1 team.

#19 Updated by Nicolas Theys 2 months ago

Attached is the input for _SO2 (sorry for the delay).
Following Pascal's idea, it would be good to monitor directly the BG parameters to spot issues there. I don't know how exactly this could be done, as it is slightly different from other variables. Therefore I have not included the BG parameters in the xls sheet. Description is as follows:
window_1_north

plot vs field o3_grid
either plot one line for each row or generate mean over all rows
range: [-1,1]

window_1_south

plot vs field o3_grid
either plot one line for each row or generate mean over all rows
range: [-1,1]

window_2

plot vs lat_grid
either plot one line for each row or generate mean over all rows
range: [-1,1]

window_3

plot vs lat_grid
either plot one line for each row or generate mean over all rows
range: [-1,1]

Nicolas

#20 Updated by Maarten Sneep 2 months ago

  • File deleted (Time-dependent-QC.xlsx)

#21 Updated by Maarten Sneep 2 months ago

  • File Time-dependent-QC.xlsx added

Thank you all for your feedback so far. I've collected all comments and feedback.

Note: all crossed out variables will be removed from the daily reports. Please let me know if that is unintentional. I will continue to include some variables that were crossed out because they provide unique instrument monitoring capabilities (SWIR wavelength offset for instance).

#22 Updated by Maarten Sneep 2 months ago

  • Target version deleted (PyCAMA 0.9.0)

#23 Updated by Maarten Sneep about 2 months ago

  • File deleted (Time-dependent-QC.xlsx)

#25 Updated by Richard Siddans 2 days ago

Form for NPP cloud uploaded.
Note that there is no need to make plots for all of the (4) field of view for which radiances and cloud flag/fractions are available. It would be sufficient to make plots only for the 1st FOV.

#26 Updated by Maarten Sneep 2 days ago

Richard Siddans wrote:

Form for NPP cloud uploaded.
Note that there is no need to make plots for all of the (4) field of view for which radiances and cloud flag/fractions are available. It would be sufficient to make plots only for the 1st FOV.

Thank you. And yes, I had no intention to do all 4 of them.

Also available in: Atom PDF