| Program/Script | IDPC | description | Zebra | BW | SGP Shared Libraries | TDB | C | Fortran | Perl | Shell | IDL | Common Y2K problems | Common Problems | Common Problems | Common Problems | Common Problems | Common Problems | Common Problems | Common Problems | Software Dependencies | Software Dependencies | Status | priority | Contact Person(s) | Sites | Sites | Sites | Sites | Sites | Y2K problem? | Time estimate | Time estimate | Time estimate | Time estimate | Time estimate | comments/concerns | |
| Creates/parse filename | works with 2 digits years from data within file | calls sds shared times | Calls "date" command | Calls date_chr_to_int | Has own routines for time (for finding yesterday) | Calls ParseOutDate | Uses Obstime.ds_yymmdd | In House | Outside sources | implemented | implemented | implemented | implemented | implemented | Y/N | To assess (hours) | To change | unit test | system integration test | Data quality review | |||||||||||||||||
| External Data Center | SGP | TWP | NSA | SHE | XDC | EC | |||||||||||||||||||||||||||||||
| Collections | Scripts could be made more modular when fixed. Converted to perl? Grep'ed for "yy" "leap" jdate_to_yymmdd,yesterday.pl | ||||||||||||||||||||||||||||||||||||
| ftpget24sfc.csh | SGP WPDN SURF | n | n | n | n | n | n | n | y | n | y | y | n | y | y | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | |||||||||||||
| ftpget32eta.csh | SGP WPDN ETA | n | n | n | n | n | n | n | y | n | y | y | n | y | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | |||||||||||||||
| ftpgetm06.csh | SGP WPDN MMTS | n | n | n | n | n | n | n | y | n | y | y | n | y | y | jdate_to_yymmdd | ebselect (EBUFR Utilities) | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | |||||||||||
| ftpgetok05.csh | SGP OKM 05 | n | n | n | n | n | n | n | y | n | y | y | n | y | y | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | |||||||||||||
| ftpgetok15.csh | SGP OKM 15 | n | n | n | n | n | n | n | y | n | y | y | n | y | y | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | |||||||||||||
| ftpgetpfr.csh | SGP WPDN PRF | n | n | n | n | n | n | n | y | n | y | y | n | y | y | jdate_to_yymmdd | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | ||||||||||||
| ftpgetruc.csh | SGP RUC | n | n | n | n | n | n | y | y | n | y | y | n | y | n | yesterday.pl | development | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | |||||||||||||
| ftpgetsfc.csh | SGP WPDN SURF | n | n | n | n | n | n | n | y | n | y | y | n | y | y | retired | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||||
| ftpgetstg3.csh | SGP ABRFC | n | n | n | n | n | n | n | y | n | y | y | n | y | y | wgrib | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | Does not calculate 2000 as leap year | ||||||||||||
| ftpgoeswater.csh | SGP GOES PROF | n | n | n | n | n | n | y | y | n | y | y | n | y | n | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||||
| ftpgpstar.csh | SGP GPS | n | n | n | n | n | n | n | y | n | y | n | n | y | n | jdate_to_yymmdd | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | |||||||||||||
| ftpgetmolts.csh | NAC MOLTS | n | n | n | n | n | y | n | y | n | y | n | n | y | n | bufr_time.f | BUFR utilities? | production | Lynn.Ma@arm.gov | y | y | 2 | 1 | 1 | 1 | Already creates 4 digit years in filenames | |||||||||||
| ftpgetnsaavhrr.csh | NSA AVHRR | fetches & subsets nsa jpeg data | nsa_avhrr.pro, nsa_sub_jpeg.pl | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 4 | 4 | ||||||||||||||||||||||||||
| twp_get_surf.pl | TWP NCDC SURF | n | n | n | n | n | n | n | y | n | y | y | y | n | n | y | n | n | twp_srf_dat.pro | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | ||||||||||
| Ingests | |||||||||||||||||||||||||||||||||||||
| allruc60 | SGP RUC 60 | y | y | n | n | y | y | n | n | n | y | y | n | n | n | n | y | y | GRIB utilties | retired | Tammy Kwan (John Yio) | n | n | n | n | y | y | 0 | 0 | 0 | 0 | allruc60 data no longer available, see allruc40 | |||||
| gridsub | SGP RUC 60 | y | y | n | n | y | y | n | n | n | y | y | n | n | n | n | y | y | GRIB Utilities | retired | Tammy Kwan (John Yio) | n | n | n | n | y | y | 0 | 0 | 0 | 0 | gridsub no longer needed since RUC 60 data no available, see allruc40 | |||||
| allruc40 | SGP RUC 40 | y | y | n | n | y | y | n | n | n | y | y | n | n | n | n | y | y | GRIB utilties | development | Tammy Kwan (John Yio) | n | n | n | n | y | y | 16 | 4 | 4 | 1 | allruc40 is in development, assessments of time & problems are based on allruc60 ingest | |||||
| avhrr_ingest.csh | SGP AVHRR | n | n | n | n | n | n | n | y | n | y | y | n | y | n | n | n | n | jdate_to_yymmdd | Terascan | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 8 | 4 | 8 | 8 | Similar to goes8ir_ingest & goes8vis_ingest, Also note that there are other wrapper "process" scripts that should be checked. | ||||
| goes8ir_ingest.csh | SGP GOES IR | n | n | n | n | n | n | n | y | n | y | y | n | y | n | n | n | n | jdate_to_yymmdd | Terascan | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 2 | 2 | 4 | 4 | Similar to avhrr_ingest & goes8vis_ingest, Also note that there are other wrapper "process" scripts that should be checked. | ||||
| goes8vis_ingest.csh | SGP GOES VIS | n | n | n | n | n | n | n | y | n | y | y | n | y | n | n | n | n | jdate_to_yymmdd | Terascan | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 2 | 2 | 4 | 4 | Similar to avhrr_ingest & goes8vis_ingest, Also note that there are other wrapper "process" scripts that should be checked. | ||||
| ksumeso | SGP Kansas Mesonet | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | development | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 4 | 4 | 4 | 1 | Calls main_juldate_to_yymmdd. Note: kansas ingest is currently being revised. Still waiting for quality assured data set for 1996, 1997 & 1998 | ||||||
| sgp05okm | SGP OKM 05 | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 2 | 3 | 2 | 1 | Similar to sgp15okm, Could be fixed at same time. Note that dates within raw files are 2 digit years. | ||||||
| sgp15okm | SGP OKM 15 | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 4 | 8 | 2 | 1 | Depends on Obstime & TC_UIToZt function to convert time to Zeb time, Similar to sgp05okm. | ||||||
| sgp06mmts | SGP WPDN MMTS | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | EBUFR Libs | production | Alice Cialella (Tammy Kwan) | n | n | n | n | y | y | 1 | 3 | 2 | 1 | See sgp60wpdn ingest (Same problems) Ingest is similar to sgp60surf,sgp60rass & sgp60wnd, Could all be fixed at the same time | |||||
| sgp60rass | SGP WPDN RASS | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | EBUFR Libs | production | Alice Cialella (Tammy Kwan) | n | n | n | n | y | y | 1 | 3 | 2 | 1 | See sgp60wpdn ingest (Same problems) Ingest is similar to sgp60surf,sgp06mmts & sgp60wnd, Could all be fixed at the same time | |||||
| sgp60surf | SGP WPD SURF | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | EBUFR Libs | production | Alice Cialella (Tammy Kwan) | n | n | n | n | y | y | 1 | 3 | 2 | 1 | See sgp60wpdn ingest (Same problems) Ingest is similar to sgp60rass,sgp06mmts & sgp60wnd, Could all be fixed at the same time | |||||
| sgp60wnd | SGP WPDN WIND | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | EBUFR Libs | production | Alice Cialella (Tammy Kwan) | n | n | n | n | y | y | 8 | 8 | 4 | 1 | Has a number of routines to manipulate time (date_chr_to_int, get_obs_time, next_sample_time (using obstime structure), eb_GetDataHdr(). Check if EBUFR stores date in yyyy or yy format? Uses ParseOutDate() to extract date from filename. Note similar to sgp60rass,sgp06mmts & sgp60surf. | |||||
| sgp60nwssurf | SGP NWS SURF 60 | y | y | n | n | y | n | n | n | n | y | y | n | n | y | n | y | y | EBUFR Libs | production | Alice Cialella | n | n | n | n | y | y | 4 | 4 | 4 | 4 | ||||||
| twp_runprocess | TWP GMS5 | GMS ingest & Hovmuller diagram routines | n | n | n | n | n | n | y | y | y | y | y | n | n | n | n | n | n | Terascan | production | Laurie.Gregory@arm.gov | n | n | n | n | y | y | 8 | 16 | 8 | 8 | Does lots of filename parsing. Testing takes time, due to large files being extracted from tape. | ||||
| gps_ingest.pro | GPS | n | n | n | n | n | n | n | y | y | y | y | n | n | n | y | n | n | arm_time.pro,zeb2cal | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 4 | 4 | ||||||||||
| make_ism | ISM | n | n | n | n | n | n | n | y | y | y | y | n | n | n | n | n | n | arm_time.pro, ncdf_getdata.pro, ncdf_helpers.pro,data_helpers.pro,ncdf_newfile.pro,time_helpers.pro, | development | y | 4 | 8 | 8 | 2 | VAP. Reads in okm, ksu, wpdnsurf, smos, and nwssurf data | |||||||||||
| Preprocess | The following scripts are in /apps/vip/bin | ||||||||||||||||||||||||||||||||||||
| check_xdata.pl | ALL XDC IDPC | Generate the daily filecheck report. | n | n | n | n | n | n | y | n | n | y | y | n | y | n | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | |||||||||||||
| clean_xdata.csh | ALL XDC IDPC | Clean files in /data on a daily basis. | n | n | n | n | n | n | y | n | n | y | n | y | yesterday.pl | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | |||||||||||||
| ecmwf_process.sh | ECMWF(NSA, SGP AND TWP) | Rename ECMWf ASCII data. | n | n | n | n | n | n | y | y | n | y | y | n | n | n | n | ecmwf_date.pl | n | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | 1 | This script calls ecmwf_date.pl | ||||||||
| ftpeop180.csh | SGP AVHRR AND SGP GOES | Deliver satellite data to Bill smith's group | n | n | n | n | n | n | n | y | n | n | y | n | y | yesterday.pl | n | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||
| get05okm.csh | SGP OKM 05 | Fetch the mising okm 05 data | n | n | n | n | n | n | n | y | n | y | y | n | y | y | ftpgetok05.csh | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | This script calls ftpgetokm05 | ||||||||||
| get15okm.csh | SGP OKM 15 | Fetch the mising okm 15 data | n | n | n | n | n | n | n | y | n | y | y | n | y | y | ftpgetok15.csh | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | This script calls ftpgetokm15 | ||||||||||
| getabrfc.csh | SGP ABRFC | Fetch the missing abrfc data | n | n | n | n | n | n | n | y | n | y | y | n | y | y | ftpgetstg3.csh, ftpgetstg3arc.csh | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | This script calls fetgetabrfc | ||||||||||
| ingest_xdata.csh | ALL XDC IDPC | Run the daily ingest programs for XDC raw data. | y | y | y | n | y | n | y | y | y | All ingest scritps, yesterday.pl | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | This script calls ingest scripts | ||||||||||||||||
| install_vip | ALL XDC IDPC | Release a new version of a VIP | n | n | y | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||||||||||||||
| move_seaspace.csh | SGP AVHRR AND SGP GOES | Move the file transferred completely | n | n | n | n | n | n | n | y | n | n | slowmove | production | wagener@arm.gov | y | y | 1 | 4 | 5 | 4 | This script call slowmove. It needs to be checked into by Rick. | |||||||||||||||
| okm_process.csh | SGP OKM | Rename the okm QA files | n | n | n | n | n | n | n | y | n | y | y | n | n | n | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | |||||||||||||
| renamewpdn.pl | SGP WPDN | Process the missing WPDN data retrieved | n | n | n | n | n | n | n | y | n | y | y | n | n | n | ebprint and ebselect | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||
| sgp_create_gifs.pl | SGP GOES | Create the gif files for GOES | n | n | n | n | n | n | y | y | y | y | n | n | sgp_create_gifs2.pro | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||||
| twp_create_gifs.pl | TWP GMS5 | Create the gif files for TWP GMS | n | n | n | n | n | n | y | y | y | y | n | n | twp_create_gifs/pro | production | Laurie.Gregory@arm.gov | y | y | 1 | 4 | 5 | 4 | ||||||||||||||
| twp_ecmwf.sh | TWP ECMWF | Rename the TWP ECMWF model data | n | n | n | n | y | y | y | y | n | y | y | n | n | n | n | n | n | twp_ecmwf_datyp.pl | agrdemo | production | Lynn.Ma@arm.gov | y | y | 1 | 4 | 5 | 4 | Use agrdemo to extract the beginning time. | |||||||
| Miscellaneous | The following scripts are in /home/operx/scripts | ||||||||||||||||||||||||||||||||||||
| clean_stagearea.pl | ALL XDC IDPC | This script will remove all files in stage area that appera in the Manifest | n | n | n | n | n | y | n | n | y | y | n | y | n | production | wagener@bnl.gov | y | 1 | 4 | 5 | 4 | This script needs to be checked into by Rick. | ||||||||||||||
| renameokmqa.csh | SGP OKM | Rename okm QA data | n | n | n | n | n | n | y | n | y | y | n | n | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | ||||||||||||||
| run_gridsub.csh | SGP RUC | Manually ingest RUC data | y | n | y | n | n | y | n | y | y | allruc60 | production | Laurie.Gregory@arm.gov | y | y | 1 | 1 | 1 | 1 | This script depends on the RUC ingest package. | ||||||||||||||||
| run_ruc.csh | SGP RUC | Manually ingest RUC data | y | n | y | n | n | y | n | y | y | gridsub.rsgp | production | Laurie.Gregory@arm.gov | y | y | 1 | 1 | 1 | 1 | This script depends on the RUC ingest package. | ||||||||||||||||
| tapeinv.sh | ECMWF | Generate the inventory report | n | n | n | n | n | y | y | n | y | y | n | n | inv.pl, period.pl | agrdemo | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | This script calls inv.pl and period.pl | ||||||||||||
| taravhrr.csh | SGP AVHRR | Tar avhrr daily diag. file into monthly tar file | n | n | n | n | y | n | y | y | n | y | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | ||||||||||||||||
| targoes.csh | SGP GOES | Tar goes8 hourly diag. files into a daily tar file. | n | n | n | n | n | n | y | n | y | y | n | y | n | production | Lynn.Ma@arm.gov | y | y | 1 | 1 | 1 | 1 | ||||||||||||||
| throttle2archive.pl | ALL XDC IDPC | Transfer files from /scratch/read_for_archive to out_going/archive.arm.gov | n | n | n | n | n | y | n | n | y | n | n | production | wagener@bnl.gov | y | y | 1 | 4 | 5 | 4 | This script needs to be checked into by Rick | |||||||||||||||
| Manifest | ALL XDC IDPC | Process the daily Manifest received from the Archive and EC. | n | n | n | n | n | y | y | n | n | n | IncomingManifest.pl, MnifestCron.sh, Manifest_filter | production | wagener@bnl.gov | y | 1 | 4 | 5 | 4 | This script needs to be checked into by Rick | ||||||||||||||||
| Other Software | |||||||||||||||||||||||||||||||||||||
| EBUFR Utilities | Utilities to read ebufr | ||||||||||||||||||||||||||||||||||||
| GRIB | |||||||||||||||||||||||||||||||||||||
| wgrib | |||||||||||||||||||||||||||||||||||||
| agrdemo | Read the data in bufr format | ||||||||||||||||||||||||||||||||||||
| Common Time utilities | |||||||||||||||||||||||||||||||||||||
| yesterday.pl | n | n | n | n | n | n | y | n | n | 4 | 4 | 4 | |||||||||||||||||||||||||
| arm_time.pro | n | n | n | n | n | n | n | n | y | y | 4 | 4 | 4 | ||||||||||||||||||||||||
| jdate_to_yymmdd | n | n | n | n | y | n | n | n | n | y | 4 | 4 | 4 | ||||||||||||||||||||||||
| y | |||||||||||||||||||||||||||||||||||||
| Zebra uliites in config_xdc release | ALL XDC IDPC | includes zstop, zebkill, & config files | |||||||||||||||||||||||||||||||||||
| Sums | 117 | 204 | 215 | 158 | |||||||||||||||||||||||||||||||||
| t | |||||||||||||||||||||||||||||||||||||
| Hours to assess | 117 | ||||||||||||||||||||||||||||||||||||
| Hours to fix | 204 | ||||||||||||||||||||||||||||||||||||
| Hours to unit test | 215 | ||||||||||||||||||||||||||||||||||||
| Hours to integrate | 158 | ||||||||||||||||||||||||||||||||||||
| SUM (TOTAL HOURS) | 694 | ||||||||||||||||||||||||||||||||||||
| SUM/8 (num of days) | 86.75 |