Operational Modelling
From MohidWiki
Contents
Overview
This wiki intends to explain how operational models are set in the Mohid Maretec framework.
Before intending to put any model in operational, the model has to be strongly tested.
Folders Needed
In the folder where the model is going to be set up, it is needed to define the following generic folders:
- Backup
- GeneralData
- Logs
- Plots
- Work (only if atmospheric interpolation is needed)
Also a folder for the first level model will be defined, and it will contain the following subfolders:
- data
- exe
- figures
- res
- a folder with the name of the submodel in case it exist, this folder must replicate this same estructure
GeneralData folder
This folder must contains the following subfolders:
- Bathymetry: Here it should be contained the bathymetries used by the model
- BoundaryConditions: Folders for the boundary conditions should be defined here (Atmosphere, Hydrodynamics, etc.). In them, the temporary files for each run should be copied.
- Exe: In this folder should be located the MohidWater.exe file, this is the only name that is accepted for the Mohid executable file.
Also should contain any other subfolders needed for input/output definitions as discharges, timeseries or boxes files
Input Data
For each of the different modelling levels, a set of typical input data for each of the modules have to be selected (model.dat, hydrodynamic.dat, waterproperties.dat, turbulence.dat, etc.) also a set of hdf5 final files (.fin) for the hydrodynamic, GOTM and waterproperties in case they exist.
Atmospheric forcing
If the model have interpolated atmospheric forcing data for the particular gridded data, a location should be provided. In the case that it need to be calculated, a folder named work should be included with the configuration files and programs. Atmospherical forcing conditions can be provided by different sources: GFS, MM5 and WRF.
MM5
Two consecutive programs would be executed here, a first program GetWindForecast.exe that will go to find the files corresponding for the selected dates and that automatically will glue the files using a second software ConvertToHDF5Action.exe. The input file for the first software is described below.
GetMM5Forecast.dat MM5_PATH : \\ftpserver\ftp.mohid.com\LocalUser\meteoIST\mm5_6h\ WORK_PATH : D:\Aplica\PCOMS\Work\MM5\ OUTPUT_FOLDER : D:\Aplica\PCOMS\Work\MM5\History\ BACKUP_FOLDER : \\datacenter\alexandria4\modelos\Mohid_IST\PCOMS\Portugal\Meteo\ MOHID_GRID : Portugal.dat MAIL_SERVER : mail.ist.utl.pt MAIL_SENDER_NAME : Portuguese Coast Operational Modelling System MAIL_SENDER_ADDRESS : CHECK_NUMBER_OF_FILES : 1 NUMBER_OF_FILES : 13 <begin_out_email_list> <end_out_email_list>
Once the first software has performed the find and glue task, the ConvertToHDF5Action.exe will generate a input file for the desired period of time and will interpolate for the selected grid.
ConvertToHDF5Action.dat <begin_file> ACTION : PATCH HDF5 FILES TYPE_OF_INTERPOLATION : 3 START : 2011 4 19 0 0 0 END : 2011 4 22 0 0 0 <<begin_father>> FATHER_FILENAME : MM5_D2_Portugal.hdf5 FATHER_GRID_FILENAME : D2.dat LEVEL : 2 <<end_father>> <<begin_father>> FATHER_FILENAME : MM5_D3_Portugal.hdf5 FATHER_GRID_FILENAME : D3.dat LEVEL : 3 <<end_father>> OUTPUTFILENAME : MM5_Portugal_2011-04-19_2011-04-22.hdf5 NEW_GRID_FILENAME : Portugal.dat <<BeginFields>> air temperature downward long wave radiation wind velocity X wind velocity Y wind modulus relative humidity solar radiation mean sea level pressure <<EndFields>> <end_file>
WRF
Two consecutive programs would be executed here, a first program GetMeteoForecast.exe that will go to find the files corresponding for the selected dates and that automatically will glue the files using a second software ConvertToHDF5Action.exe. The input file for the first software is described below.
GetMeteoForecast.dat METEO_MODEL : WRF METEO_MODEL_PATH : \\DATACENTER\alexandria3\modelos\Meteo_IST\wrf_6h WORK_PATH : D:\Aplica\OPTagus3D\Work\WRF\ OUTPUT_FOLDER : D:\Aplica\OPTagus3D\Work\WRF\History\ BACKUP_FOLDER : \\datacenter\alexandria4\modelos\Mohid_IST\OPTagus3D\Tagus\Meteo\ MOHID_GRID : D:\Aplica\OPTagus3D\GeneralData\Bathymetry\TagusRibeiras.dat MOHID_GRID_LABEL : Tagus3D MAIL_SERVER : mail.ist.utl.pt MAIL_SENDER_NAME : OPTagus3D MAIL_SENDER_ADDRESS : !So por ser hindcast START : 2011 2 6 0 0 0 END : 2011 2 7 0 0 0 !NUMBER_OF_DAYS : 1 !CHECK_NUMBER_OF_FILES : 1 !NUMBER_OF_FILES : 5 <begin_domain_list> WRF_3km Lisbon 3 <end_domain_list> <begin_out_email_list> <end_out_email_list>
Once the first software has performed the find and glue task, the ConvertToHDF5Action.exe will generate a input file for the desired period of time and will interpolate for the selected grid.
ConvertToHDF5Action.dat <begin_file> ACTION : INTERPOLATE GRIDS TYPE_OF_INTERPOLATION : 3 START : 2011 2 6 0 0 0 END : 2011 2 7 0 0 0 <<begin_father>> FATHER_FILENAME : WRF_WRF_3km_Lisbon.hdf5 FATHER_GRID_FILENAME : WRF_3km.dat LEVEL : 3 <end_father>> OUTPUTFILENAME : WRF_Tagus3D_2011-02-06_2011-02-07.hdf5 NEW_GRID_FILENAME : D:\Aplica\OPTagus3D\GeneralData\Bathymetry\TagusRibeiras.dat <<BeginFields>> air temperature downward long wave radiation wind velocity X wind velocity Y wind modulus relative humidity solar radiation mean sea level pressure <<EndFields>> <end_file>
Running Mohid
In each of the exe folder a nomfich.dat should be placed and modified with the following information.
nomfich.dat IN_BATIM : ..\..\GeneralData\Bathymetry\Portugal_Window.dat ROOT : D:\Aplica\OPTagus3D\Portugal_Window\res\ ROOT_SRT : D:\Aplica\OPTagus3D\Portugal_Window\res\Run1\ IN_MODEL : D:\Aplica\OPTagus3D\Portugal_Window\data\Model_1.dat SURF_DAT : D:\Aplica\OPTagus3D\Portugal_Window\data\Atmosphere_1.dat SURF_HDF : D:\Aplica\OPTagus3D\Portugal_Window\res\Atmosphere_1.hdf DOMAIN : D:\Aplica\OPTagus3D\Portugal_Window\data\Geometry_1.dat AIRW_DAT : D:\Aplica\OPTagus3D\Portugal_Window\data\InterfaceWaterAir_1.dat AIRW_HDF : D:\Aplica\OPTagus3D\Portugal_Window\res\InterfaceWaterAir_1.hdf BOT_DAT : D:\Aplica\OPTagus3D\Portugal_Window\data\InterfaceSedimentWater_1.dat BOT_HDF : D:\Aplica\OPTagus3D\Portugal_Window\res\InterfaceSedimentWater_1.hdf IN_DAD3D : D:\Aplica\OPTagus3D\Portugal_Window\data\Hydrodynamic_1.dat OUT_DESF : D:\Aplica\OPTagus3D\Portugal_Window\res\Hydrodynamic_1.hdf IN_TURB : D:\Aplica\OPTagus3D\Portugal_Window\data\Turbulence_1.dat TURB_HDF : D:\Aplica\OPTagus3D\Portugal_Window\res\Turbulence_1.hdf DISPQUAL : D:\Aplica\OPTagus3D\Portugal_Window\data\WaterProperties_1.dat EUL_HDF : D:\Aplica\OPTagus3D\Portugal_Window\res\WaterProperties_1.hdf OUTWATCH : D:\Aplica\OPTagus3D\Portugal_Window\res\Outwatch_1.txt DT_LOG : D:\Aplica\OPTagus3D\Portugal_Window\res\DTLog_1.txt
and also a Tree.dat file with the locations of the respective submodels to be run, in case there is a problem and only one of them is to be ran, it is enough to include an empty line between the different domains.
Tree.dat +D:\Aplica\OPTagus3d\Portugal_Window\exe ++D:\Aplica\OPTagus3d\Portugal_Window\3DTagusWQ\exe
Hindcasting
In this case it will be used the executable AutoTagusROFI.exe and the configuration file is TagusROFI-Auto.dat, in this file should be indicated the location of the specific configuration input files and the minimum and maximum time that the model should run, to stop the operational procedure in seconds.
TagusROFI-Auto.dat START : 2011 01 08 0 0 0 END : 2011 03 01 0 0 0 TAGUSROFI_INPUT_FILE : \\turbo\aplica\OPSAndre\TagusROFI.dat TAGUSROFIPLOTS_INPUT_FILE : \\turbo\aplica\OPSAndre\Plots\MatlabPlots.dat TAGUSROFI_METEO_INPUT_FILE : \\turbo\aplica\OPSAndre\Work\WRF\GetMeteoForecast.dat TAGUSROFI_BATCH : \\turbo\aplica\OPSAndre\TagusROFI.bat PLOTS_ONLY : 0 MIN_TIME : 200 MAX_TIME : 30000
TagusROFI.dat MAIN_PATH : D:\Aplica\OPTagus3D\ MAIL_SERVER : mail.ist.utl.pt MAIL_SENDER_NAME : OPTagus3D MAIL_SENDER_ADDRESS :
START : 2011 2 12 0 0 0 END : 2011 2 13 0 0 0
OPENMP : 1 OPENMP_NUM_THREADS : 6
<begin_out_email_list> List of e-mail addresses to be contacted in the format name <email address> <end_out_email_list>
<begin_model> NAME : Portugal_Window PATH : Portugal_Window\ MODEL_HAS_OBC : 1 OBC_WORK_PATH : MODEL_HAS_METEO : 0 GRID_FILE : MODEL_RUN_ID : 1 DT : 180 BACKUP_PATH : D:\Aplica\OPTagus3D\BackUp\Portugal_Window\ STORAGE_PATH : \\DATACENTER\alexandria4\modelos\Mohid_IST\OPTagus3D\Portugal_Window\ MODEL_HAS_WATERPROPERTIES : 1 MODEL_HAS_SURFACE_HDF : 0 MODEL_HAS_GOTM : 0 MODEL_HAS_OUTPUT_WINDOW : 0 MODEL_HAS_SOLUTION_FROM_FILE : 1 <end_model>
<begin_model> NAME : 3DTagusWQ PATH : Portugal_Window\3DTagusWQ\ MODEL_HAS_OBC : 0 MODEL_HAS_METEO : 1 METEO_WORK_PATH : D:\Aplica\OPTagus3D\Work\WRF\History\ GRID_FILE : Portugal_Window\GeneralData\Bathymetry\TagusRibeiras.dat MODEL_RUN_ID : 1 DT : 12 BACKUP_PATH : D:\Aplica\OPTagus3D\BackUp\3DTagusWQ\ STORAGE_PATH : MODEL_HAS_WATERPROPERTIES : 1 MODEL_HAS_INTERFACESEDIMENTWATER : 1 MODEL_HAS_SURFACE_HDF : 1 MODEL_HAS_GOTM : 1 MODEL_HAS_OUTPUT_WINDOW : 0 <end_model>
Forecasting
In this case the executable to be used will be TagusROFI-OP.exe
Running Manually
The batch file to be used will be MOHID_run - manual.bat and should be edited according to the project, as an example:
cd "D:\Aplica\OPSAndre\Portugal_Window\exe" D: "D:\Aplica\OPSAndre\GeneralData\Exe\MohidWater.exe" pause
Backup and Storage
A folder containing the name of each submodels should be created in the backup folder, i.e.
D:\Aplica\OPSAndre\BackUp\Portugal_Window\
and also a location in the dataserver should be created for the storage, i.e.
\\datacenter\alexandria4\modelos\Mohid_IST\OPSAndre\Portugal_Window\
Plots
Publishing online
Operational Models
PCOMS running in mar computer
BIOPCOMS WQ running in pcoms-bio computer
PCOMS-BIO2 Life running in pcoms-bio computer
OPTagus3D running in Tagus computer