wrf.exe consuming too much time

Having problems running the WRF Preprocessing Sysmte (WPS)?

wrf.exe consuming too much time

Postby Bilal » Wed Jun 20, 2012 12:31 am

Hi,

I am using "Red Hat Enterprise Linux Server" with RAM = 98 GiB and 24 Intel Xeon CPU X5690 @ 3.47 GHz for WRF-ARW simulation. I ran the wrf.exe for four domains (d01 = 13.5km, d02 = 4.5km, d03=1.5km and d04 = 0.5km) for one day simulation with 16 CPU (processors) (mpirun -np 16 ./wrf.exe) but it completed the simulation after 51hr. I ran it again for one day simulation with 22 CPU (processors) and it only completed 400MB out of 1.31 GiB (of d04) within 19hr but it should be completed within one day.

Does anyone suggest me how to increase the performance of the server?

Thanks in advance for your kind response!

Best Regards,
Muhammad Bilal
Bilal
 
Posts: 14
Joined: Sun Feb 05, 2012 1:47 pm

Re: wrf.exe consuming too much time

Postby jan » Wed Jun 20, 2012 2:38 am

Bilal,
you did not mention the size of your domains. Post the namelist.wps.
Generally, the more domains you have, the longer the simulation will neeed. You will have very small time steps and there is a lot of communication going on, what could be a reason for your long computing time. You can have very fast CPU´s, but you also need a fast communication between the nodes and CPU´s.
jan
 
Posts: 174
Joined: Wed Jun 15, 2011 3:48 am
Location: Kiel, Germany, GEOMAR

Re: wrf.exe consuming too much time

Postby Bilal » Wed Jun 20, 2012 2:50 am

Hi Jan,

Thanks for your reply.

Please see the namelist.wps

&share
wrf_core = 'ARW',
max_dom = 4,
start_date = '2007-09-01_00:00:00','2007-09-01_00:00:00','2007-09-01_00:00:00','2007-09-01_00:00:00',
end_date = '2007-09-03_00:00:00','2007-09-03_00:00:00','2007-09-03_00:00:00','2007-09-03_00:00:00',
interval_seconds = 21600
io_form_geogrid = 2,
debug_level = 63,
/

&geogrid
parent_id = 1, 1, 2, 3,
parent_grid_ratio = 1, 3, 3, 3,
i_parent_start = 1, 23, 42, 37,
j_parent_start = 1, 36, 21, 25,
e_we = 100, 100, 103, 151,
e_sn = 100, 100, 100, 139,
geog_data_res = '5m', '2m', '30s', '30s',
dx = 13500,
dy = 13500,
map_proj = 'lambert',
ref_lat = 22.629,
ref_lon = 115.011,
truelat1 = 22.629,
truelat2 = 22.629,
stand_lon = 115.011,
geog_data_path = '/home/RSRG/WRF/geog'
ref_x = 50.0,
ref_y = 50.0,
/

&ungrib
out_format = 'WPS',
prefix = 'FILE',
/

&metgrid
fg_name = 'FILE'
io_form_metgrid = 2,
/


Domains size: (d01 = 13.5km, d02 = 4.5km, d03=1.5km and d04 = 0.5km)

time_Step = 81 (13.5 (km) *6 )

Actually I am not expert about the machine and other things. Would you please guide me how can I have a fast communication between nodes and CPUs.

Thank you.
Bilal
 
Posts: 14
Joined: Sun Feb 05, 2012 1:47 pm

Re: wrf.exe consuming too much time

Postby jan » Wed Jun 20, 2012 4:31 am

Your domain set up needs a lot of computing resources! Your first nest will require 3x as many time steps to keep pace with the coarse domain, also your nest number 2. For nest number 3 it is even higher, since you have more grid points, than in the coarser grid nests. If all your domains would have the same number of grid points and the 3:1 ratio, nest #4 will need 27x as many time steps as your coarse grid domain.
So think about increasing the resolution of your coarse grid domain. Doubling the coarse grid points results in only a 25% nested forecast time increase!
I would start here, and reduce the number of nests. Keep in mind to have approximately 1/3 of your coarse grid domain surrounding each side of your nest domain (suggested!, but at least 4 grid points).
jan
 
Posts: 174
Joined: Wed Jun 15, 2011 3:48 am
Location: Kiel, Germany, GEOMAR

Re: wrf.exe consuming too much time

Postby Bilal » Thu Jun 21, 2012 2:58 am

I want to use the same number of grids and domains. I thought may be there is way to speed up the computations. I have to compromise with the number of days. Thanks Jan for your valuable suggestions!
Bilal
 
Posts: 14
Joined: Sun Feb 05, 2012 1:47 pm

Re: wrf.exe consuming too much time

Postby Bilal » Mon Jun 25, 2012 11:54 pm

Hi Jan,

As I mentioned that I was using 22 core for wrf.exe simulation for 30hrs but after 68hrs I stopped it as it was not going to complete. After that I used 8 core for 30hrs and it was completed after 45hrs. I also checked with only 2 core for 30hrs simulation and it was completed after 29hrs. Now I ran the simulation for 54hrs with 4 core and let see when it will be completed.

Thanks!
Bilal
 
Posts: 14
Joined: Sun Feb 05, 2012 1:47 pm

Re: wrf.exe consuming too much time

Postby balaji » Sat Dec 29, 2012 1:47 pm

hi ..
I'm running wrf model for 5 day simulation using 'dmpar'. I'm using IBM AIX 6.1 server for the same. i used 10 processors to run the model from 25th apr06 to 30th apr06 and the model stopped at 27th apr06 UTC. "poe wrf.exe -hostfile hostfile -procs 10 >& wrfout.log &"
here is log file and namelist.wps. but if I found the model run successfully in serial mode with same configuration..
Thanks in advance..
log file....
starting wrf task 2 of 10
starting wrf task 3 of 10
starting wrf task 5 of 10
starting wrf task 0 of 10
starting wrf task 1 of 10
starting wrf task 4 of 10
starting wrf task 6 of 10
starting wrf task 7 of 10
starting wrf task 8 of 10
starting wrf task 9 of 10
ERROR: 0031-300 Forcing all remote tasks to exit due to exit code 1 in
task 0

namelist.wps.....
&share
wrf_core = 'ARW',
max_dom = 2,
start_date = '2006-04-25_00:00:00','2006-04-25_00:00:00',
end_date = '2006-04-30_18:00:00','2006-04-30_18:00:00',
interval_seconds = 21600
io_form_geogrid = 2,
/
&geogrid
parent_id = 1, 1,
parent_grid_ratio = 1, 3,
i_parent_start = 1, 23,
j_parent_start = 1, 24,
e_we = 151, 316,
e_sn = 151, 286,
geog_data_res = '10m','5m',
dx = 27000,
dy = 27000,
map_proj = 'mercator',
ref_lat = 15.00,
ref_lon = 87.40,
truelat1 = 30.00,
truelat2 = 00.00,
stand_lon = 87.40,
geog_data_path = '/user3/mandal/soma/geog'
/
&ungrib
out_format = 'WPS',
prefix = 'FILE',
/
&metgrid
fg_name = 'FILE','SST'
io_form_metgrid = 2,
/
balaji
 
Posts: 1
Joined: Thu Dec 27, 2012 6:04 am


Return to Runtime Problems

Who is online

Users browsing this forum: No registered users and 4 guests