WRF Crashes over an hour into simulation

Any issues with the actual running of the WRF.

WRF Crashes over an hour into simulation

Postby bptyner » Wed Nov 20, 2013 3:08 pm

I am conducting a simulation using WRFV3.5. The simulation includes three mesoscale domains (8.1 km, 2.7 km, 0.9 km grid spacings) and two LES domains nested within (0.3 km and 0.1 km grid spacings). The model is run near the coastline of North Carolina, but not over the ocean/sounds. The model runs without problem for over an hour. However, sometime near 1 hour, 10 minutes into simulation, the processes are killed at appears when the radiation driver is called for domain 5 (based on debug_level=1000). Based on the forums, I thought I was possibly breaking a CFL condition, but when I look at my rsl.error files, I do not see anywhere where the CFL condition is violated. Does anyone have any suggestions? Are there any ways to narrow down the problem? I would be happy to provide whatever additional information is needed.
bptyner
 
Posts: 8
Joined: Wed Nov 20, 2013 3:03 pm

Re: WRF Crashes over an hour into simulation

Postby bassline » Thu Nov 21, 2013 4:18 am

What are the errors on rsl.error.00** files?
bassline
 
Posts: 55
Joined: Tue Jan 29, 2013 3:25 pm

Re: WRF Crashes over an hour into simulation

Postby bptyner » Tue Nov 26, 2013 12:32 pm

I have searched the rsl.error.* files for errors and I do not see any (did a grep command for error, cfl, etc.). I am running with debug_level set to 1000. Below are the final several lines of output in rsl.error.0000:

d05 2011-08-27_01:07:49+08/09 calling inc/HALO_EM_E_5_inline.inc
d05 2011-08-27_01:07:49+08/09 call HALO_RK_MOIST
d05 2011-08-27_01:07:49+08/09 calling inc/HALO_EM_MOIST_E_5_inline.inc
d05 2011-08-27_01:07:49+08/09 call HALO_RK_SCALAR
d05 2011-08-27_01:07:49+08/09 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d05 2011-08-27_01:07:49+08/09 call end of solve_em
d05 2011-08-27_01:07:49+08/09 DEBUG wrf_timetoa(): returning with str = [2011
-08-27_01:07:49]
d05 2011-08-27_01:07:49+08/09 DEBUG wrf_timetoa(): returning with str = [2011
-08-27_01:00:05]
d05 2011-08-27_01:07:49+08/09 DEBUG wrf_timetoa(): returning with str = [2011
-08-28_00:00:00]
d05 2011-08-27_01:07:49+08/09 DEBUG wrf_timeinttoa(): returning with str = [0
000000000_000:000:000]
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock start time = 20
11-08-27_01:00:05
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock current time =
2011-08-27_01:07:49
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock stop time = 201
1-08-28_00:00:00
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock time step = 000
0000000_000:000:000
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d05 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:000]
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock start time = 201
1-08-27_01:00:05
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock current time = 2
011-08-27_01:07:50
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock stop time = 2011
-08-28_00:00:00
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock time step = 0000
000000_000:000:000
d05 2011-08-27_01:07:50 module_integrate: back from solve interface
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
Timing for main: time 2011-08-27_01:07:50 on domain 5: 0.06958 elapsed seconds
d05 2011-08-27_01:07:50 module_integrate: back from recursive call to integrate
d05 2011-08-27_01:07:50 module_integrate: calling med_nest_feedback
d05 2011-08-27_01:07:50 module_integrate: back from med_nest_feedback
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
Timing for main: time 2011-08-27_01:07:50 on domain 4: 0.39465 elapsed seconds
d04 2011-08-27_01:07:50 module_integrate: back from recursive call to integrate
d04 2011-08-27_01:07:50 module_integrate: calling med_nest_feedback
d04 2011-08-27_01:07:50 module_integrate: back from med_nest_feedback
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
Timing for main: time 2011-08-27_01:07:50 on domain 3: 1.53321 elapsed seconds
d03 2011-08-27_01:07:50 module_integrate: back from recursive call to integrate
d03 2011-08-27_01:07:50 module_integrate: calling med_nest_feedback
d03 2011-08-27_01:07:50 calling inc/HALO_INTERP_UP_inline.inc
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d03 2011-08-27_01:07:50 calling inc/HALO_INTERP_UP_inline.inc
d03 2011-08-27_01:07:50 entering update_after_feedback_em
d03 2011-08-27_01:07:50 before HALO_EM_FEEDBACK.inc in update_after_feedback_em
d03 2011-08-27_01:07:50 calling inc/HALO_EM_FEEDBACK_inline.inc
d03 2011-08-27_01:07:50 leaving update_after_feedback_em
d03 2011-08-27_01:07:50 module_integrate: back from med_nest_feedback
d02 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
Timing for main: time 2011-08-27_01:07:50 on domain 2: 5.79317 elapsed seconds
d02 2011-08-27_01:07:50 in med_latbound_in
d02 2011-08-27_01:07:50 module_integrate: calling solve interface
d02 2011-08-27_01:07:50 grid spacing, dt, time_step_sound= 2700.000 3.
000000 4
d02 2011-08-27_01:07:50 call rk_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d02 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d02 2011-08-27_01:07:50 call init_zero_tendency
d02 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_A_inline.inc
d02 2011-08-27_01:07:50 call phy_prep
d02 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d02 2011-08-27_01:07:50 call radiation_driver
d02 2011-08-27_01:07:50 Top of Radiation Driver
d02 2011-08-27_01:07:50 CALL rrtm
d02 2011-08-27_01:07:50 CAM-CLWRF interpolated values______ year: 2011
julian day: 238.0471
d02 2011-08-27_01:07:50 CAM-CLWRF co2vmr: 3.790000046137720E-004 n2ovmr:
3.190000086306100E-007 ch4vmr: 1.773999997567444E-006
d02 2011-08-27_01:07:50 CALL swrad
d02 2011-08-27_01:07:50 calling inc/HALO_PWP_inline.inc
d02 2011-08-27_01:07:50 call surface_driver
d02 2011-08-27_01:07:50 SST_UPDATE is on
d02 2011-08-27_01:07:50 in SFCLAY
d02 2011-08-27_01:07:50 in SLAB
d02 2011-08-27_01:07:50 in SFCDIAGS
d02 2011-08-27_01:07:50 call pbl_driver
d02 2011-08-27_01:07:50 in YSU PBL
d02 2011-08-27_01:07:50 call cumulus_driver
d02 2011-08-27_01:07:50 call shallow_cumulus_driver
d02 2011-08-27_01:07:50 calling inc/HALO_EM_FDDA_SFC_inline.inc
d02 2011-08-27_01:07:50 call fddagd_driver
d02 2011-08-27_01:07:50 call calculate_phy_tend
d02 2011-08-27_01:07:50 call compute_diff_metrics
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A1_inline.inc
d02 2011-08-27_01:07:50 call bc for diffusion_metrics
d02 2011-08-27_01:07:50 call cal_deform_and_div
d02 2011-08-27_01:07:50 calling inc/HALO_EM_HELICITY_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_D_inline.inc
d02 2011-08-27_01:07:50 call calculate_km_kh
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_E_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_PHY_BC_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d02 2011-08-27_01:07:50 call phy_bc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_PBL_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_DIFFUSION_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d02 2011-08-27_01:07:50 call update_phy_ten
d02 2011-08-27_01:07:50 call rk_tendency
d02 2011-08-27_01:07:50 call small_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 call rk_small_finish
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d02 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d02 2011-08-27_01:07:50 call rk_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d02 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d02 2011-08-27_01:07:50 call rk_tendency
d02 2011-08-27_01:07:50 call small_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 call rk_small_finish
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d02 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_7_inline.inc
d02 2011-08-27_01:07:50 call rk_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d02 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d02 2011-08-27_01:07:50 call rk_tendency
d02 2011-08-27_01:07:50 call small_step_prep
d02 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d02 2011-08-27_01:07:50 call rk_small_finish
d02 2011-08-27_01:07:50 call rk_update_scalar_pd
d02 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_OLD_E_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_OLD_inline.inc
d02 2011-08-27_01:07:50 call rk_update_scalar_pd
d02 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_OLD_E_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_OLD_inline.inc
d02 2011-08-27_01:07:50 call rk_update_scalar_pd
d02 2011-08-27_01:07:50 calling inc/HALO_EM_CHEM_OLD_E_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_OLD_inline.inc
d02 2011-08-27_01:07:50 call rk_update_scalar_pd
d02 2011-08-27_01:07:50 calling inc/HALO_EM_TRACER_OLD_E_7_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_OLD_inline.inc
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call rk_scalar_tend
d02 2011-08-27_01:07:50 call rk_update_scalar
d02 2011-08-27_01:07:50 call advance_ppt
d02 2011-08-27_01:07:50 call moist_physics_prep
d02 2011-08-27_01:07:50 call microphysics_driver
d02 2011-08-27_01:07:50 microphysics_driver: calling thompson
d02 2011-08-27_01:07:50 MP-GT:qc: 0.000000E+00 ( 0, 0, 0) qr: 0.000000E+00
( 0, 0, 0) qi: 0.000000E+00 ( 0, 0, 0) qs: 0.000000E+00 ( 0, 0, 0)
qg: 0.000000E+00 ( 0, 0, 0) ni: 0.000000E+00 ( 0, 0, 0) nr: 0.000000E+
00 ( 0, 0, 0)
d02 2011-08-27_01:07:50 microphysics_driver: returning from
d02 2011-08-27_01:07:50 call moist_physics_finish
d02 2011-08-27_01:07:50 call chem polar filter
d02 2011-08-27_01:07:50 calling inc/HALO_EM_D3_5_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D3_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_inline.inc
d02 2011-08-27_01:07:50 call set_phys_bc_dry_2
d02 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d02 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_E_inline.inc
d02 2011-08-27_01:07:50 call set_w_surface
d02 2011-08-27_01:07:50 call diagnostic_driver
d02 2011-08-27_01:07:50 call HALO_RK_E
d02 2011-08-27_01:07:50 calling inc/HALO_EM_E_5_inline.inc
d02 2011-08-27_01:07:50 call HALO_RK_MOIST
d02 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d02 2011-08-27_01:07:50 call HALO_RK_SCALAR
d02 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d02 2011-08-27_01:07:50 call end of solve_em
d02 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d02 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d02 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d02 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:003]
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock start time = 20
11-08-27_01:00:05
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock current time =
2011-08-27_01:07:50
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock stop time = 201
1-08-28_00:00:00
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock time step = 000
0000000_000:000:003
d02 2011-08-27_01:07:53 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:53]
d02 2011-08-27_01:07:53 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d02 2011-08-27_01:07:53 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d02 2011-08-27_01:07:53 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:003]
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock start time = 201
1-08-27_01:00:05
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock current time = 2
011-08-27_01:07:53
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock stop time = 2011
-08-28_00:00:00
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock time step = 0000
000000_000:000:003
d02 2011-08-27_01:07:53 module_integrate: back from solve interface
d03 2011-08-27_01:07:50 module_integrate: calling med_nest_force
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_FORCE_DOWN_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d03 2011-08-27_01:07:50 module_integrate: back from med_nest_force
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d03 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:001]
DEBUG: top of integrate(), clock start time = 2011-08-27_01:00:05
DEBUG: top of integrate(), clock current time = 2011-08-27_01:07:50
DEBUG: top of integrate(), clock stop time = 2011-08-28_00:00:00
DEBUG: top of integrate(), clock time step = 0000000000_000:000:001
d03 2011-08-27_01:07:50 in med_latbound_in
d03 2011-08-27_01:07:50 module_integrate: calling solve interface
d03 2011-08-27_01:07:50 grid spacing, dt, time_step_sound= 900.0000 1.
000000 4
d03 2011-08-27_01:07:50 call rk_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d03 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d03 2011-08-27_01:07:50 call init_zero_tendency
d03 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_A_inline.inc
d03 2011-08-27_01:07:50 call phy_prep
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d03 2011-08-27_01:07:50 call radiation_driver
d03 2011-08-27_01:07:50 Top of Radiation Driver
d03 2011-08-27_01:07:50 CALL rrtm
d03 2011-08-27_01:07:50 CAM-CLWRF interpolated values______ year: 2011
julian day: 238.0471
d03 2011-08-27_01:07:50 CAM-CLWRF co2vmr: 3.790000046137720E-004 n2ovmr:
3.190000086306100E-007 ch4vmr: 1.773999997567444E-006
d03 2011-08-27_01:07:50 CALL swrad
d03 2011-08-27_01:07:50 calling inc/HALO_PWP_inline.inc
d03 2011-08-27_01:07:50 call surface_driver
d03 2011-08-27_01:07:50 SST_UPDATE is on
d03 2011-08-27_01:07:50 in SFCLAY
d03 2011-08-27_01:07:50 in SLAB
d03 2011-08-27_01:07:50 in SFCDIAGS
d03 2011-08-27_01:07:50 call pbl_driver
d03 2011-08-27_01:07:50 in YSU PBL
d03 2011-08-27_01:07:50 call cumulus_driver
d03 2011-08-27_01:07:50 call shallow_cumulus_driver
d03 2011-08-27_01:07:50 calling inc/HALO_EM_FDDA_SFC_inline.inc
d03 2011-08-27_01:07:50 call fddagd_driver
d03 2011-08-27_01:07:50 call calculate_phy_tend
d03 2011-08-27_01:07:50 call compute_diff_metrics
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A1_inline.inc
d03 2011-08-27_01:07:50 call bc for diffusion_metrics
d03 2011-08-27_01:07:50 call cal_deform_and_div
d03 2011-08-27_01:07:50 calling inc/HALO_EM_HELICITY_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_D_inline.inc
d03 2011-08-27_01:07:50 call calculate_km_kh
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_E_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_PHY_BC_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d03 2011-08-27_01:07:50 call phy_bc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_PBL_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_DIFFUSION_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d03 2011-08-27_01:07:50 call update_phy_ten
d03 2011-08-27_01:07:50 call rk_tendency
d03 2011-08-27_01:07:50 call small_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 call rk_small_finish
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d03 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d03 2011-08-27_01:07:50 call rk_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d03 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d03 2011-08-27_01:07:50 call rk_tendency
d03 2011-08-27_01:07:50 call small_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 call rk_small_finish
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d03 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_7_inline.inc
d03 2011-08-27_01:07:50 call rk_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d03 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d03 2011-08-27_01:07:50 call rk_tendency
d03 2011-08-27_01:07:50 call small_step_prep
d03 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d03 2011-08-27_01:07:50 call rk_small_finish
d03 2011-08-27_01:07:50 call rk_update_scalar_pd
d03 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_OLD_E_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_OLD_inline.inc
d03 2011-08-27_01:07:50 call rk_update_scalar_pd
d03 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_OLD_E_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_OLD_inline.inc
d03 2011-08-27_01:07:50 call rk_update_scalar_pd
d03 2011-08-27_01:07:50 calling inc/HALO_EM_CHEM_OLD_E_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_OLD_inline.inc
d03 2011-08-27_01:07:50 call rk_update_scalar_pd
d03 2011-08-27_01:07:50 calling inc/HALO_EM_TRACER_OLD_E_7_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_OLD_inline.inc
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call rk_scalar_tend
d03 2011-08-27_01:07:50 call rk_update_scalar
d03 2011-08-27_01:07:50 call advance_ppt
d03 2011-08-27_01:07:50 call moist_physics_prep
d03 2011-08-27_01:07:50 call microphysics_driver
d03 2011-08-27_01:07:50 microphysics_driver: calling thompson
d03 2011-08-27_01:07:50 MP-GT:qc: 0.661948E-03 ( 12, 5, 45) qr: 0.101132E-03
( 13, 2, 29) qi: 0.605532E-05 ( 6, 10, 53) qs: 0.584744E-03 ( 13, 2, 50)
qg: 0.205429E-05 ( 2, 12, 47) ni: 0.340410E+06 ( 2, 12, 53) nr: 0.343082E+
04 ( 13, 2, 35)
d03 2011-08-27_01:07:50 microphysics_driver: returning from
d03 2011-08-27_01:07:50 call moist_physics_finish
d03 2011-08-27_01:07:50 call chem polar filter
d03 2011-08-27_01:07:50 calling inc/HALO_EM_D3_5_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D3_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_inline.inc
d03 2011-08-27_01:07:50 call set_phys_bc_dry_2
d03 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d03 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_E_inline.inc
d03 2011-08-27_01:07:50 call set_w_surface
d03 2011-08-27_01:07:50 call diagnostic_driver
d03 2011-08-27_01:07:50 call HALO_RK_E
d03 2011-08-27_01:07:50 calling inc/HALO_EM_E_5_inline.inc
d03 2011-08-27_01:07:50 call HALO_RK_MOIST
d03 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d03 2011-08-27_01:07:50 call HALO_RK_SCALAR
d03 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d03 2011-08-27_01:07:50 call end of solve_em
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d03 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d03 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:001]
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock start time = 20
11-08-27_01:00:05
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock current time =
2011-08-27_01:07:50
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock stop time = 201
1-08-28_00:00:00
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock time step = 000
0000000_000:000:001
d03 2011-08-27_01:07:51 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:51]
d03 2011-08-27_01:07:51 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d03 2011-08-27_01:07:51 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d03 2011-08-27_01:07:51 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:001]
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock start time = 201
1-08-27_01:00:05
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock current time = 2
011-08-27_01:07:51
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock stop time = 2011
-08-28_00:00:00
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock time step = 0000
000000_000:000:001
d03 2011-08-27_01:07:51 module_integrate: back from solve interface
d04 2011-08-27_01:07:50 module_integrate: calling med_nest_force
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_FORCE_DOWN_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d04 2011-08-27_01:07:50 module_integrate: back from med_nest_force
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d04 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:000]
DEBUG: top of integrate(), clock start time = 2011-08-27_01:00:05
DEBUG: top of integrate(), clock current time = 2011-08-27_01:07:50
DEBUG: top of integrate(), clock stop time = 2011-08-28_00:00:00
DEBUG: top of integrate(), clock time step = 0000000000_000:000:000
d04 2011-08-27_01:07:50 in med_latbound_in
d04 2011-08-27_01:07:50 module_integrate: calling solve interface
d04 2011-08-27_01:07:50 grid spacing, dt, time_step_sound= 300.0000 0.3
333333 4
d04 2011-08-27_01:07:50 call rk_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d04 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d04 2011-08-27_01:07:50 call init_zero_tendency
d04 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_A_inline.inc
d04 2011-08-27_01:07:50 call phy_prep
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d04 2011-08-27_01:07:50 call radiation_driver
d04 2011-08-27_01:07:50 Top of Radiation Driver
d04 2011-08-27_01:07:50 CALL rrtm
d04 2011-08-27_01:07:50 CAM-CLWRF interpolated values______ year: 2011
julian day: 238.0471
d04 2011-08-27_01:07:50 CAM-CLWRF co2vmr: 3.790000046137720E-004 n2ovmr:
3.190000086306100E-007 ch4vmr: 1.773999997567444E-006
d04 2011-08-27_01:07:50 CALL swrad
d04 2011-08-27_01:07:50 calling inc/HALO_PWP_inline.inc
d04 2011-08-27_01:07:50 call surface_driver
d04 2011-08-27_01:07:50 SST_UPDATE is on
d04 2011-08-27_01:07:50 in SFCLAY
d04 2011-08-27_01:07:50 in SLAB
d04 2011-08-27_01:07:50 in SFCDIAGS
d04 2011-08-27_01:07:50 call pbl_driver
d04 2011-08-27_01:07:50 call cumulus_driver
d04 2011-08-27_01:07:50 call shallow_cumulus_driver
d04 2011-08-27_01:07:50 calling inc/HALO_EM_FDDA_SFC_inline.inc
d04 2011-08-27_01:07:50 call fddagd_driver
d04 2011-08-27_01:07:50 call calculate_phy_tend
d04 2011-08-27_01:07:50 call compute_diff_metrics
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A1_inline.inc
d04 2011-08-27_01:07:50 call bc for diffusion_metrics
d04 2011-08-27_01:07:50 call cal_deform_and_div
d04 2011-08-27_01:07:50 calling inc/HALO_EM_HELICITY_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_D_inline.inc
d04 2011-08-27_01:07:50 call calculate_km_kh
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_E_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_PHY_BC_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d04 2011-08-27_01:07:50 call phy_bc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_DIFFUSION_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d04 2011-08-27_01:07:50 call update_phy_ten
d04 2011-08-27_01:07:50 call vertical_diffusion_2
d04 2011-08-27_01:07:50 call horizontal_diffusion_2
d04 2011-08-27_01:07:50 call rk_tendency
d04 2011-08-27_01:07:50 call small_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 call rk_small_finish
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d04 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_5_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d04 2011-08-27_01:07:50 call rk_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d04 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d04 2011-08-27_01:07:50 call rk_tendency
d04 2011-08-27_01:07:50 call small_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 call rk_small_finish
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D2_5_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR2_inline.inc
d04 2011-08-27_01:07:50 call rk_phys_bc_dry_2
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TKE_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_7_inline.inc
d04 2011-08-27_01:07:50 call rk_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d04 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d04 2011-08-27_01:07:50 call rk_tendency
d04 2011-08-27_01:07:50 call small_step_prep
d04 2011-08-27_01:07:50 calling inc/HALO_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C2_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_B3_inline.inc
d04 2011-08-27_01:07:50 call rk_small_finish
d04 2011-08-27_01:07:50 call rk_update_scalar_pd
d04 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_OLD_E_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_OLD_inline.inc
d04 2011-08-27_01:07:50 call rk_update_scalar_pd
d04 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_OLD_E_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_OLD_inline.inc
d04 2011-08-27_01:07:50 call rk_update_scalar_pd
d04 2011-08-27_01:07:50 calling inc/HALO_EM_CHEM_OLD_E_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_OLD_inline.inc
d04 2011-08-27_01:07:50 call rk_update_scalar_pd
d04 2011-08-27_01:07:50 calling inc/HALO_EM_TRACER_OLD_E_7_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_OLD_inline.inc
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_EM_DA_inline.inc
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call rk_scalar_tend
d04 2011-08-27_01:07:50 call rk_update_scalar
d04 2011-08-27_01:07:50 call advance_ppt
d04 2011-08-27_01:07:50 call moist_physics_prep
d04 2011-08-27_01:07:50 call microphysics_driver
d04 2011-08-27_01:07:50 microphysics_driver: calling thompson
d04 2011-08-27_01:07:50 MP-GT:qc: 0.334362E-03 ( 6, 2, 46) qr: 0.659540E-04
( 2, 6, 45) qi: 0.597516E-05 ( 3, 3, 53) qs: 0.283725E-03 ( 6, 3, 48)
qg: 0.502593E-04 ( 5, 6, 47) ni: 0.527510E+06 ( 6, 2, 53) nr: 0.276075E+
04 ( 2, 6, 46)
d04 2011-08-27_01:07:50 microphysics_driver: returning from
d04 2011-08-27_01:07:50 call moist_physics_finish
d04 2011-08-27_01:07:50 call chem polar filter
d04 2011-08-27_01:07:50 calling inc/HALO_EM_D3_5_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_D3_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_MOIST_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_CHEM_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_TRACER_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_SCALAR_inline.inc
d04 2011-08-27_01:07:50 call set_phys_bc_dry_2
d04 2011-08-27_01:07:50 calling inc/HALO_EM_C_inline.inc
d04 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_E_inline.inc
d04 2011-08-27_01:07:50 call set_w_surface
d04 2011-08-27_01:07:50 call diagnostic_driver
d04 2011-08-27_01:07:50 call HALO_RK_E
d04 2011-08-27_01:07:50 calling inc/HALO_EM_E_5_inline.inc
d04 2011-08-27_01:07:50 call HALO_RK_MOIST
d04 2011-08-27_01:07:50 calling inc/HALO_EM_MOIST_E_5_inline.inc
d04 2011-08-27_01:07:50 call HALO_RK_SCALAR
d04 2011-08-27_01:07:50 calling inc/HALO_EM_SCALAR_E_5_inline.inc
d04 2011-08-27_01:07:50 call end of solve_em
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d04 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d04 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:000]
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock start time = 20
11-08-27_01:00:05
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock current time =
2011-08-27_01:07:50
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock stop time = 201
1-08-28_00:00:00
DEBUG domain_clockadvance(): before WRFU_ClockAdvance, clock time step = 000
0000000_000:000:000
d04 2011-08-27_01:07:50+01/03 DEBUG wrf_timetoa(): returning with str = [2011
-08-27_01:07:50]
d04 2011-08-27_01:07:50+01/03 DEBUG wrf_timetoa(): returning with str = [2011
-08-27_01:00:05]
d04 2011-08-27_01:07:50+01/03 DEBUG wrf_timetoa(): returning with str = [2011
-08-28_00:00:00]
d04 2011-08-27_01:07:50+01/03 DEBUG wrf_timeinttoa(): returning with str = [0
000000000_000:000:000]
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock start time = 201
1-08-27_01:00:05
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock current time = 2
011-08-27_01:07:50
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock stop time = 2011
-08-28_00:00:00
DEBUG domain_clockadvance(): after WRFU_ClockAdvance, clock time step = 0000
000000_000:000:000
d04 2011-08-27_01:07:50+01/03 module_integrate: back from solve interface
d05 2011-08-27_01:07:50 module_integrate: calling med_nest_force
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_FORCE_DOWN_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/HALO_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_EM_COUPLE_B_inline.inc
d05 2011-08-27_01:07:50 module_integrate: back from med_nest_force
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:00:05]
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-28
_00:00:00]
d05 2011-08-27_01:07:50 DEBUG wrf_timeinttoa(): returning with str = [0000000
000_000:000:000]
DEBUG: top of integrate(), clock start time = 2011-08-27_01:00:05
DEBUG: top of integrate(), clock current time = 2011-08-27_01:07:50
DEBUG: top of integrate(), clock stop time = 2011-08-28_00:00:00
DEBUG: top of integrate(), clock time step = 0000000000_000:000:000
d05 2011-08-27_01:07:50 in med_latbound_in
d05 2011-08-27_01:07:50 module_integrate: calling solve interface
d05 2011-08-27_01:07:50 grid spacing, dt, time_step_sound= 100.0000 0.1
111111 4
d05 2011-08-27_01:07:50 call rk_step_prep
d05 2011-08-27_01:07:50 calling inc/HALO_EM_A_inline.inc
d05 2011-08-27_01:07:50 calling inc/PERIOD_BDY_EM_A_inline.inc
d05 2011-08-27_01:07:50 call rk_phys_bc_dry_1
d05 2011-08-27_01:07:50 call init_zero_tendency
d05 2011-08-27_01:07:50 calling inc/HALO_EM_PHYS_A_inline.inc
d05 2011-08-27_01:07:50 call phy_prep
d05 2011-08-27_01:07:50 DEBUG wrf_timetoa(): returning with str = [2011-08-27
_01:07:50]
d05 2011-08-27_01:07:50 call radiation_driver
d05 2011-08-27_01:07:50 Top of Radiation Driver
d05 2011-08-27_01:07:50 CALL rrtm
d05 2011-08-27_01:07:50 CAM-CLWRF interpolated values______ year: 2011
julian day: 238.0471
d05 2011-08-27_01:07:50 CAM-CLWRF co2vmr: 3.790000046137720E-004 n2ovmr:
3.190000086306100E-007 ch4vmr: 1.773999997567444E-006
bptyner
 
Posts: 8
Joined: Wed Nov 20, 2013 3:03 pm

Re: WRF Crashes over an hour into simulation

Postby bassline » Wed Nov 27, 2013 4:32 am

Well, you should see rsl.out.0000 file too...

But it looks like an error on radiation parameterisation. With a fast searching on the forum, I found this link that would be useful for you:

viewtopic.php?f=6&t=5726

[]'s
bassline
 
Posts: 55
Joined: Tue Jan 29, 2013 3:25 pm

Re: WRF Crashes over an hour into simulation

Postby bptyner » Wed Dec 04, 2013 4:28 pm

As a follow up, when I looked at some of my output, it appears that at the time the model crashes, all of the temperature values in my innermost domain are "nan," except those on the perimeter of the boundary of the domain. I feel that the bad temperature values are thus being fed into the radiation scheme, which is then causing the model to crash. Any other thoughts, given this latest symptom of the problem?
bptyner
 
Posts: 8
Joined: Wed Nov 20, 2013 3:03 pm

Re: WRF Crashes over an hour into simulation

Postby ginopw » Wed May 20, 2015 1:56 am

Dear bptyner,

I'm having a similar issue that you described in your last comment. I was wondering if you solve it and if you will kind to share the solution.

My run crashes with the radiation driver, using RRTM and Goddard Shortwave. I have tried other radiation schemes with similar results.

When using the new Goddard scheme the model runs for a few days but then crashed. When I checked the output, I'm having the same results filled with "Nans", except on the perimeter of the boundaries of the domains. A similar situation occurs when I turn off the radiation schemes.

Any help will be appreciated.
ginopw
 
Posts: 5
Joined: Mon May 17, 2010 12:45 pm

Re: WRF Crashes over an hour into simulation

Postby ricardofaria » Sun Jan 15, 2017 7:41 am

I everybody,

I'm having the same problem as you guys trying to run a real LES case and there's no CFL errors...
Any way to solve this problem?

Thanks, Ricardo Faria
ricardofaria
 
Posts: 6
Joined: Tue Nov 29, 2016 11:09 am

Re: WRF Crashes over an hour into simulation

Postby BHajni » Tue Jan 17, 2017 11:50 am

Hi,

I've had such problems before.
The problem is, that your timestep became 0s, thus the simulation stopped:
DEBUG: top of integrate(), clock start time = 2011-08-27_01:00:05
DEBUG: top of integrate(), clock current time = 2011-08-27_01:07:50
DEBUG: top of integrate(), clock stop time = 2011-08-28_00:00:00
DEBUG: top of integrate(), clock time step = 0000000000_000:000:000

Mostly it happens when the simulation becomes unstable - sometime only at 1 gridpoint, then it spreads - at the model boundary, at coastal regions or over mountains.

Usually this dt=0 happens with adaptive timesteps, even when giving the timestep a minimum value not helps the case. As strange as it is, for high really high resolution modelling sometimes it helps to give it a fixed timestep rather than the one calculated by the numerical solution.

Perhaps a little dampening can diffuse the unstable solution, or using the 6th order horizontal numerical diffusion (but do not smooth the field too much).

Cheers,
Hajni
BHajni
 
Posts: 31
Joined: Sun Mar 10, 2013 11:50 am

Re: WRF Crashes over an hour into simulation

Postby akpattant » Thu Jul 26, 2018 10:46 am

Hello,

I have also had this problem of timestep going to zero for VLES run down to 40 m grid spacing. I tried what you had suggested and added then increased diffusion to the run but this does not seem to make a difference. You also warned not to smooth too much? Do you mean do not increase diff_6th factor too much? What would be the threshold? I have it set to 0.2 but don't want to go much above that. I do not have horizontal or vertical diffusion turned on yet perhaps I should increase that as well?

&time_control
run_days = 0,
run_hours = 30,
run_minutes = 0,
run_seconds = 0,
start_year = 2017, 2017, 2017, 2017, 2017,
start_month = 05, 05, 05, 05, 05,
start_day = 14, 14, 14, 14, 14,
start_hour = 18, 18, 18, 18, 18,
start_minute = 00, 00, 00, 00, 00,
start_second = 00, 00, 00, 00, 00,
end_year = 2017, 2017, 2017, 2017, 2017,
end_month = 05, 05, 05, 05, 05,
end_day = 16, 16, 16, 16, 16,
end_hour = 00, 00, 00, 00, 00,
end_minute = 00, 00, 00, 00, 00,
end_second = 00, 00, 00, 00, 00,
interval_seconds = 10800,
input_from_file = .true.,.true.,.true.,.true.,.true.,
history_interval = 360, 60, 60, 15, 15,
frames_per_outfile = 100, 6, 6, 4, 4,
restart = .false.,
restart_interval = 360,
io_form_history = 2,
io_form_restart = 2,
io_form_input = 2,
io_form_boundary = 2,
debug_level = 0,
override_restart_timers = .true.,
iofields_filename = "myfile_d01.txt","myfile_d02.txt","myfile_d03.txt","myfile_d04.txt","myfile_d05.txt",
ignore_iofields_warning = .true.,
/

&domains
time_step = 120,
time_step_fract_num = 0,
time_step_fract_den = 1,
max_dom = 5,
e_we = 100, 101, 146, 221, 321,
e_sn = 100, 106, 151, 226, 326,
e_vert = 37, 37, 37, 64, 90,
vert_refine_method = 0, 0, 0, 2, 2,
p_top_requested = 5000,
num_metgrid_levels = 32,
num_metgrid_soil_levels = 4,
dx = 31250, 6250, 1250, 250, 50,
dy = 31250, 6250, 1250, 250, 50,
grid_id = 1, 2, 3, 4, 5,
parent_id = 0, 1, 2, 3, 4,
i_parent_start = 1, 40, 37, 51, 57,
j_parent_start = 1, 40, 39, 53, 74,
parent_grid_ratio = 1, 5, 5, 5, 5,
parent_time_step_ratio = 1, 5, 5, 5, 5,
feedback = 0,
smooth_option = 0,
eta_levels = 1.0, 0.9962, 0.989737, 0.98246, 0.974381, 0.965422, 0.955498, 0.944507, 0.932347, 0.918907, 0.904075, 0.887721, 0.869715, 0.849928, 0.828211, 0.804436, 0.778472, 0.750192, 0.719474, 0.686214, 0.650339, 0.611803, 0.570656, 0.526958, 0.480854, 0.432582, 0.382474, 0.33097, 0.278674, 0.22639, 0.175086, 0.132183, 0.096211, 0.065616, 0.039773, 0.018113, 0.0,
1.0, 0.9962, 0.989737, 0.98246, 0.974381, 0.965422, 0.955498, 0.944507, 0.932347, 0.918907, 0.904075, 0.887721, 0.869715, 0.849928, 0.828211, 0.804436, 0.778472, 0.750192, 0.719474, 0.686214, 0.650339, 0.611803, 0.570656, 0.526958, 0.480854, 0.432582, 0.382474, 0.33097, 0.278674, 0.22639, 0.175086,0.132183, 0.096211, 0.065616, 0.039773, 0.018113, 0.0,
1.0, 0.9962, 0.989737, 0.98246, 0.974381, 0.965422, 0.955498, 0.944507, 0.932347, 0.918907, 0.904075, 0.887721, 0.869715, 0.849928, 0.828211, 0.804436, 0.778472, 0.750192, 0.719474, 0.686214, 0.650339, 0.611803, 0.570656, 0.526958, 0.480854, 0.432582, 0.382474, 0.33097, 0.278674, 0.22639, 0.175086, 0.132183, 0.096211, 0.065616, 0.039773, 0.018113, 0.0,
1.0, 0.996, 0.9915, 0.986, 0.981, 0.976, 0.971, 0.966, 0.961, 0.9565, 0.95, 0.945, 0.94, 0.935, 0.93, 0.925, 0.92, 0.915, 0.91, 0.905, 0.9, 0.895, 0.8893, 0.883, 0.877, 0.872, 0.863, 0.856, 0.849, 0.841, 0.833, 0.8245, 0.816, 0.807, 0.7974, 0.7873, 0.7772, 0.7665, 0.7554, 0.744, 0.732, 0.715, 0.707, 0.6802, 0.6517, 0.6216, 0.6061, 0.5741, 0.5244, 0.5074, 0.4903, 0.4386, 0.3867, 0.3354, 0.2852, 0.2688, 0.2207, 0.1745, 0.1305, 0.0887, 0.0621, 0.0365, 0.0119, 0.0,
1.0, 0.997, 0.992, 0.9872, 0.983, 0.9788, 0.9745, 0.9702, 0.9659, 0.9615, 0.957, 0.9525, 0.9479, 0.9432, 0.9384, 0.9335, 0.9286, 0.9235, 0.9183, 0.913, 0.9075, 0.9018, 0.896, 0.89, 0.8838, 0.8774, 0.8708, 0.8639, 0.8567, 0.8493, 0.8415, 0.8335, 0.8251, 0.8164, 0.8073, 0.7978, 0.7879, 0.7777, 0.767, 0.7559, 0.7443, 0.7324, 0.72, 0.7071, 0.6939, 0.6802, 0.6661, 0.6517, 0.6368, 0.6216, 0.6061, 0.5902, 0.5741, 0.5578, 0.5412, 0.5244, 0.5074, 0.4903, 0.4732, 0.4559, 0.4386, 0.4213, 0.404, 0.3867, 0.3695, 0.3524, 0.3354, 0.3185, 0.3018, 0.2852, 0.2688, 0.2525, 0.2365, 0.2207, 0.2051, 0.1897, 0.1745, 0.1596, 0.1449, 0.1305, 0.1163, 0.1024, 0.0887, 0.0753, 0.0621, 0.0492, 0.0365, 0.0241, 0.0119, 0.0,
/
&physics
mp_physics = 8, 8, 8, 8, 8,
ra_lw_physics = 1, 1, 1, 1, 1,
ra_sw_physics = 1, 1, 1, 1, 1,
radt = 30, 6, 1, 1, 1,
sf_sfclay_physics = 1, 1, 1, 1, 1,
sf_surface_physics = 2, 2, 2, 2, 2,
bl_pbl_physics = 1, 1, 1, 0, 0,
cu_physics = 1, 0, 0, 0, 0,
cudt = 5, 0, 0, 0, 0,
cu_diag = 1, 0, 0, 0, 0,
cu_rad_feedback = .true., .true., .true., .true., .true.,
do_radar_ref = 0,
isfflx = 1,
ifsnow = 0,
icloud = 1,
surface_input_source = 3,
num_soil_layers = 4,
num_land_cat = 24,
slope_rad = 1, 1, 1, 1, 1,
topo_shading = 1, 1, 1, 1, 1,
shadlen = 10000,
windfarm_opt = 0,
windfarm_ij = 0,
topo_wind = 1, 1, 0, 0, 0,
/

&fdda
obs_max_num = 0,
obs_nudge_opt = 0, 0, 0,
max_obs = 0,
fdda_start = 0., 0., 0.,
fdda_end = 240., 240., 240.,
obs_nudge_wind = 1, 1, 1,
obs_nudge_temp = 1, 1, 1,
obs_nudge_mois = 1, 1, 1,
obs_coef_wind = 1.0, 1.0, 1.0,
obs_coef_temp = 1.0, 1.0, 1.0,
obs_coef_mois = 1.0, 1.0, 1.0,
obs_twindo = 1.0, 1.0, 1.0,
obs_rinxy = 120., 45., 30.,
obs_npfi = 20,
obs_ionf = 1, 1, 1,
obs_idynin = 1,
obs_dtramp = 30.,
obs_prt_max = 10,
obs_prt_freq = 20, 20, 20,
obs_ipf_in4dob = .true.,
obs_ipf_errob = .true.,
obs_ipf_nudob = .true.,
obs_ipf_init = .true.,
obs_no_pbl_nudge_uv = 0, 0, 0,
obs_no_pbl_nudge_t = 0, 0, 0,
obs_no_pbl_nudge_q = 0, 0, 0,
obs_nudgezfullr1_uv = 50,
obs_nudgezrampr1_uv = 50,
obs_nudgezfullr2_uv = 50,
obs_nudgezrampr2_uv = 50,
obs_nudgezfullr4_uv = -5000,
obs_nudgezrampr4_uv = 50,
obs_nudgezfullr1_t = 50,
obs_nudgezrampr1_t = 50,
obs_nudgezfullr2_t = 50,
obs_nudgezrampr2_t = 50,
obs_nudgezfullr4_t = -5000,
obs_nudgezrampr4_t = 50,
obs_nudgezfullr1_q = 50,
obs_nudgezrampr1_q = 50,
obs_nudgezfullr2_q = 50,
obs_nudgezrampr2_q = 50,
obs_nudgezfullr4_q = -5000,
obs_nudgezrampr4_q = 50,
obs_nudgezfullmin = 50,
obs_nudgezrampmin = 50,
obs_nudgezmax = 3000,
obs_sfcfact = 0.67,
obs_sfcfacr = 0.5,
obs_dpsmx = 7.5,
obs_sfc_scheme_horiz = 1,
obs_sfc_scheme_vert = 0,
obs_max_sndng_gap = 20,
obs_scl_neg_qv_innov = 1,
/

&noah_mp
dveg = 1,
opt_crs = 1,
opt_sfc = 1,
opt_btr = 1,
opt_run = 1,
opt_rad = 3,
opt_rsf = 1,
/
&dynamics
w_damping = 1,
diff_opt = 1, 1, 2, 2, 2,
km_opt = 4, 4, 4, 3, 3,
diff_6th_opt = 2, 2, 2, 2, 1,
diff_6th_factor = 0.1, 0.1, 0.1, 0.15, 0.2,
base_temp = 290.,
damp_opt = 3,
zdamp = 5000., 5000., 5000., 5000., 5000.,
dampcoef = 0.2, 0.2, 0.2, 0.2, 0.2,
khdif = 0, 0, 0, 0, 0,
kvdif = 0, 0, 0, 0, 0,
smdiv =0.1, 0.1, 0.1, 0.5, 0.3,
emdiv =0.01, 0.01, 0.01, 0.01, 0.01,
epssm =0.1, 0.1, 0.3, 0.8, 0.7,
time_step_sound =6, 6, 6, 6, 6,
c_s =0.25, 0.25, 0.25, 0.25, 0.25,
c_k =0.15, 0.15, 0.15, 0.15, 0.15,
non_hydrostatic = .true., .true., .true., .true., .true.,
moist_adv_opt = 1, 1, 1, 1, 1,
scalar_adv_opt = 1, 1, 1, 1, 1,
tke_adv_opt = 1, 1, 1, 1, 1,
/

&bdy_control
spec_bdy_width = 5,
spec_zone = 1,
relax_zone = 4,
specified = .true., .false.,.false.,.false.,.false.,
nested = .false., .true., .true., .true., .true.,
/

&grib2
/

&namelist_quilt
nio_tasks_per_group = 0,
nio_groups = 2,
/
akpattant
 
Posts: 6
Joined: Wed Jan 18, 2017 3:16 pm


Return to Runtime Problems

Who is online

Users browsing this forum: Google [Bot] and 7 guests