ensemble # E250_1 # replica # E250r001 # ! name # value # A0:type # ACG # A10:im0 # 1 # A10:ipf # 9 # A10:irat # 0 9 9 # A10:isp # 1 # A10:type # ACF_RAT # A11:im0 # 1 # A11:ipf # 10 # A11:irat # 0 10 10 # A11:isp # 1 # A11:type # ACF_RAT # A12:im0 # 1 # A12:ipf # 11 # A12:irat # 0 11 11 # A12:isp # 1 # A12:type # ACF_RAT # A13:im0 # 1 # A13:ipf # 12 # A13:irat # 0 12 12 # A13:isp # 1 # A13:type # ACF_RAT # A14:im0 # 1 # A14:ipf # 13 # A14:irat # 0 13 13 # A14:isp # 1 # A14:type # ACF_RAT # A1:im0 # 0 # A1:imu # 5 # A1:ipf # 0 # A1:isp # 0 # A1:type # ACF_TM1_EO_SDET # A2:im0 # 0 # A2:imu # 4 5 # A2:ipf # 1 # A2:isp # 1 0 # A2:type # ACF_TM2_EO # A3:im0 # 0 # A3:imu # 3 4 # A3:ipf # 2 # A3:isp # 1 1 # A3:type # ACF_TM2_EO # A4:im0 # 0 # A4:imu # 2 3 # A4:ipf # 3 # A4:isp # 1 1 # A4:type # ACF_TM2_EO # A5:im0 # 0 # A5:imu # 0 2 # A5:ipf # 4 # A5:isp # 1 1 # A5:type # ACF_TM2_EO # A6:im0 # 0 # A6:imu # 0 1 # A6:ipf # 5 # A6:isp # 1 1 # A6:type # ACF_TM2_EO # A7:im0 # 1 # A7:ipf # 6 # A7:irat # 0 0 6 # A7:isp # 4 # A7:type # ACF_RAT_SDET # A8:im0 # 1 # A8:ipf # 7 # A8:irat # 0 7 7 # A8:isp # 1 # A8:type # ACF_RAT # A9:im0 # 1 # A9:ipf # 8 # A9:irat # 0 8 8 # A9:isp # 1 # A9:type # ACF_RAT # DG:kappa # 0.137200 # DG:mu # 0.001 # DG:ncy # 4 # DG:ninv # 12 # DG:nmr # 4 # DP:nkv # 48 # DP:nmx # 3072 # DP:res # 1.0e-02 # DS:Ns # 34 # DS:bs # 4 8 8 8 # DU:dtau # 0.01 # DU:nsm # 1 # F0:type # FRG # F10:isp # 3 # F10:type # FRF_RAT # F11:isp # 3 # F11:type # FRF_RAT # F12:isp # 3 # F12:type # FRF_RAT # F13:isp # 3 # F13:type # FRF_RAT # F14:isp # 3 # F14:type # FRF_RAT # F1:isp # 2 # F1:ncr # 4 # F1:type # FRF_TM1_EO_SDET # F2:isp # 3 # F2:ncr # 3 # F2:type # FRF_TM2_EO # F3:isp # 3 # F3:ncr # 3 # F3:type # FRF_TM2_EO # F4:isp # 3 # F4:ncr # 3 # F4:type # FRF_TM2_EO # F5:isp # 3 # F5:ncr # 3 # F5:type # FRF_TM2_EO # F6:isp # 3 # F6:ncr # 1 # F6:type # FRF_TM2_EO # F7:isp # 5 # F7:type # FRF_RAT_SDET # F8:isp # 3 # F8:type # FRF_RAT # F9:isp # 3 # F9:type # FRF_RAT # Host # hazelhen.hww.de, miil02.zdv.uni-mainz.de # L0:Forces # 0 # L0:Nsteps # 1 # L0:type # 4th order OMF # L1:Forces # 1 2 3 4 5 7 8 # L1:Nsteps # 1 # L1:type # 4th order OMF # L2:Forces # 6 9 10 11 12 13 14 # L2:Nsteps # 15 # L2:type # 2nd order OMF with lambda = 0.1666667 # Path # /lustre/miifs04/lattice/damohler/E250_HIMSTER # R0:degree # 14 # R0:range # [0.01,7.5] # Rcheck # /lustre/cray/ws9/3/ws/ihimdmoh-E250/cnfg/ # Rsync # off # S0:nmx # 2048 # S0:res # 1.0e-12 # S0:type # CGNE # S1:isolv # 1 # S1:ncy # 5 # S1:nkv # 36 # S1:nmr # 4 # S1:nmx # 2048 # S1:res # 1.0e-12 # S1:type # DFL_SAP_GCR # S2:nmx # 2048 # S2:res # 1.0e-11 # S2:type # CGNE # S3:isolv # 1 # S3:ncy # 5 # S3:nkv # 36 # S3:nmr # 4 # S3:nmx # 3072 # S3:res # 1.0e-11 # S3:type # DFL_SAP_GCR # S4:nmx # 2048 # S4:res # 1.0e-12 # S4:type # MSCG # S5:nmx # 2048 # S5:res # 1.0e-11 # S5:type # MSCG # Status # production # Who # Daniel Mohler # accept # 0.874 # beta # 3.55 # csw # 1.8248654 # dtr_cnfg # 2 # dtr_log # 1 # dtr_ms # 2 # firstCN # 1 # firstCT # 2 # flagBig # 0 # globL # 96 # globT # 192 # kappa_c # 0 # kappa_s # 0.136536633 # kappa_u # 0.137232867 # lastCN # 960 # lastCT # 1920 # lastChangeC # 326 # lastChangeT # 652 # lastT # 1920 # locLat # 12 8 16 16 # logDate # 2021-01-20_19:11:00 # logFile # ../spool/E250r001/E250r001.log # mu # 0.0001 0.00014142135623731 0.0003 0.003 0.03 0.5 # nlv # 3 # nth # 0 # ntr # 2 # procBlock # 2 2 2 2 # procGrid # 16 12 6 6 # restartT # 0 # startC # X200t051n152 # tau # 2.0 # timeTraj # 19362.4 sec # totalC # 960 # totalR # 0 # totalT # 1920 # version # openQCD-1.6 # ! CHANGED: After traj 14 / conf 7: locLat = 12 8 16 16 --> 12 8 8 16 ! CHANGED: After traj 14 / conf 7: procGrid = 16 12 6 6 --> 16 12 12 6 ! CHANGED: After traj 652 / conf 326: locLat = 12 8 8 16 --> 12 8 16 16 ! CHANGED: After traj 652 / conf 326: procGrid = 16 12 12 6 --> 16 12 6 6 ! CHANGED: After traj 652 / conf 326: procBlock = 2 3 2 2 --> 2 2 2 2 ! HISTORY: production chain: ! HISTORY: r001 ! HISTORY: E250r001: host: hazelhen ! HISTORY: path to configs: /lustre/cray/ws8/ws/ihimdmoh-E250/cnfg/ ! HISTORY: Started from X200t051 configuration X200t051n152 ! HISTORY: For parameters see E250r001.in ! HISTORY: Parameter Changes with respect to X200t051: Changed lvl 2 integrator nstep from 14 to 15; Changed deflation subspace generation kappa from 0.137180 to 0.137200 ! HISTORY: seed at start: 1487 ! HISTORY: Initial process grid: ! HISTORY: 192x96x96x96 lattice, 12x8x16x16 local lattice ! HISTORY: 16x12x6x6 process grid, 2x3x2x2 process block size ! HISTORY: ****************************************************************** ! HISTORY: after configuration 7 Process grid changed: ! HISTORY: 192x96x96x96 lattice, 12x8x8x16 local lattice ! HISTORY: 16x12x12x6 process grid, 2x3x2x2 process block size ! HISTORY: new seed: 1492 ! HISTORY: ****************************************************************** ! HISTORY: Error writing log after configuration 111 and before 112 was written. ! HISTORY: For some reason the run proceeded and the old log got overwritten by a broken one ! HISTORY: truncated all the files to the way they should have looked after n111; restarted with a new seed: 1543 ! HISTORY: ****************************************************************** ! HISTORY: Recompiled openQCD due to system upgrade on HazelHen ! HISTORY: Started with new executible from n112 ! HISTORY: ****************************************************************** ! HISTORY: Due to feedback from HLRS we performed scaling tests with wto different grid partitions starting from Configuration 247 ! HISTORY: These tests did not yield satisfactory performance and I restartd the run with the old settings from Configuration 247 ! HISTORY: ****************************************************************** ! HISTORY: Due to sustained unsatisfactory performance on hazelhen we moved the job to the HIMSTER-II cluster in Mainz ! HISTORY: Started from configuration 326 with new 16x12x6x6 process grid (half the previous cores) and seed 1690 ! HISTORY: ****************************************************************** ! HISTORY: Solver error during trajectory 682: ! HISTORY: Error in force4 [force4.c] (error no=1): ! HISTORY: DFL_SAP_GCR solver failed (mu = 3.0000e-03, parameter set no 3, status = 38,92,0;61,-1,24) ! HISTORY: Program aborted ! HISTORY: Restarted with new seed 1692 from configuration 340 ! HISTORY: ****************************************************************** ! HISTORY: Job interrupted at configuration n672. Likely to be continued on Hawk in Stuttgart. ! HISTORY: ****************************************************************** ! HISTORY: 26.6.2020 Trying to run the code using 288 HIMSTER nodes ! HISTORY: Made a backup of the log and dat directories and will do a continuation run with a new seed ! HISTORY: seed: 1766 ! HISTORY: ****************************************************************** ! HISTORY: This change was not possible due to the chosen parameters ! HISTORY: The run was continued on HIMSTER-II in Mainz using 216 nodes cprresponding to the 16x12x6x6 process grid