jsr335tests balanced crash vmState=0x000566ff

[pshipton]

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/1019 - cent9-aarch64-3
jsr335tests_7
Xjit -Xgcpolicy:balanced -Xnocompressedrefs

https://openj9-artifactory.osuosl.org/artifactory/ci-openj9/Test/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/1019/functional_test_output.tar.gz

02:43:35  #0: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x89d924) [0xffff8289d924]
02:43:35  #1: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x8a9d30) [0xffff828a9d30]
02:43:35  #2: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x12db54) [0xffff8212db54]
02:43:35  #3: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x27c44) [0xffff83598c44]
02:43:35  #4: function __kernel_rt_sigreturn+0 [0]
02:43:35  #5: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9vm29.so(+0x65288) [0xffff83265288]
02:43:35  #6: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x2f3a94) [0xffff822f3a94]
02:43:35  #7: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x736190) [0xffff82736190]
02:43:35  #8: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x737af0) [0xffff82737af0]
02:43:35  #9: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x54c2b8) [0xffff8254c2b8]
02:43:35  #10: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x54d7f4) [0xffff8254d7f4]
02:43:35  #11: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x14519c) [0xffff8214519c]
02:43:35  #12: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x145fec) [0xffff82145fec]
02:43:35  #13: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x2881c) [0xffff8359981c]
02:43:35  #14: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x143ccc) [0xffff82143ccc]
02:43:35  #15: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x14417c) [0xffff8214417c]
02:43:35  #16: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x142f08) [0xffff82142f08]
02:43:35  #17: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x1433b4) [0xffff821433b4]
02:43:35  #18: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x14345c) [0xffff8214345c]
02:43:35  #19: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9prt29.so(+0x2881c) [0xffff8359981c]
02:43:35  #20: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9jit29.so(+0x143828) [0xffff82143828]
02:43:35  #21: /home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9thr29.so(+0x74dc) [0xffff8383f4dc]
02:43:35  #22: /lib64/libc.so.6(+0x80e00) [0xffff83aa7e00]
02:43:35  #23: /lib64/libc.so.6(+0xeb49c) [0xffff83b1249c]
02:43:35  Unhandled exception
02:43:35  Type=Segmentation error vmState=0x000566ff
02:43:35  J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
02:43:35  Handler1=0000FFFF83234594 Handler2=0000FFFF83598AD0 InaccessibleAddress=0000000000000036 Sending_Process=00000036
02:43:35  x0=0000000000000000 x1=0000000000000000 x2=0000FFFF7C2AA6D8 x3=0000000000000000
02:43:35  x4=0000000000000001 x5=0000FFFF83265210 x6=0000000000000018 x7=0000000000000010
02:43:35  x8=0000000000000000 x9=000000000000001F x10=00000000000566FF x11=0000000000000001
02:43:35  x12=0000000000001260 x13=0000000000000003 x14=0000000000000001 x15=0000000000000000
02:43:35  x16=0000000000000001 x17=0000FFFF83AA9560 x18=0000000000000000 x19=0000000000000028
02:43:35  x20=0000FFFF7C18A3F8 x21=0000000000000001 x22=0000FFFF7C02A8A0 x23=0000000000002309
02:43:35  x24=0000000000000009 x25=0000FFFF7C132FF8 x26=0000FFFF82BCC000 x27=0000FFFF821DEC40
02:43:35  x28=0000FFF925BD7EF8 x29(FP)=0000FFF925BD7DF0 x30(LR)=0000FFFF83265268 x31(SP)=0000FFF925BD7DE0
02:43:35  PC=0000FFFF83265288 SP=0000FFF925BD7DE0 PSTATE=0000000000001000
02:43:35  v0=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v1=ffffffffffffffff (f: 4294967296.000000, d: -nan)
02:43:35  v2=042f7fb023b6dfff (f: 599187456.000000, d: 1.616099e-288)
02:43:35  v3=e01efbf9f9cefeb8 (f: 4191092480.000000, d: -1.038578e+155)
02:43:35  v4=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v5=f8afc00000098102 (f: 622850.000000, d: -2.146989e+273)
02:43:35  v6=f8afc00000098102 (f: 622850.000000, d: -2.146989e+273)
02:43:35  v7=ca3d0000016a8847 (f: 23758920.000000, d: -4.238355e+49)
02:43:35  v8=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v9=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v10=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v11=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v12=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v13=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v14=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v15=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v16=0f0f0f0f0f0f0f0f (f: 252645136.000000, d: 3.815737e-236)
02:43:35  v17=5555555555555555 (f: 1431655808.000000, d: 1.194531e+103)
02:43:35  v18=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v19=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v20=3fb1eb851eb851ec (f: 515396064.000000, d: 7.000000e-02)
02:43:35  v21=0000000000000002 (f: 2.000000, d: 9.881313e-324)
02:43:35  v22=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v23=0000000000000008 (f: 8.000000, d: 3.952525e-323)
02:43:35  v24=3fd6666666666666 (f: 1717986944.000000, d: 3.500000e-01)
02:43:35  v25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v26=000000000000000a (f: 10.000000, d: 4.940656e-323)
02:43:35  v27=0000000000000001 (f: 1.000000, d: 4.940656e-324)
02:43:35  v28=000000000000000a (f: 10.000000, d: 4.940656e-323)
02:43:35  v29=0000000000000001 (f: 1.000000, d: 4.940656e-324)
02:43:35  v30=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  v31=0000000000000000 (f: 0.000000, d: 0.000000e+00)
02:43:35  Module=/home/jenkins/workspace/Test_openjdk11_j9_sanity.functional_aarch64_linux_Nightly_testList_0/jdkbinary/j2sdk-image/lib/default/libj9vm29.so
02:43:35  Module_base_address=0000FFFF83200000
02:43:35  
02:43:35  Method_being_compiled=com/sun/org/apache/xerces/internal/impl/XMLDTDScannerImpl.skipSeparator(ZZ)Z
02:43:35  Target=2_90_20251031_1090 (Linux 5.14.0-570.el9.aarch64)
02:43:35  CPU=aarch64 (8 logical CPUs) (0x3d135d000 RAM)
02:43:35  ----------- Stack Backtrace -----------
02:43:35  reportHotField+0x78 (0x0000FFFF83265288 [libj9vm29.so+0x65288])
02:43:35  _ZN18TR_HotFieldMarking7performEv+0x484 (0x0000FFFF822F3A94 [libj9jit29.so+0x2f3a94])
02:43:35  _ZN3OMR9Optimizer19performOptimizationEPK20OptimizationStrategyiii.localalias+0x74c (0x0000FFFF82736190 [libj9jit29.so+0x736190])
02:43:35  _ZN3OMR9Optimizer8optimizeEv+0x180 (0x0000FFFF82737AF0 [libj9jit29.so+0x737af0])
02:43:35  _ZN3OMR11Compilation20performOptimizationsEv+0x28 (0x0000FFFF8254C2B8 [libj9jit29.so+0x54c2b8])
02:43:35  _ZN3OMR11Compilation7compileEv+0x570 (0x0000FFFF8254D7F4 [libj9jit29.so+0x54d7f4])
02:43:35  _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadPNS_11CompilationEP17TR_ResolvedMethodR11TR_J9VMBaseP19TR_OptimizationPlanRKNS_16SegmentAllocatorE+0x40c (0x0000FFFF8214519C [libj9jit29.so+0x14519c])
02:43:35  _ZN2TR28CompilationInfoPerThreadBase14wrappedCompileEP13J9PortLibraryPv+0x2ec (0x0000FFFF82145FEC [libj9jit29.so+0x145fec])
02:43:35  omrsig_protect+0x21c (0x0000FFFF8359981C [libj9prt29.so+0x2881c])
02:43:35  _ZN2TR28CompilationInfoPerThreadBase7compileEP10J9VMThreadP21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x2d8 (0x0000FFFF82143CCC [libj9jit29.so+0x143ccc])
02:43:35  _ZN2TR24CompilationInfoPerThread12processEntryER21TR_MethodToBeCompiledRN2J917J9SegmentProviderE+0x118 (0x0000FFFF8214417C [libj9jit29.so+0x14417c])
02:43:35  _ZN2TR24CompilationInfoPerThread14processEntriesEv+0x2f8 (0x0000FFFF82142F08 [libj9jit29.so+0x142f08])
02:43:35  _ZN2TR24CompilationInfoPerThread3runEv+0x50 (0x0000FFFF821433B4 [libj9jit29.so+0x1433b4])
02:43:35  _Z30protectedCompilationThreadProcP13J9PortLibraryPN2TR24CompilationInfoPerThreadE+0x7c (0x0000FFFF8214345C [libj9jit29.so+0x14345c])
02:43:35  omrsig_protect+0x21c (0x0000FFFF8359981C [libj9prt29.so+0x2881c])
02:43:35  _Z21compilationThreadProcPv+0x148 (0x0000FFFF82143828 [libj9jit29.so+0x143828])
02:43:35  thread_wrapper+0xcc (0x0000FFFF8383F4DC [libj9thr29.so+0x74dc])
02:43:35  start_thread+0x300 (0x0000FFFF83AA7E00 [libc.so.6+0x80e00])
02:43:35  thread_start+0xc (0x0000FFFF83B1249C [libc.so.6+0xeb49c])

Changes from previous build
d65c022...42fa4e3
eclipse-openj9/openj9-omr@063a875...55e1efd

[pshipton]

@hzongaro fyi

[hzongaro]

IL dump in jitdump file ends with this:

n17n      BBStart <block_2> (freq 9487)                                                       [    0xfff8b5005260] bci=[-1,0,-] rc=0 vc=1211 vn=- li=-1 udi=- nc=1
n719n       GlRegDeps                                                                         [    0xfff8b508d070] bci=[-1,0,-] rc=1 vc=1211 vn=- li=- udi=- nc=1
n720n         aRegLoad x0   this<'this' parm Lcom/sun/org/apache/xerces/internal/impl/XMLDTDScannerImpl;>[#349  Parm] [flags 0x40000107 0x0 ] (X!=0 X>=0 SeenRealReference )  [    0xfff8b508d0c0] bci=[-1,0,-] rc=10 vc=1211 vn=- li=1 udi=- nc=0 flg=0x8104
n21n      iRegStore x8                                                                        [    0xfff8b50053a0] bci=[-1,4,-] rc=0 vc=1211 vn=- li=- udi=- nc=1
n20n        iloadi  com/sun/org/apache/xerces/internal/impl/XMLDTDScannerImpl.fPEDepth I[#352  Shadow +344] [flags 0x80603 0x0 ] (cannotOverflow )  [    0xfff8b5005350] bci=[-1,1,-] rc=7 vc=1211 vn=- li=- udi=- nc=1 flg=0x1000
n720n         ==>aRegLoad

[hzongaro]

No luck reproducing this in a 5x100 grinder run of jsr335tests_7.