Repository navigation
Tests failed on WASM with NRE in CustomAttributeTypedArgument.CanonicalizeValue #39473
Description
Activity
- addeduntriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner
on Jul 16, 2020 - addedarch-wasmWebAssembly architectureWebAssembly architectureand removed
on Jul 16, 2020 Same for unrelated Asn1 test:
System.NullReferenceException : Object reference not set to an instance of an object. Stack trace at System.Reflection.CustomAttributeTypedArgument.CanonicalizeValue(Object value) at System.Reflection.CustomAttributeTypedArgument..ctor(Type argumentType, Object value) at System.Reflection.CustomAttributeData.ResolveArguments() at System.Reflection.CustomAttributeData.get_ConstructorArguments() at ReflectionAbstractionExtensions.GetCustomAttributes(IMethodInfo methodInfo, Type attributeType)- changed the title
[-]System.SpanTests.ReadOnlySpanTests.Overlap failed on WASM[/-][+]Tests failed on WASM with NRE in CustomAttributeTypedArgument.CanonicalizeValue[/+]on Jul 16, 2020 - removeduntriagedNew issue has not been triaged by the area ownerNew issue has not been triaged by the area owner
on Jul 16, 2020 @akoeplinger and I were looking at this. This is a flaky issue that started happening yesterday morning. @akoeplinger is suspecting of: ef2ecfd#diff-a70a13cf973dcdf79e3a506980ae1a2d
I looked at the first build that hit this which ran against the following commits:
HEAD is now at 23d574901 Merge 5e493d6 into 37cf387The commit in question above is not in that tree, however there is: c80cc2a#diff-a70a13cf973dcdf79e3a506980ae1a2d
But I don't have enough expertise to know that? Maybe the runtime is returning null when doing
GetType().This is flaky enough that I was not able to get a repro, but since this is hit when Xunit tries to get attributes for the test to execute, it could hit any test case.
- addedblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
on Jul 16, 2020 @vargaz I sent a private job that ran
System.Memory.Tests30 times and added:g_warning ("NULL interp_runtime_invoke");
To this if block:
runtime/src/mono/mono/mini/interp/interp.c
Lines 1915 to 1921 in c80cc2a
if (context->has_resume_state) { /* * This can happen on wasm where native frames cannot be skipped during EH. * EH processing will continue when control returns to the interpreter. */ return NULL; } And it did print the warning when failed:
L: NULL interp_runtime_invoke [FAIL] System.Memory.Tests.ReadOnlySequenceTestsByte+SegmentPerByte.PositionOf_ReturnsPosition System.NullReferenceException : Object reference not set to an instance of an object. at System.Reflection.CustomAttributeTypedArgument.CanonicalizeValue(Object value) at System.Reflection.CustomAttributeTypedArgument..ctor(Type argumentType, Object value) at System.Reflection.CustomAttributeData.ResolveArguments() at System.Reflection.CustomAttributeData.get_ConstructorArguments() at ReflectionAbstractionExtensions.GetCustomAttributes(IMethodInfo methodInfo, Type attributeType)So it seems like: c80cc2a is what introduced this regression, right?
I can't reproduce the failures locally, but it does look like this is the cause, we should revert.
It reproed 2 times out of 30 runs for System.Memory.Tests and that took like 3 hours to run 😫
4 remaining items
- added a commit that references this issue
on Jul 22, 2020 Another hit in: #39854
- added a commit that references this issue
on Jul 24, 2020 We think this is fixed with #39856 which is merged now (I ran four helix jobs with a loop of System.Memory.Tests for three hours with no crashes).
I'll keep a close eye on the CI results over the next few days.
Reacted by Santiago Fernandez MaderoReacted by Dan MoseleyReacted by Dan Moseley- added a commit that references this issue
on Jul 24, 2020 Let's keen an eye and look at the data tomorrow or Monday that will give us an idea as there can be many runs today that checked out sources without this change.
Reacted by Alexander KöplingerI checked the data and couldn't find any run that hit this after the fix was merged :)
Reacted by Santiago Fernandez MaderoNice job everybody! That was a tough one.
Reacted by Santiago Fernandez Madero- added a commit that references this issue
on Jul 27, 2020 This looks like a different stack trace. Maybe another bug. @v-haren would you mind opening a new issue?
Actually that is: #40307
- added a commit that references this issue
on Aug 10, 2020 - ghost locked as resolved and limited conversation to collaborators
on Dec 8, 2020
net5.0-Browser-Release-wasm-Mono_Release-Ubuntu.1804.Amd64.Open
https://dev.azure.com/dnceng/public/_build/results?buildId=733324&view=ms.vss-test-web.build-test-results-tab&runId=22691562&resultId=139620&paneView=debug
#39420