Skip to content

Test failures: Microsoft.Extensions.Caching.Memory flakiness #33993

Closed
#72821
Closed
Test failures: Microsoft.Extensions.Caching.Memory flakiness#33993
#72821
Labels
area-Extensions-Cachingblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
Milestone
Future

Description

@maryamariyan
maryamariyan
opened on Mar 24, 2020
Microsoft.Extensions.Caching.Memory.MemoryCacheSetAndRemoveTests.GetAndSet_AreThreadSafe_AndUpdatesNeverLeavesNullValues [FAIL]
      Assert.False() Failure
      Expected: False
      Actual:   True
      Stack Trace:
        /_/src/libraries/Microsoft.Extensions.Caching.Memory/tests/MemoryCacheSetAndRemoveTests.cs(488,0): at Microsoft.Extensions.Caching.Memory.MemoryCacheSetAndRemoveTests.GetAndSet_AreThreadSafe_AndUpdatesNeverLeavesNullValues()
        /_/src/mono/netcore/System.Private.CoreLib/src/System/Reflection/RuntimeMethodInfo.cs(339,0): at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

https://helix.dot.net/api/2019-06-17/jobs/e7ed99d0-5a25-4792-8b58-04c5a0009c69/workitems/Microsoft.Extensions.Caching.Memory.Tests/console

UPDATE:
Failures not just on Mono. The flakiness reported in #34128 and disabled in PR #34142

Activity

  1. maryamariyan
    added
    area-Microsoft.Extensions
    on Mar 24, 2020
  2. Dotnet-GitSync-Bot
    added
    untriagedNew issue has not been triaged by the area owner
    on Mar 24, 2020
  3. maryamariyan
    changed the title [-]mono test failure: Microsoft.Extensions.Caching.Memory.MemoryCacheSetAndRemoveTests.GetAndSet_AreThreadSafe_AndUpdatesNeverLeavesNullValues[/-] [+]Test failures: Microsoft.Extensions.Caching.Memory flakiness[/+] on Mar 26, 2020

  4. ericstj commented on Mar 26, 2020

    @ericstj
    ericstj
    on Mar 26, 2020
    Member

    Duping this to #34128 since it has more data.

  5. ericstj
    closed this as completedon Mar 26, 2020
  6. ericstj
    reopened this on Mar 26, 2020

  7. ericstj commented on Mar 26, 2020

    @ericstj
    ericstj
    on Mar 26, 2020
    Member

    Reopen since tests are disabled against this

  8. ericstj commented on Mar 27, 2020

    @ericstj
    ericstj
    on Mar 27, 2020
    Member

    There may be more tests failing than just these. I sampled some of the logs listed in #34128 and see a couple other tests failing:

    https://helix.dot.net/api/2019-06-17/jobs/69862130-a475-4556-96d7-896801bfcfec/workitems/Microsoft.Extensions.Caching.Memory.Tests/files/console.ed98370f.log

    Microsoft.Extensions.Caching.Memory.CapacityTests.CompactsToLessThanLowWatermarkUsingLRUWhenHighWatermarkExceeded [FAIL]
      Assert.True() Failure
      Expected: True
      Actual:   False
      Stack Trace:
        /_/src/libraries/Microsoft.Extensions.Caching.Memory/tests/CapacityTests.cs(378,0): at Microsoft.Extensions.Caching.Memory.CapacityTests.CompactsToLessThanLowWatermarkUsingLRUWhenHighWatermarkExceeded()

    https://helix.dot.net/api/2019-06-17/jobs/7df59f03-64bf-479e-a50e-680591bfadde/workitems/Microsoft.Extensions.Caching.Memory.Tests/files/console.b7698877.log

        Microsoft.Extensions.Caching.Memory.CapacityTests.ExpiringEntryDecreasesCacheSize [FAIL]
      Assert.True() Failure
      Expected: True
      Actual:   False
      Stack Trace:
        /_/src/libraries/Microsoft.Extensions.Caching.Memory/tests/CapacityTests.cs(338,0): at Microsoft.Extensions.Caching.Memory.CapacityTests.ExpiringEntryDecreasesCacheSize()

    I wonder if there is something broken with how we're testing these in dotnet/runtime? Maybe concurrency differences and shared state?

  9. maryamariyan
    added
    area-Extensions-Caching
    and removed
    area-Microsoft.Extensions
    on Apr 2, 2020
  10. maryamariyan
    added this to the Future milestone on Jun 12, 2020
  11. maryamariyan
    removed
    untriagedNew issue has not been triaged by the area owner
    on Jun 12, 2020
  12. BruceForstall
    added a commit that references this issue on Jul 26, 2020

    Disable Microsoft.Extensions.Caching.Memory.CapacityTests.DoNotAddIfS…

    b6a3957
  13. jkotas
    added a commit that references this issue on Jul 26, 2020

    Disable Microsoft.Extensions.Caching.Memory.CapacityTests.DoNotAddIfS…

    0b16471

  14. v-haren commented on Jul 27, 2020

    @v-haren
    v-haren
    on Jul 27, 2020

    failed again in job: runtime-coreclr libraries-jitstress 20200726.1

    failed test: Microsoft.Extensions.Caching.Memory.CapacityTests.DoNotAddIfSizeOverflows

    Error message

    Assert.True() Failure
Expected: True
Actual:   False


Stack trace
   at Microsoft.Extensions.Caching.Memory.CapacityTests.DoNotAddIfSizeOverflows() in /_/src/libraries/Microsoft.Extensions.Caching.Memory/tests/CapacityTests.cs:line 137
--- End of stack trace from previous location ---

  15. 3 remaining items

  16. danmoseley
    closed this as completedon Jun 22, 2021

  17. jkotas commented on Jun 22, 2021

    @jkotas
    jkotas
    on Jun 22, 2021
    Member

    We still have 7 tests disabled against this issue.

  18. jkotas
    reopened this on Jun 22, 2021

  19. danmoseley commented on Jun 22, 2021

    @danmoseley
    danmoseley
    on Jun 22, 2021
    Contributor

    More commentary in #50270

  20. maryamariyan
    removed their assignment
    on Feb 27, 2022
  21. ghost added
    in-prThere is an active PR which will close this issue when it is merged
    on Jul 26, 2022
  22. danmoseley
    closed this as completedin #72821on Jul 26, 2022
  23. ghost removed
    in-prThere is an active PR which will close this issue when it is merged
    on Jul 26, 2022

  24. jakobbotsch commented on Jul 26, 2022

    @jakobbotsch
    jakobbotsch
    on Jul 26, 2022
    Member

    Failed again in https://dev.azure.com/dnceng/public/_build/results?buildId=1903569&view=ms.vss-test-web.build-test-results-tab&runId=49497968&resultId=111528&paneView=dotnet-dnceng.dnceng-anon-build-release-tasks.helix-anon-test-information-tab after the reenabling

  25. jakobbotsch
    reopened this on Jul 26, 2022
  26. jakobbotsch
    added
    blocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'
    on Jul 26, 2022

  27. danmoseley commented on Jul 26, 2022

    @danmoseley
    danmoseley
    on Jul 26, 2022
    Contributor

    I'll disable that asap and create a new issue, for clarity, as this has covered other symptoms...

  28. danmoseley commented on Jul 26, 2022

    @danmoseley
    danmoseley
    on Jul 26, 2022
    Contributor

    #72879

  29. danmoseley
    closed this as completedon Jul 26, 2022
  30. ghost locked as resolved and limited conversation to collaborators on Aug 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area-Extensions-Cachingblocking-clean-ciBlocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms'

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions