Skip to content

OpenCL: large graph support through RAM->VRAM streaming #211

Description

@EgorOrachyov

Requirements:

  • Async streaming of chunks of graph from RAM into VRAM
  • Dynamic chunk size adaptation
  • Partial operations evaluation support

Activity

  1. gsvgit commented on Mar 16, 2023

    @gsvgit
    Member

    What do you think about SVM ? Can it be helpful in this task?

  2. EgorOrachyov commented on Mar 16, 2023

    @EgorOrachyov
    ContributorAuthor

    @gsvgit By def, shared virtual memory is a virtual address space for multiple processors, devices which can access the same address in seamles fashion.

    The question is, how it is implemented for a gpu.

    When and how gpu loads pages?
    What happens if there not enough GPU space?
    What is the maximum allocation size for a svm allocation?

    Streaming solves the problem of large vram usage and overcomes limit of single allocation, which also is a limit of maximum range, which can be addressed inside a kernel.

    Svm seems like a gimmick. But how it is implemented across vendors and which overhead has?

    All in all, seems svm wont solve problem of large data.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

enhancementNew feature or requesthelp wantedExtra attention is neededtopic:apiLibrary API relatedtopic:gpuOpenCL (Compute) relatedtopic:perfPerformance optimziations

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions