Skip to content

doc: add design for NVMe-oF access to RBD-images - #5397

Merged
mergify[bot] merged 1 commit into
ceph:develfrom
nixpanic:design/nvme-of
Jul 1, 2025
Merged

mergify[bot] merged 1 commit into
ceph:develfrom
nixpanic:design/nvme-of

Conversation

@nixpanic

Copy link
Copy Markdown
Member

The ceph-nvmeof project provides a NVMe-oF Gateway that makes RBD-images available over the NVMe-oF TCP protocol. Ceph-CSI can use this to provision block-type volumes that are accessible over a standard protocol instead of depending on RADOS/RBD.

/cc @gadididi

Updates: #5370

@mergify mergify Bot added ci/skip/e2e skip running e2e CI jobs ci/skip/multi-arch-build skip building on multiple architectures component/docs Issues and PRs related to documentation labels Jun 25, 2025
@nixpanic
nixpanic requested a review from a team June 25, 2025 11:53
Comment thread docs/design/proposals/nvme-of.md

@Madhu-1 Madhu-1 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great to see a new one is getting added to cephcsi. 🎉

Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md
Comment thread docs/design/proposals/nvme-of.md
The Node-plugin should implement the following CSI procedures:

- `NodeStageVolume` / `NodeUnstageVolume`
1. attach the NVMe-oF namespace from the NVMe-oF Gateway

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we have any limit on the nodes here?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What limits are you thinking about? I am not aware of anything specific at the moment.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i dont know, like we have limit for number of snapshots on an image for mapping the node. If we dont have any limits in gateway itself we are good

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Madhu-1 HI, there is a limitation (in GW) of the number of namespaces (=rbd image) can subsystem handle.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @gadididi

Comment thread docs/design/proposals/nvme-of.md
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
Comment thread docs/design/proposals/nvme-of.md Outdated
The `ceph-nvmeof` project provides a NVMe-oF Gateway that makes
RBD-images available over the NVMe-oF TCP protocol. Ceph-CSI can use
this to provision block-type volumes that are accessible over a standard
protocol instead of depending on RADOS/RBD.

Signed-off-by: Niels de Vos <[email protected]>
@nixpanic
nixpanic requested a review from gadididi July 1, 2025 08:55

@Rakshith-R Rakshith-R left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

mergify Bot added a commit that referenced this pull request Jul 1, 2025
@mergify
mergify Bot merged commit cfb3979 into ceph:devel Jul 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci/skip/e2e skip running e2e CI jobs ci/skip/multi-arch-build skip building on multiple architectures component/docs Issues and PRs related to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants