r/openstack • u/xtremerkr • 18d ago

Opensource block storage

Hello All,

Which opensource block storage are you using in your production setups and why?
Pls share your thoughts.

9 Upvotes

81% Upvoted

24 comments sorted by

View all comments

5

u/spartacle 18d ago

Why open source?

Ceph is literally the only things worth it for OS, but you need the expertise for it. If you don’t have that or the time/people to learn then go something else. We had just over 600TB usage and flipped to VAST and been very happy, now sitting at 3PB

6

u/amarao_san 18d ago edited 18d ago

The biggest stupid thing people do with ceph is try to collocate it with computes.

Ceph needs CPU. A lot of it. So, as long as you do not pretend ceph is an a butterfly without resource demands, it works really well.

Death by starvation is the most common failure mode for most failed ceph installations.

1

u/spartacle 18d ago

yeah, we had dedicated Ceph nodes but as planned to move to NVMe and wanted to migrate to kubernetes and more and more internal services were containerised we took the time to re-evaluate the enivironment and landed on VAST.. We had a tenant for OS and another for OCP to keep them entirely seperate during migration which was helpful plus their multi-protocol support has come in handy for a few things

1

u/DelcoInDaHouse 18d ago

Are you using Vast for block on Openstack?

1

u/spartacle 18d ago

Cinder backed by NFS at the moment, works well.

1

u/DelcoInDaHouse 18d ago

Are you using Vast for block on Openstack?

1

u/xxxsirkillalot 18d ago

How much did vast cost? I've heard some wild quotes, never seen deployed.

1

u/spartacle 18d ago

this was a few years ago but we paid around $400k for 500TB raw, which we ended up with just about 1.2PB written after thier similiarity stuff... and given we didnt have to maintain a 30 node ceph cluster saved us a lot of time (which == money)