MinIO is a high performance distributed object storage server, designed for large-scale private cloud infrastructure. MinIO is designed in a cloud-native manner to scale sustainably in multi-tenant environments. Orchestration platforms like Kubernetes provide perfect launchpad for MinIO to scale. There are multiple options to deploy MinIO on Kubernetes:
-
Helm Chart: MinIO Helm Chart offers customizable and easy MinIO deployment with a single command. Refer MinIO Helm Chart repository documentation for more details.
-
YAML File: MinIO can be deployed with yaml files via kubectl. Refer MinIO yaml file documentation to deploy MinIO using yaml files.
-
MinIO-Operator: Operator creates and manages distributed MinIO deployments running on Kubernetes, using CustomResourceDefinitions and Controller.
- Kubernetes version v1.15.5 and above.
kubectlconfigured to refer to a Kubernetes cluster.
To start MinIO-Operator, use the docs/minio-operator.yaml file.
kubectl create -f https://raw.githubusercontent.com/minio/minio-operator/master/minio-operator.yaml
This will create all relevant resources required for the Operator to work. Here is a list of resources created by above yaml file:
Namespace: Custom namespace for MinIO-Operator. By default it is named asminio-operator-ns.CustomResourceDefinition: Custom resource definition named asminioinstances.miniocontroller.min.io.ClusterRole: A cluster wide role for the controller. It is named asminio-operator-role. This is used for RBAC.ServiceAccount: Service account is used by the custom controller to access the cluster. Account name by default isminio-operator-sa.ClusterRoleBinding: This cluster wide binding binds the service accountminio-operator-sato cluster roleminio-operator-role.Deployment: Deployment creates a pod using the MinIO-Operator Docker image. This is where the custom controller runs and looks after any changes in custom resource.
These variables may be passed to operator Deployment in order to modify some of its parameters
| name | default | description |
|---|---|---|
WATCHED_NAMESPACE |
If set, the operator will watch only MinIO resources deployed in the specified namespace. All namespaces are watched if empty |
Once MinIO-Operator deployment is running, you can create MinIO instances using the below command
kubectl create -f https://raw.githubusercontent.com/minio/minio-operator/master/examples/minioinstance.yaml
After you have a distributed MinIO Cluster running (zones.server > 3), you can expand the MinIO cluster using
kubectl patch minioinstances.miniocontroller.min.io minio --patch "$(cat examples/patch.yaml)" --type=merge
You can further keep adding new zones in the patch.yaml file and apply the patch, to add new nodes to existing cluster.
MinIO-Operator currently supports following features:
- Create and delete highly available distributed MinIO clusters.
- Expand an existing MinIO cluster.
- Upgrading existing distributed MinIO clusters.
Refer minioinstance.yaml for details on how to pass supported fields to the operator.
- Bucket Expansion Support
- Federation and CoreDNS
- Continuous remote site mirroring with
mc mirror