关键词：
k8s使用glusterfs存储报错type ‘features/utime‘ is not valid or not found on this machinepods报错如下
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 5m48s default-scheduler Successfully assigned default/auth-web-1-77f4f7cbcc-snp8c to 192.168.1.216
Warning FailedMount 5m47s kubelet, 192.168.1.216 MountVolume.SetUp failed for volume "auth-web-home" : mount failed: mount failed: exit status 1
Mounting command: mount
Mounting arguments: -t glusterfs -o log-file=/var/lib/kubelet/plugins/kubernetes.io/glusterfs/auth-web-home/auth-web-1-77f4f7cbcc-snp8c-glusterfs.log,backup-volfile-servers=192.168.1.175:192.168.1.178:192.168.1.179,log-level=ERROR 192.168.1.175:k8s-glusterfs /var/lib/kubelet/pods/cb033ec1-6a62-11e9-b923-e0d55e1cf4c9/volumes/kubernetes.io~glusterfs/auth-web-home
Output: Mount failed. Please check the log file for more details.
the following error information was pulled from the glusterfs log to help diagnose this issue:
[2019-04-29 09:40:16.070806] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:16.071117] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x5654d1b3138e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x5654d1b2bdc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f7989cda68b] ) 0-graph: invalid argument: graph [Invalid argument]
Warning FailedMount 5m47s kubelet, 192.168.1.216 MountVolume.SetUp failed for volume "auth-web-home" : mount failed: mount failed: exit status 1
Mounting command: mount
Mounting arguments: -t glusterfs -o log-level=ERROR,log-file=/var/lib/kubelet/plugins/kubernetes.io/glusterfs/auth-web-home/auth-web-1-77f4f7cbcc-snp8c-glusterfs.log,backup-volfile-servers=192.168.1.175:192.168.1.178:192.168.1.179 192.168.1.175:k8s-glusterfs /var/lib/kubelet/pods/cb033ec1-6a62-11e9-b923-e0d55e1cf4c9/volumes/kubernetes.io~glusterfs/auth-web-home
Output: Mount failed. Please check the log file for more details.根据报错信息,我们可以看出来挂载的时候他是指定的日志文件的,我们去对应的日志查看报错
[2019-04-29 09:40:16.070575] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:16.070647] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:16.070806] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:16.071117] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x5654d1b3138e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x5654d1b2bdc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f7989cda68b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:16.712383] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:16.712464] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:16.712658] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:16.713034] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x55c7459fe38e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x55c7459f8dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f1a3cded68b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:17.868659] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:17.868718] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:17.868882] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:17.869215] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x5625d510738e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x5625d5101dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f578831768b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:20.068908] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:20.068976] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:20.069168] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:20.069562] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x55da540e838e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x55da540e2dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f1a9d62068b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:24.271395] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:24.271482] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:24.271669] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:24.272034] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x56378367338e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x56378366ddc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f676cb0468b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:32.670859] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:32.670935] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:32.671118] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:32.671504] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x55d7af7e738e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x55d7af7e1dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7f33da2a568b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:40:48.870810] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:40:48.870865] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:40:48.871021] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:40:48.871325] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x55b23825838e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x55b238252dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7fcc6bb9668b] ) 0-graph: invalid argument: graph [Invalid argument]
[2019-04-29 09:41:21.069815] E [MSGID: 101002] [graph.y:212:volume_type] 0-parser: Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
[2019-04-29 09:41:21.069878] E [MSGID: 101019] [graph.y:320:volume_end] 0-parser: "type" not specified for volume k8s-glusterfs-utime
[2019-04-29 09:41:21.070033] E [MSGID: 100026] [glusterfsd.c:2307:glusterfs_process_volfp] 0-: failed to construct the graph
[2019-04-29 09:41:21.070404] E [graph.c:982:glusterfs_graph_destroy] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x12e) [0x55c07e7d838e] -->/usr/sbin/glusterfs(glusterfs_process_volfp+0x148) [0x55c07e7d2dc8] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(glusterfs_graph_destroy+0x6b) [0x7fe065eee68b] ) 0-graph: invalid argument: graph [Invalid argument]发现他一直在提示这一句 Volume ‘k8s-glusterfs-utime‘, line 61: type ‘features/utime‘ is not valid or not found on this machine
造成这个原因有如下几种可能:
1,glusterfs-server和glusterfs-client安装的版本不对应(解决办法,升级版本使版本一致)
2,glusterfs-server和glusterfs-clinet时间不同步,(做ntp时间服务器,或者关闭校验使用命令 gluster volume set $VolumeName ctime off)
k8s使用glusterfs动态生成pv(代码片段)
一、环境介绍[[email protected]~]#cat/etc/hosts127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4::1 localhost localhost.localdomain localhost6 localhost6.localdomain6172.31.250.152k8s-m172.31.250.153node1172.31.250.154node2[[email protected]~]#kubectlgetnode... 查看详情
对象存储glusterfs使用
新增三台centos7机器，最小化安装ip分配是服务端192.168.1.7192.168.1.8 客户端192.168.1.9 主机名分别为gluster01gluster02client01hostnamectlset-hostnamegluster01hostnamectlset-hostnamegluster02hostnamectlset-ho 查看详情
glusterfs分布式存储
目录glusterfs简介glusterfs部署 一、glusterfs简介Glusterfs是一个开源的分布式文件系统，是Scale存储的核心，能够处理千数量级的客户端。是整合了许多存储块（server）通过InfinibandRDMA或者 Tcp/Ip方式互联的一个并行的网络文件... 查看详情
k8s1.5.4挂载volume之glusterfs
k8s1.5.4挂载volume之glusterfsvolume的例子集合https://github.com/kubernetes/kubernetes/tree/master/examples/volumeshttp://www.dockerinfo.net/2926.htmlhttp://dockone.io/article/2087https://www.kubernetes.org.cn 查看详情
分布式文件存储——glusterfs
一、概论1.简介GlusterFS(GlusterFileSystem)是一个开源的分布式文件系统，主要由ZRESEARCH公司负责开发。GlusterFS是Scale-Out存储解决方案Gluster的核心，具有强大的横向扩展能力，通过扩展能够支持数PB存储容量和处理数千客户端。GlusterFS... 查看详情
38掌握分布式存储系统glusterfs的基本用法，包括卷管理数据复制(代码片段)
GlusterFS是一种分布式文件系统，可以将多个存储服务器集成为一个分布式存储池。以下是一些基本的使用方法和示例代码。安装和启动GlusterFS在所有节点上安装GlusterFS，并确保每个节点上的GlusterFS服务已经启动。创建Glust... 查看详情
glusterfs分布式存储部署流程
转自：http://bangbangba.blog.51cto.com/3180873/1712061GlusterFS是一款非常易于使用的分布式文件存储系统，实现了全部标准POSIX接口，并用fuse实现虚拟化，让用户看起来就像是本地磁盘一样。因此程序想从本地磁盘切换到GlusterFS时是不用修... 查看详情
glusterfs分布式文件系统概述(代码片段)
博文目录一、GlusterFS概述1、GlusterFS的特点2、GlusterFS术语3、模块化堆栈式架构二、GlusterFS的工作原理1、GlusterFS的工作流程2、弹性HASH算法三、GlusterFS的卷类型1、分布式卷2、条带卷3、复制卷4、分布式条带卷5、分布式复制卷一、G... 查看详情
glusterfs分布式存储集群-2.使用(代码片段)
参考文档： QuickStartGuide：http://gluster.readthedocs.io/en/latest/Quick-Start-Guide/Quickstart/ Install-Guide：https://docs.gluster.org/en/latest/Install-Guide/Install/ CentOSgluster-Quickstart：https: 查看详情
glusterfs本地yum源安装报错error:package:
报错如下-->FinishedDependencyResolutionError:Package:glusterfs-server-3.4.7-1.el6.x86_64(glusterfs) Requires:glusterfs-cli=3.4.7-1.el6 &n 查看详情
glusterfs分布式文件系统部署
理论部分一：GlusterFS概述1.1：Glusterfs简介??GlusterFS是Scale-Out存储解决方案Gluster的核心，它是一个开源的分布式文件系统，具有强大的横向扩展能力，通过扩展能够支持数PB存储容量和处理数千客户端。GlusterFS借助TCP/IP或InfiniBandRDM... 查看详情
k8s的pv/pvc
...部分第一个介绍了Volume。Volume可以支持local、nfs、cephfs、glusterfs以及各种云计算平台。官网Volume的配置都是在一个创建pod的yaml文件中，例如除了Volume之外，kubernetes还提供了PersistentVolume的方法。Volume主要是为了存储一些有必要保... 查看详情
分布式文件系统---glusterfs介绍
GlusterFS概述GlusterFS是Scale-Out存储解决方案Gluster的核心，它是一个开源的分布式文件系统，具有强大的横向扩展能力，通过扩展能够支持数PB存储容量和处理数千客户端。GlusterFS借助TCP/IP或InfiniBandRDMA网络将物理分布的存储资源聚... 查看详情
glusterfs简单介绍
...手，低坑模式，深受我这种菜鸟的喜爱并一发不可收拾。glusterFS：适用于数据密集型任务的可扩展忘了文件系统，免费开源。gluster于2011年10月7日被redhat收 查看详情
glusterfs分布式存储安装部署
Glusterfs分布式存储部署是存储当中可以选择的一种现在很多虚拟化云计算都在用软件存储例如cephGlusterfs等等今天我们部署一下Glusterfs环境 GlusterFs安装 环境信息： Glusterfs-A ... 查看详情
glusterfs分布式存储集群部署记录-相关补充
接着上一篇Centos7下GlusterFS分布式存储集群环境部署记录文档，继续做一些补充记录，希望能加深对GlusterFS存储操作的理解和熟悉度。========================清理glusterfs存储环境=========================由上面可知，该glusterfs存储集群... 查看详情
glusterfs引起的splitbrain问题(代码片段)
1问题描述在openstack环境中的一个vm无故停止了，使用界面和命令都启动不了，查看日志：2018-04-0203:22:53.46314655INFOnova.virt.libvirt.driver[-][instance:0498a9d1-3958-4972-943e-fe6a44490192]Instancedestroyedsuccessful 查看详情
glusterfs-----文件分布系统＋集群部署(代码片段)
一、Gluster概述1.1、gluster简介Glusterfs是一个开源的分布式文件系统,是Scale存储的核心,能够处理千数量级的客户端.在传统的解决方案中Glusterfs能够灵活的结合物理的,虚拟的和云资源去体现高可用和企业级的性能存储.Glusterfs通过TCP... 查看详情