FS-Cache 调研

最近需要使用到 FSCache，今天调研一下FS-Cache，主要记录一些索引，方便以后查阅：

RedHat 文档：https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/storage_administration_guide/ch-fscache （此文档讲解较为详细）

内核社区文档：https://www.kernel.org/doc/Documentation/filesystems/caching/fscache.txt

FS-Cache: A Network Filesystem Caching Facility：https://people.redhat.com/dhowells/fscache/FS-Cache.pdf

NFS 相关，请阅读：https://www.cnblogs.com/xuyaowen/p/NFS_install.html （之前写的关于nfs安装相关的内容）

使用NFS缓存减少IO https://blog.csdn.net/luckytanggu/article/details/78476634 (此篇文章较为实践，我也进行了相同的测试，显示fscache起作用，大家可以参考) 

关于linux内核中对文件系统的cache大家可以参考此链接：https://www.kernel.org/doc/Documentation/filesystems/caching/ （内核文件系统cache详细文档）

FS-Cache 配置文件解析：

###############################################################################
#
# Copyright (C) 2006,2010 Red Hat, Inc. All Rights Reserved.
# Written by David Howells (dhowells@redhat.com)
#
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU General Public License
# as published by the Free Software Foundation; either version
# 2 of the License, or (at your option) any later version.
#
###############################################################################

dir /var/cache/fscache  # 自定义缓存目录
tag mycache             # 标签，用于区分多个缓存
brun 10%                # 剩余空间大于这个设置值时，自动进行缓存
bcull 7%                # 剩余空间大于这个设置值时，开始自动删除使用频率最低的缓存
bstop 3%                # 剩余空间小于这个设置值时，缓存功能关闭

# 开头的参数则是按照文件数来计算%， 其原理与根据block数（剩余空间）计算是一样的。
frun 10%
fcull 7%
fstop 3%

# Assuming you're using SELinux with the default security policy included in
# this package
secctx system_u:system_r:cachefiles_kernel_t:s0

brun N% (percentage of blocks) , frun N% (percentage of files)
If the amount of free space and the number of available files in the cache rises above both these limits, then culling is turned off.
bcull N% (percentage of blocks), fcull N% (percentage of files)
If the amount of available space or the number of files in the cache falls below either of these limits, then culling is started.
bstop N% (percentage of blocks), fstop N% (percentage of files)
If the amount of available space or the number of available files in the cache falls below either of these limits, then no further allocation of disk space or files is permitted until culling has raised things above these limits again.

三对参数应该满足的关系：

0 ≤ bstop < bcull < brun < 100

0 ≤ fstop < fcull < frun < 100 

注意：Culling depends on both bxxx and fxxx pairs simultaneously; they can not be treated separately.

其他参考地址：/usr/share/doc/kernel-doc-version/Documentation/filesystems/caching/fscache.txt 

关于nfs fsc 选项的说明（fsc选项）：

阅读摘要：

• yum install cachefilesd; 
• 挂载命令：直接mount服务端共享的目录到本地的/mnt目录，必须使用-o fsc参数选项;
• All access to files under /mount/point will go through the cache, unless the file is opened for direct I/O or writing; 
• Opening a file from a shared file system for direct I/O automatically bypasses the cache. This is because this type of access must be direct to the server.
• To avoid coherency management problems between superblocks, all NFS superblocks that wish to cache data have unique Level 2 keys. Normally, two NFS mounts with same source volume and options share a superblock, and thus share the caching, even if they mount different directories within that volume.
• Opening a file from a shared file system for writing will not work on NFS version 2 and 3.  因为没有足够的维持并发写的一致性信息；
• Furthermore, this release of FS-Cache only caches regular NFS files. FS-Cache will not cache directories, symlinks, device files, FIFOs and sockets. 其只对文件数据进行cache的操作。

保持更新，资源来源自网络，此文章主要是用来索引，如果您有相关问题，请关注cnblogs.com/xuyaowen; 

# 更新 12.3.2019 

• cachefiles 为 fscache的后端；cachefs也是 fscache的后端；
• cachefiles 和 fscache都集成到了linux 内核中；作为单独的模块；好像 cachefs没有继承到内核之中，说明cachefiles较为常用，已经合并到内核之中，说明该功能模块，较为稳定。
• 对应的linux内核模块为 cachefiles.ko 和 fscache.ko，在 /lib/modules/内核版本/kernel/fs/之中；
• 同理，我们在相应的内核模块目录中，可以查看fuse的内核模块：cuse.ko; 使用modprobe -v 可以加载；rmmod和inmod 可以卸载和安装内核模块；具体其他操作，可以查找相应的手册；