Hadoop学习指南：探索大数据时代的重要组成——HDFS(下)

[atguigu@hadoop102 current]$ hdfs 
oiv            
apply the offline fsimage viewer to an fsimage 
oev            
apply the offline edits viewer to an edits file

[atguigu@hadoop102 current]$ pwd 
/opt/module/hadoop-3.1.3/data/dfs/name/current 
 
[atguigu@hadoop102 current]$ hdfs oiv -p XML -i 
fsimage_0000000000000000025 -o /opt/module/hadoop-3.1.3/fsimage.xml 
 
[atguigu@hadoop102 current]$ cat /opt/module/hadoop-3.1.3/fsimage.xml

<inode> 
 <id>16386</id> 
 <type>DIRECTORY</type> 
 <name>user</name> 
 <mtime>1512722284477</mtime> 
 <permission>atguigu:supergroup:rwxr-xr-x</permission> 
 <nsquota>-1</nsquota> 
 <dsquota>-1</dsquota> 
</inode> 
<inode> 
 <id>16387</id> 
 <type>DIRECTORY</type> 
 <name>atguigu</name> 
 <mtime>1512790549080</mtime> 
 <permission>atguigu:supergroup:rwxr-xr-x</permission> 
 <nsquota>-1</nsquota> 
 <dsquota>-1</dsquota> 
</inode> 
<inode> 
 <id>16389</id> 
 <type>FILE</type> 
 <name>wc.input</name> 
 <replication>3</replication> 
 <mtime>1512722322219</mtime> 
 <atime>1512722321610</atime> 
 <perferredBlockSize>134217728</perferredBlockSize> 
 <permission>atguigu:supergroup:rw-r--r--</permission> 
 <blocks> 
  <block> 
   <id>1073741825</id> 
   <genstamp>1001</genstamp> 
   <numBytes>59</numBytes> 
  </block> 
 </blocks> 
</inode > 

hdfs oev -p 文件类型 -i编辑日志 -o 转换后文件输出路径 

[atguigu@hadoop102 current]$ hdfs oev -p XML -i 
edits_0000000000000000012-0000000000000000013 -o /opt/module/hadoop
3.1.3/edits.xml 
 
[atguigu@hadoop102 current]$ cat /opt/module/hadoop-3.1.3/edits.xml 

<?xml version="1.0" encoding="UTF-8"?> 
<EDITS> 
 <EDITS_VERSION>-63</EDITS_VERSION> 
 <RECORD> 
  <OPCODE>OP_START_LOG_SEGMENT</OPCODE> 
  <DATA> 
   <TXID>129</TXID> 
  </DATA> 
 </RECORD> 
 <RECORD> 
  <OPCODE>OP_ADD</OPCODE> 
  <DATA> 
   <TXID>130</TXID> 
   <LENGTH>0</LENGTH> 
   <INODEID>16407</INODEID> 
   <PATH>/hello7.txt</PATH> 
   <REPLICATION>2</REPLICATION> 
   <MTIME>1512943607866</MTIME> 
   <ATIME>1512943607866</ATIME> 
   <BLOCKSIZE>134217728</BLOCKSIZE> 
   <CLIENT_NAME>DFSClient_NONMAPREDUCE_
1544295051_1</CLIENT_NAME> 
   <CLIENT_MACHINE>192.168.10.102</CLIENT_MACHINE> 
   <OVERWRITE>true</OVERWRITE> 
   <PERMISSION_STATUS> 
    <USERNAME>atguigu</USERNAME> 
    <GROUPNAME>supergroup</GROUPNAME> 
    <MODE>420</MODE> 
   </PERMISSION_STATUS> 
   <RPC_CLIENTID>908eafd4-9aec-4288-96f1
e8011d181561</RPC_CLIENTID> 
   <RPC_CALLID>0</RPC_CALLID> 
  </DATA> 
 </RECORD> 
 <RECORD> 
  <OPCODE>OP_ALLOCATE_BLOCK_ID</OPCODE> 
  <DATA> 
   <TXID>131</TXID> 
   <BLOCK_ID>1073741839</BLOCK_ID> 
  </DATA> 
 </RECORD> 
 <RECORD> 
  <OPCODE>OP_SET_GENSTAMP_V2</OPCODE> 
  <DATA> 
   <TXID>132</TXID> 
   <GENSTAMPV2>1016</GENSTAMPV2> 
    </DATA> 
 </RECORD> 
 <RECORD> 
  <OPCODE>OP_ADD_BLOCK</OPCODE> 
  <DATA> 
   <TXID>133</TXID> 
   <PATH>/hello7.txt</PATH> 
   <BLOCK> 
    <BLOCK_ID>1073741839</BLOCK_ID> 
    <NUM_BYTES>0</NUM_BYTES> 
    <GENSTAMP>1016</GENSTAMP> 
   </BLOCK> 
   <RPC_CLIENTID></RPC_CLIENTID> 
   <RPC_CALLID>-2</RPC_CALLID> 
  </DATA> 
 </RECORD> 
 <RECORD> 
  <OPCODE>OP_CLOSE</OPCODE> 
  <DATA> 
   <TXID>134</TXID> 
   <LENGTH>0</LENGTH> 
   <INODEID>0</INODEID> 
   <PATH>/hello7.txt</PATH> 
   <REPLICATION>2</REPLICATION> 
   <MTIME>1512943608761</MTIME> 
   <ATIME>1512943607866</ATIME> 
   <BLOCKSIZE>134217728</BLOCKSIZE> 
   <CLIENT_NAME></CLIENT_NAME> 
   <CLIENT_MACHINE></CLIENT_MACHINE> 
   <OVERWRITE>false</OVERWRITE> 
   <BLOCK> 
    <BLOCK_ID>1073741839</BLOCK_ID> 
    <NUM_BYTES>25</NUM_BYTES> 
    <GENSTAMP>1016</GENSTAMP> 
   </BLOCK> 
   <PERMISSION_STATUS> 
    <USERNAME>atguigu</USERNAME> 
    <GROUPNAME>supergroup</GROUPNAME> 
    <MODE>420</MODE> 
   </PERMISSION_STATUS> 
  </DATA> 
 </RECORD> 
</EDITS > 

<property> 
  <name>dfs.namenode.checkpoint.period</name> 
  <value>3600s</value> 
</property> 

<property>
<name>dfs.namenode.checkpoint.txns</name> 
<value>1000000</value> 
<description>操作动作次数</description> 
</property> 
<property> 
<name>dfs.namenode.checkpoint.check.period</name> 
<value>60s</value> 
<description> 1 分钟检查一次操作次数</description> 
</property> 

<property> 
<name>dfs.blockreport.intervalMsec</name> 
<value>21600000</value> 
<description>Determines block reporting interval in 
milliseconds.</description> 
</property> 

<property> 
<name>dfs.datanode.directoryscan.interval</name> 
<value>21600s</value> 
<description>Interval in seconds for Datanode to scan data 
directories and reconcile the difference between blocks in memory and on 
the disk. 
Support multiple time unit suffix(case insensitive), as described 
in dfs.heartbeat.interval. 
</description> 
</property> 

<property> 
<name>dfs.namenode.heartbeat.recheck-interval</name> 
<value>300000</value> 
</property> 
<property> 
<name>dfs.heartbeat.interval</name> 
<value>3</value> 
</property>