What do you mean by Meta information in HDFS? List the documents related to metadata.

devquora
devquora

Posted On: Feb 22, 2018

 

Name-Node Metadata stores the record for Block mapping, locations of blocks on DataNodes, dynamic data nodes, and much more metadata are altogether stored in memory on the Name-Node. When we check the Name-Node status site, basically the greater part of that data is kept in memory somewhere.

The main thing stored on disk is the fsimage, edit log, and status logs. Name-Node never truly utilizes these records on disk, aside from when it begins. The fsimage and edits record practically exist to have the capacity to bring the Name-Node back up if it should be halted or it crashes.

  • 1) fsimage An fsimage document contains the entire state of the file system at a point in time. Each document system modification is doled out in a unique process, monotonically expanding transaction ID. A fsimage document speaks to the file system state after all alterations up to a particular transaction ID.
  • 2) Edits – An edited file is a log that lists each document system change (record creation, deletion or alteration) that was made after the latest fsimage. When a document is put into HDFS, it is converted into blocks (of configurable size).

    Related Questions

    Please Login or Register to leave a response.

    Related Questions

    Hadoop Interview Questions

    What does HDFS mean?

    The HDFS is one of the storage systems of the Hadoop structure. It is a circulated file structure that can helpfully ke..

    Hadoop Interview Questions

    What are the key features of HDFS?

    Various key features of HDFS are as follows: HDFS is a profoundly versatile and reliable storage system for big data st..

    Hadoop Interview Questions

    What is check pointing in Hadoop?

    Check pointing is a fundamental part of keeping up and holding on file system metadata in HDFS. It’s urgent for profi..