Jump to content

HAMMER (file system)

From Wikipedia, the free encyclopedia
(Redirected from HAMMER2)
HAMMER
DeveloperMatthew Dillon
Full nameHAMMER
IntroducedJuly 21, 2008; 18 years ago (2008-07-21) with DragonFly BSD 2.0[1][2]
Structures
Directory contentsModified B+ tree[3]
Limits
Max volume size1 EiB[3]
Features
ForksNo
File system
permissions		UNIX permissions
Transparent
compression		Yes[4]
Data deduplicationOn demand
Other
Supported
operating systems		DragonFly BSD

HAMMER is a high-availability 64-bit file system developed by Matthew Dillon for DragonFly BSD using B+ trees. Its major features include infinite NFS-exportable snapshots, master–multislave operation, configurable history retention, fsckless-mount, and checksums to deal with data corruption.[5] HAMMER also supports data block deduplication, meaning that identical data blocks will be stored only once on a file system.[6] A successor, HAMMER2, was announced in 2011 and became the default in Dragonfly 5.2 (April 2018).[7]

HAMMER2 was redesigned from the ground up to support enhanced clustering.

Features

[edit]

HAMMER file system provides configurable fine-grained and coarse-grained filesystem histories with online snapshots availability. Up to 65536 master (read–write) and slave (read-only) pseudo file systems (PFSs), with independent individual retention parameters and inode numbering, may be created for each file system; PFS may be mirrored to multiple slaves both locally or over network connection with near real-time performance. No file system checking is required on remount.[5][8][9][10]

HAMMER supports volumes up to 1 EiB of storage capacity. File system supports CRC checksumming of data and metadata, online layout correction and data deduplication, and dynamic inodes allocation with an effectively unlimited number of inodes.[8][11][12]

HAMMER2 supports online and batched deduplication, snapshots, directory entry indexing, multiple mountable filesystem roots, mountable snapshots, a low memory footprint, compression, encryption, zero-detection, data and metadata checksumming, and synchronization to other filesystems or nodes. It lacks support for extended file attributes ("xattr").

Limitations

[edit]

As of May 2020, regular maintenance is required to keep the file system clean and regain space after file deletions. By default, a cron job performs the necessary actions on DragonFly BSD daily. HAMMER does not support multi-master configurations.[8][10]

Performance

[edit]

HAMMER is optimized to reduce the number of physical I/O operations to cover the most likely path,[13] ensuring sequential access for optimal performance.

The following performance-related improvements were introduced in July 2011:[14]

  • Increased disk read speed in certain scenarios by implementing pulse-width modulated time-domain multiplexer on B-tree cursor operation
  • Removed a deadlock stalling issue
  • Improved read performance during heavy, concurrent file write operations

Development

[edit]

HAMMER was developed specifically for DragonFly BSD to "provide a feature-rich yet better designed analogue"[according to whom?] of the then increasingly popular ZFS.

HAMMER was declared production-ready with DragonFly 2.2 in 2009;[9] in 2012, design-level work shifted onto HAMMER2.

An example of file system layout of HAMMER2

The HAMMER2 file system was conceived by Matthew Dillon, who initially planned to bring it up to minimal working state by July 2012 and ship the final version in 2013.[15][7] During Google Summer of Code 2013 Daniel Flores implemented compression in HAMMER2 using LZ4 and zlib algorithms.[16][17] On June 4, 2014, DragonFly 3.8.0 was released featuring support for HAMMER2, although the file system was said to be not ready for use.[18] On October 16, 2017, DragonFly 5.0 was released with bootable support for HAMMER2, though file-system status was marked as experimental.[19]

HAMMER2 had a long incubation and development period before it officially entered production in April 2018, as the recommended root filesystem in the Dragonfly BSD 5.2 release.[20]

As of 2019, HAMMER is now often referred to as HAMMER1 to avoid confusion with HAMMER2, although an official renaming has not happened. Both filesystems are independent of each other due to different on-disk formats,[21][22] and continue to receive separate updates and improvements independently.[23]

Dillon continues to actively develop and maintain HAMMER2 as of June 2020.

See also

[edit]

References

[edit]
  1. ↑ "В состав DragonFlyBSD 2.0 будет включена файловая система HAMMER". Linux.org.ru (in Russian). 2007-10-14. Retrieved 2019-08-21.
  2. ↑ Larabel, Michael (7 January 2011). "Can DragonFlyBSD's HAMMER Compete With Btrfs, ZFS?". Phoronix. Retrieved 2014-05-26.
  3. 1 2 Dillon, Matthew (21 June 2008). "THE HAMMER FILESYSTEM" (PDF). Retrieved 2009-03-02.
  4. ↑ "HAMMER2 File-System Now Uses LZ4 Compression By Default - Phoronix". www.phoronix.com.
  5. 1 2 hammer(5) – DragonFly BSD File Formats Manual
  6. ↑ Sherrill, Justin (7 November 2010). "Deduplication arrives". Archived from the original on 2011-10-03. Retrieved 2011-11-28.
  7. 1 2 Dillon, Matthew (11 May 2011). "HAMMER2 announcement". users (Mailing list).
  8. 1 2 3 "HAMMER". DragonFly BSD. Retrieved 2011-11-28.
  9. 1 2 Vervloesem, Koen (21 April 2010). "DragonFly BSD 2.6: towards a free clustering operating system". LWN.net. Retrieved 2014-05-26.
  10. 1 2 George, Siju (May 2014). "Working with Hammer File System and PFSes" (PDF). BSD Magazine. 8 (5). Warsaw, Poland: Hakin9 Media SK: 18–23. Archived from the original on 27 May 2014. Retrieved 2014-05-25.
  11. ↑ hammer(8) – DragonFly BSD System Maintenance and Operation Commands Manual
  12. ↑ Kemp, Juliet (4 August 2008). "Tip of the Trade: Dragonfly BSD and the Hammer Filesystem". ServerWatch. Archived from the original on 2014-05-27. Retrieved 2014-05-26.
  13. ↑ Jeremy Andrews (2007-10-14). "HAMMER Performance". KernelTrap. Archived from the original on 2011-11-04. Retrieved 2019-08-21.
  14. ↑ Dillon, Matthew (22 July 2011). "git: HAMMER VFS - Add code to reduce frontend vs flusher locking conflicts". commits (Mailing list).
  15. ↑ Dillon, Matthew (2017-07-24). "DESIGN document for HAMMER2 (24-Jul-2017 update)" (Mailing list).
  16. ↑ "DragonFly BSD 5.0: HAMMER2 a 900 000 procesů".
  17. ↑ "Block compression feature in HAMMER2". GSoC 2013. Retrieved 2014-06-05.
  18. ↑ "DragonFly Release 3.8". DragonFly BSD. 2014-06-04. Retrieved 2014-06-05.
  19. ↑ "DragonFly Release 5.0". DragonFly BSD. 2017-10-16. Retrieved 2017-10-16.
  20. ↑ "DragonFly BSD 5.2". Dragonfly BSD Project. 9 April 2018. Retrieved 11 April 2018.
  21. ↑ Matthew Dillon (2017-09-23). "hammer_disk.h". BSD Cross Reference. DragonFly BSD. Retrieved 2019-03-06.
  22. ↑ Matthew Dillon (2018-05-05). "hammer2_disk.h". BSD Cross Reference. DragonFly BSD. Retrieved 2019-03-06.
  23. ↑ Matthew Dillon (2017-03-27). "git: hammer - HAMMER Version 7". commits@DragonFly (Mailing list). Retrieved 2019-03-06.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=HAMMER_(file_system)&oldid=1367548290"