Manjaro Difference between revisions of "File Systems"

Difference between revisions of "File Systems"

From Manjaro
(Marked this version for translation)
m (remove under construction)
 
(50 intermediate revisions by 4 users not shown)
Line 1: Line 1:
<languages/>
<languages/>
__TOC__
<translate>
<translate>
<!--T:1-->
<!--T:14-->
__TOC__
This page provides information on some of the filesystems commonly used in Manjaro. It also shows where and how they are used. Further information on these and other filesystems can be found in the ARCH Wiki.
 
<!--T:15-->
A filesystem manages the space on a storage medium (hard disk, SSD ...). It makes this memory available to the operating system so that files can be saved and read again. Each of the following filesystems has advantages and disadvantages. They are mostly developed for a special purpose and are therefore used in a certain environment.
 
== Linux == <!--T:16-->
 
<!--T:32-->
filesystems that are mostly used under Linux.
 
<!--T:33-->
Note that many filesystem drivers are already included in the Linux kernel. You may not need anything else to mount, read, or write these filesystems. But there are packages with additional tools. You may need them to format, check, repair, modify, or optimize such filesystems. So if you regularly use a filesystem, it is a good idea to install the appropriate tools.
 
=== Ext2 → Ext3 → Ext4 === <!--T:34-->
 
<!--T:35-->
Ext4 is the default filesystem in Manjaro at the moment. It is the evolution of the most used Linux filesystems (Ext3, Ext2) and promises improved design, better performance, reliability, and features over its predecessors.
 
<!--T:36-->
If you are using Ext2 or Ext3, you can convert the partition to Ext4. Ext4 uses journaling, checksums and write barriers and is therefore more robust against damage.
 
<!--T:37-->
Currently Ext4 is fully supported in Win10 and OsX. Support for ext4 has been built in since WSL is included in Win10 (2016).
 
<!--T:38-->
see [https://ext4.wiki.kernel.org/ Ext4@kernel.org], [https://wiki.archlinux.org/title/Ext4 Ext4@ARCH-wiki], [https://de.wikipedia.org/wiki/Ext4 Ext4@wikipedia]
<br>For advanced optimizations see  [https://wiki.archlinux.org/index.php/Ext4#Improving_performance Improving Ext4 performance@Archwiki].
 
====Install==== <!--T:17-->
 
<!--T:39-->
In Manjaro, e2fsprogs is already installed
 
===[[Btrfs]]=== <!--T:20-->
 
<!--T:40-->
A modern '''C'''opy '''o'''n '''W'''rite filesystem for Linux aimed at implementing advanced features while also focusing on '''fault tolerance''', '''repair''' and '''easy administration'''. [[Btrfs]] not only is a filesystem, but also is partly a volume manager, software-raid, backup-tool, and it is flash-friendly.
 
<!--T:41-->
Because [[Btrfs]] is different, some things seem unfamiliar and strange. Then [[Btrfs]] is a good starting point to search for answers.
 
<!--T:42-->
Development of Btrfs started in 2007. Since that time, Btrfs is a part of the Linux kernel and is under active development. The Btrfs code base is '''[https://btrfs.wiki.kernel.org/index.php/Status stable] .''' However, new features are still under development. Its main features and benefits are:
* '''Snapshots''' which do not make a full copy of files
* '''RAID''' - support for software-based RAID 0, RAID 1, RAID 10
* '''Self-healing''' - checksums for data and metadata, automatic detection of silent data corruptions
 
<!--T:43-->
see [[Btrfs]], [https://btrfs.wiki.kernel.org/index.php/Main_Page Btrfs@kernel.org], [https://wiki.archlinux.org/title/Btrfs Btrfs@ARCH-wiki], [https://de.wikipedia.org/wiki/Btrfs Btrfs@wikipedia]
 
====Install==== <!--T:21-->
 
<!--T:44-->
<tvar|usercmd0>{{UserCmd|command=pamac install btrfs-progs}}</>
 
=== ReiserFS → reiser4 === <!--T:18-->
 
<!--T:45-->
ReiserFS was the first journaling filesystem to be included in the standard kernel. It was actively used by some distros some time ago, but is not currently widely used. Reiser4 is the successor to ReiserFS(3). However, Reiser4 seems not to be integrated in the kernel yet.
 
<!--T:46-->
see [https://wiki.archlinux.org/title/Reiser4 Reiser4@ARCH-wiki], [https://en.wikipedia.org/wiki/ReiserFS ReiserFS@wikipedia], [https://en.wikipedia.org/wiki/Reiser4 Reiser4@wikipedia], [https://reiser4.wiki.kernel.org/ Reiser4@kernel.org]
 
====Install==== <!--T:19-->
 
<!--T:47-->
<tvar|usercmd2>{{UserCmd|command=pamac install reiserfsprogs reiser4progs}}</>
 
== Windows == <!--T:22-->
 
<!--T:48-->
filesystems mostly used in windows
 
=== NTFS === <!--T:49-->
 
<!--T:50-->
It is the most widely used filesystem on windows these days. It does exist in different versions, but unlike FAT32, all of them offer the following points:
* Large files> 4GB
* Long file names with UTF16 up to 255 characters
* Rights management, ACL
* Journaling of metadata
* Compression, encryption, ...
 
<!--T:51-->
Currently there are some restrictions when using NTFS with Linux. If windows is suddenly switched off or goes into hibernating, the NTFS filesystem is left in a "dirty-state". When Windows starts again, NTFS is the first to be cleaned. This operation is currently not supported by the Linux driver. Then Linux shows the NTFS filesystem as read-only to be on the safe side.
 
<!--T:53-->
see [https://wiki.archlinux.org/title/NTFS NTFS@ARCH-wiki], [https://en.wikipedia.org/wiki/NTFS NTFS@wikipedia]
 
<!--T:52-->
{{warning |If you regularly switch between Windows and Linux, you should switch off "hibernation", "Hybrid Boot", "Fast Boot" in Windows. Then Linux has always full (read / write) access to NTFS drives.
* [https://forum.manjaro.org/t/all-of-my-files-are-in-read-only-mode/83777/7 all-of-my-files-are-in-read-only-mode@forum]
}}
 
====Install==== <!--T:23-->
 
<!--T:54-->
<tvar|usercmd3>{{UserCmd|command=pamac install ntfs-3g}}</>
 
== DOS == <!--T:24-->
 
<!--T:55-->
filesystems under DOS and early windows on a lot of floppydisks and USB-sticks
 
=== FAT16 → FAT32 (+VFAT) === <!--T:56-->


<!--T:57-->
This is a traditional filesystem under DOS and early Windows versions. Even today it can be found on many floppy disks, USB sticks and hard drives. It is supported by all types of operating systems and is therefore often used to exchange files, to pass them on, or to keep them accessible to both operating systems in the case of dualboot.


=Ext4= <!--T:2-->
<!--T:58-->
Even with FAT32, this comes not without its disadvantages.
* no support for user rights or xattr
* severely restricted file names (8.3 or LFN for VFAT, no distinction between lowercase and uppercase)
* no files over 2GB (FAT16) 4GB (FAT32)
* no journaling
* not robust


<!--T:3-->
<!--T:59-->
Ext4 is the evolution of the most used Linux filesystems (Ext3, Ext2) and promises improved design, better performance, reliability, and features over its predecessors.<br />
{{warning | FAT Filesystems do not use journaling. Data on such filesystems is vulnerable to irreparable corruption due to ''improper ejection or power outage''.}}
It is the default filesystem in Manjaro.


<!--T:60-->
see [https://wiki.archlinux.org/title/FAT FAT@ARCH-wiki], [https://en.wikipedia.org/wiki/File_Allocation_Table FAT@wikipedia]


====Tips==== <!--T:4-->
====Install==== <!--T:25-->


<!--T:5-->
<!--T:61-->
For advanced optimizations see the [https://wiki.archlinux.org/index.php/Ext4#Improving_performance Archwiki Ext4 article].
<tvar|usercmd4>{{UserCmd|command=pamac install dosfstools}}</>


=== exFAT === <!--T:26-->


=exFAT= <!--T:6-->
<!--T:62-->
Microsoft developed the exFAT (Extended File Allocation Table) in 2006 and optimized it for flash memories such as USB sticks and SD cards. It can store large files and large numbers of files, and it can manage very large partitions. It is supported by Linux, Windows, macOS and many other devices and is one of the most compatible filesystems. ExFAT is included in Linux 5.4 and higher.


<!--T:7-->
<!--T:63-->
Microsoft created the exFAT (Extended File Alocation Table) to make up for the inadequacies of FAT32 & NTFS, as it can hold large files, large numbers of files & use very large partitions. Supported on Linux, Windows, MacOS and many other devices, it is one of the most compatible filesystems.
* Flash friendly
A good choice when you need to share a removable device between many systems.
* No support for user rights or xattr
* Files over 4 GB
* Checksums for metadata
* No journal
* Not robust


</translate>
<!--T:64-->
{{warning | exFAT FS does not use journaling. Data on such a filesystem is vulnerable to irreparable corruption due to ''improper ejection or power outage''.}}
{{warning | exFAT FS does not use journaling. Data on such a filesystem is vulnerable to irreparable corruption due to ''improper ejection or power outage''.}}
<translate>


<!--T:27-->
see [https://en.wikipedia.org/wiki/ExFAT ExFAT@wikipedia]
====Install==== <!--T:28-->
<!--T:65-->
<tvar|usercmd5>{{UserCmd|command=pamac install exfatprogs}}</>
== macOS == <!--T:29-->
<!--T:66-->
Filesystems mostly used in macOS
=== HFS → HFS+ === <!--T:67-->
<!--T:68-->
see [https://en.wikipedia.org/wiki/HFS_Plus HFSPlus@wikipedia]
====Install from AUR==== <!--T:69-->
<!--T:70-->
<tvar|usercmd6>{{UserCmd|command=pamac install hfsprogs}}</>
== Others == <!--T:30-->
=== XFS === <!--T:71-->
<!--T:72-->
see [https://wiki.archlinux.org/title/XFS XFS@ARCH-wiki]
===ZFS=== <!--T:73-->


====Installation==== <!--T:8-->
<!--T:74-->
see [https://wiki.archlinux.org/title/ZFS ZFS@ARCH-wiki]


<!--T:9-->
==Comparisions== <!--T:75-->
To use exFAT, you need to install the '''exfat-utils''' package. You can do this using your favorite package manager or with this command:
</translate>
{| class="wikitable sortable"
|+<translate><!--T:76--> Possible usage of Filesystems</translate>
|-
!Filesystem!!Manjaro!!Win10!!OSX!!Win9x, DOS
|-
|ext2||●||▷ ExtFS||●||
|-
|ext3/4||●||▷ ExtFS||?||
|-
|btrfs||● btrfs-progs||▷ ExtFS, WinBtrfs||-||-
|-
|reiser3||● reiser4progs||▷ RFSTool||?||-
|-
|reiser4||○ reiserfs||?||?||-
|-
|NTFS||○ ntfs-3g<br>▶ 5.15?? ntfs3||●||?||
|-
|FAT32||● dosfstools||●||●||●
|-
|exFAT||▶ 5.4 exfatprogs||●||?||?
|-
|HFS||○ hfsprogs (AUR)||?||●||
|-
|XFS||?||▷ ExtFS||?||
|-
|ZFS||?||?||?||
|}
<translate>


  <!--T:10-->
  <!--T:77-->
pamac install exfat-utils
● = fully supported, additional tools to install
▶ = included since kernel x.x.x
○ = partially supported
▷ = possible via external tools
? = feel free to extend ;-)


<!--T:78-->
{| class="wikitable sortable"
|+ Some important properties
|-
! Properties !!ext2!!ext3!!ext4!!btrfs||reiserfs(3)||XFS
|-
|journaling ||-||● ordered||● ordered||● full||▶ 2.6||●
|-
|barriers ||-||||●||●
|-
|checksum ||-||-||◎ metadata||● full||●
|-
|kompression||-||-||-||●,<br><small>zstd ▶ 4.14/5.1</small>||
|-
|encryption||-||-||▶ 4.13||-
|-
|snapshots||-||-||-||●||-
|-
|TRIM possible||-||-||▶ 2.6.33||▶ 4.3
|-
|xattr, ACL||◎||?||ACL||ACL||ACL
|-
|small repair||● fsck||● fsck||● fsck||● auto||reiserfsck
|-
|journal repair||● fsck||● fsck||● fsck||● auto 3.2||
|-
|repair after power loss||-||?||● tune2fs, fsck||● auto, scrub||
|-
|since||1993||2001||2008||2009||2001
|}


=See also= <!--T:11-->
=See also= <!--T:31-->


<!--T:12-->
<!--T:79-->
[https://en.wikipedia.org/wiki/ExFAT Wikipedia:exFAT]<br />
[https://en.wikipedia.org/wiki/ExFAT Wikipedia:exFAT]<br />
[https://en.wikipedia.org/wiki/Comparison_of_file_systems Wikipedia:Comparison of file systems]<br />
[https://en.wikipedia.org/wiki/Comparison_of_file_systems Wikipedia:Comparison of filesystems]<br />
[https://wiki.archlinux.org/index.php/Filesystems Archwiki:File Systems]<br />  
[https://wiki.archlinux.org/index.php/Filesystems Archwiki:filesystems]<br />  
 
<!--T:13-->
[[Category:Contents Page]]
</translate>
</translate>
[[Category:Contents Page{{#translation:}}]]
[[Category:filesystems{{#translation:}}]]

Latest revision as of 16:58, 12 June 2023

Other languages:
English • ‎Türkçe • ‎français • ‎русский • ‎فارسی

This page provides information on some of the filesystems commonly used in Manjaro. It also shows where and how they are used. Further information on these and other filesystems can be found in the ARCH Wiki.

A filesystem manages the space on a storage medium (hard disk, SSD ...). It makes this memory available to the operating system so that files can be saved and read again. Each of the following filesystems has advantages and disadvantages. They are mostly developed for a special purpose and are therefore used in a certain environment.

Linux

filesystems that are mostly used under Linux.

Note that many filesystem drivers are already included in the Linux kernel. You may not need anything else to mount, read, or write these filesystems. But there are packages with additional tools. You may need them to format, check, repair, modify, or optimize such filesystems. So if you regularly use a filesystem, it is a good idea to install the appropriate tools.

Ext2 → Ext3 → Ext4

Ext4 is the default filesystem in Manjaro at the moment. It is the evolution of the most used Linux filesystems (Ext3, Ext2) and promises improved design, better performance, reliability, and features over its predecessors.

If you are using Ext2 or Ext3, you can convert the partition to Ext4. Ext4 uses journaling, checksums and write barriers and is therefore more robust against damage.

Currently Ext4 is fully supported in Win10 and OsX. Support for ext4 has been built in since WSL is included in Win10 (2016).

see Ext4@kernel.org, Ext4@ARCH-wiki, Ext4@wikipedia
For advanced optimizations see Improving Ext4 performance@Archwiki.

Install

In Manjaro, e2fsprogs is already installed

Btrfs

A modern Copy on Write filesystem for Linux aimed at implementing advanced features while also focusing on fault tolerance, repair and easy administration. Btrfs not only is a filesystem, but also is partly a volume manager, software-raid, backup-tool, and it is flash-friendly.

Because Btrfs is different, some things seem unfamiliar and strange. Then Btrfs is a good starting point to search for answers.

Development of Btrfs started in 2007. Since that time, Btrfs is a part of the Linux kernel and is under active development. The Btrfs code base is stable . However, new features are still under development. Its main features and benefits are:

  • Snapshots which do not make a full copy of files
  • RAID - support for software-based RAID 0, RAID 1, RAID 10
  • Self-healing - checksums for data and metadata, automatic detection of silent data corruptions

see Btrfs, Btrfs@kernel.org, Btrfs@ARCH-wiki, Btrfs@wikipedia

Install

user $ pamac install btrfs-progs COPY TO CLIPBOARD


ReiserFS → reiser4

ReiserFS was the first journaling filesystem to be included in the standard kernel. It was actively used by some distros some time ago, but is not currently widely used. Reiser4 is the successor to ReiserFS(3). However, Reiser4 seems not to be integrated in the kernel yet.

see Reiser4@ARCH-wiki, ReiserFS@wikipedia, Reiser4@wikipedia, Reiser4@kernel.org

Install

user $ pamac install reiserfsprogs reiser4progs COPY TO CLIPBOARD


Windows

filesystems mostly used in windows

NTFS

It is the most widely used filesystem on windows these days. It does exist in different versions, but unlike FAT32, all of them offer the following points:

  • Large files> 4GB
  • Long file names with UTF16 up to 255 characters
  • Rights management, ACL
  • Journaling of metadata
  • Compression, encryption, ...

Currently there are some restrictions when using NTFS with Linux. If windows is suddenly switched off or goes into hibernating, the NTFS filesystem is left in a "dirty-state". When Windows starts again, NTFS is the first to be cleaned. This operation is currently not supported by the Linux driver. Then Linux shows the NTFS filesystem as read-only to be on the safe side.

see NTFS@ARCH-wiki, NTFS@wikipedia


Warning
If you regularly switch between Windows and Linux, you should switch off "hibernation", "Hybrid Boot", "Fast Boot" in Windows. Then Linux has always full (read / write) access to NTFS drives.

Install

user $ pamac install ntfs-3g COPY TO CLIPBOARD


DOS

filesystems under DOS and early windows on a lot of floppydisks and USB-sticks

FAT16 → FAT32 (+VFAT)

This is a traditional filesystem under DOS and early Windows versions. Even today it can be found on many floppy disks, USB sticks and hard drives. It is supported by all types of operating systems and is therefore often used to exchange files, to pass them on, or to keep them accessible to both operating systems in the case of dualboot.

Even with FAT32, this comes not without its disadvantages.

  • no support for user rights or xattr
  • severely restricted file names (8.3 or LFN for VFAT, no distinction between lowercase and uppercase)
  • no files over 2GB (FAT16) 4GB (FAT32)
  • no journaling
  • not robust


Warning
FAT Filesystems do not use journaling. Data on such filesystems is vulnerable to irreparable corruption due to improper ejection or power outage.

see FAT@ARCH-wiki, FAT@wikipedia

Install

user $ pamac install dosfstools COPY TO CLIPBOARD


exFAT

Microsoft developed the exFAT (Extended File Allocation Table) in 2006 and optimized it for flash memories such as USB sticks and SD cards. It can store large files and large numbers of files, and it can manage very large partitions. It is supported by Linux, Windows, macOS and many other devices and is one of the most compatible filesystems. ExFAT is included in Linux 5.4 and higher.

  • Flash friendly
  • No support for user rights or xattr
  • Files over 4 GB
  • Checksums for metadata
  • No journal
  • Not robust


Warning
exFAT FS does not use journaling. Data on such a filesystem is vulnerable to irreparable corruption due to improper ejection or power outage.

see ExFAT@wikipedia

Install

user $ pamac install exfatprogs COPY TO CLIPBOARD


macOS

Filesystems mostly used in macOS

HFS → HFS+

see HFSPlus@wikipedia

Install from AUR

user $ pamac install hfsprogs COPY TO CLIPBOARD


Others

XFS

see XFS@ARCH-wiki

ZFS

see ZFS@ARCH-wiki

Comparisions

Possible usage of Filesystems
Filesystem Manjaro Win10 OSX Win9x, DOS
ext2 ▷ ExtFS
ext3/4 ▷ ExtFS ?
btrfs ● btrfs-progs ▷ ExtFS, WinBtrfs - -
reiser3 ● reiser4progs ▷ RFSTool ? -
reiser4 ○ reiserfs ? ? -
NTFS ○ ntfs-3g
▶ 5.15?? ntfs3
?
FAT32 ● dosfstools
exFAT ▶ 5.4 exfatprogs ? ?
HFS ○ hfsprogs (AUR) ?
XFS ? ▷ ExtFS ?
ZFS ? ? ?
● = fully supported, additional tools to install
▶ = included since kernel x.x.x 
○ = partially supported
▷ = possible via external tools
? = feel free to extend ;-)
Some important properties
Properties ext2 ext3 ext4 btrfs reiserfs(3) XFS
journaling - ● ordered ● ordered ● full ▶ 2.6
barriers -
checksum - - ◎ metadata ● full
kompression - - - ●,
zstd ▶ 4.14/5.1
encryption - - ▶ 4.13 -
snapshots - - - -
TRIM possible - - ▶ 2.6.33 ▶ 4.3
xattr, ACL ? ACL ACL ACL
small repair ● fsck ● fsck ● fsck ● auto reiserfsck
journal repair ● fsck ● fsck ● fsck ● auto 3.2
repair after power loss - ? ● tune2fs, fsck ● auto, scrub
since 1993 2001 2008 2009 2001

See also

Wikipedia:exFAT
Wikipedia:Comparison of filesystems
Archwiki:filesystems

Cookies help us deliver our services. By using our services, you agree to our use of cookies.