Skip to main content

Best Practices for Distributed File Storage

Git performance​

Git performance with Distributed File Storage can sometimes be slower than desired. Here are some best practices to enhance its performance on Distributed File Storage.

Enable parallel checkout​

Enable parallel checkout by setting a desired number of parallel workers in your Git config (checkout.workers). The recommended number for working with Distributed File Storage is 16.

Example
$
git config --global checkout.workers 16

Enable untracked cache​

Enable Git's untracked cache.

Example
$
git config --global core.untrackedCache true

Define record sizes for TAR performance​

When using TAR (tar) for compression, it may help performance to set the record size to 1M:

Example
$
tar --record-size=1M -cf archive.tar foo
Learn more

Setting the record size can also make rsync more efficient. See the man page for tar for more information.

Last updated on