Disk Performance: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
 
(One intermediate revision by the same user not shown)
Line 50: Line 50:
   
   
  /'''tmp:''' test path
  /'''tmp:''' test path
==Reclaim Disk Space==
<syntaxhighlight lang="bash">
cat <<'EXE' | sudo bash
sh -c 'du -sh /var/lib/docker/containers/*'
sh -c 'truncate -s 0 /var/lib/docker/containers/*/*-json.log' 2>/dev/null
docker images -f 'dangling=true' -q
docker rmi $(docker images -f 'dangling=true' -q) 2>/dev/null
docker system  prune -f --volumes
docker builder prune -f -a
docker network prune -f
docker volume  prune -f
apt-get clean
apt-get autoclean
apt-get autoremove -y
journalctl --disk-usage
journalctl --vacuum-time=90d
find /tmp -type f -mtime +7
find /tmp -type f -mtime +7 -delete
find /var/log/nginx  -type f -mtime +90
find /var/log/nginx  -type f -mtime +90 -delete
EXE
</syntaxhighlight>


==Playground==
==Playground==
Line 157: Line 186:


| valign="top" |
| valign="top" |
* [https://docs.rackspace.com/docs/copy-files-with-scp-and-rsync Linux » Upload & Synchronize Files]
* [https://docs.rackspace.com/docs/copy-files-with-scp-and-rsync Linux » Copy files with SCP & Rsync]
* [https://creodias.docs.cloudferro.com/en/latest/networking/How-To-Upload-And-Synchronise-Files-With-SCP-RSYNC-Creodias.html Linux » Upload & Synchronize Files]
* [[Fedora/Raspberry Pi]]
* [[Fedora/Raspberry Pi]]


|}
|}

Latest revision as of 15:31, 13 January 2026

Sequential Write

dd if=/dev/zero of=/tmp/tempfile bs=1M count=1024 conv=fdatasync
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.521978 s, 2.1 GB/s
'

Sequential Read » Clean Buffer

echo 'sync;echo 3 >/proc/sys/vm/drop_caches'|sudo bash
dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.978744 s, 1.1 GB/s
'

Sequential Read » Using Buffer

dd if=/tmp/tempfile of=/dev/null bs=1M count=1024
:'
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.151489 s, 7.1 GB/s
'

Benchmark Random Read & Write

iozone -t1 -i0 -i2 -r1k -s1g /tmp
-t  : Number of threads or processes to use in throughput test

-i  : Test to run
      0=write/rewrite    1=read/re-read      2=random-read/write  3=Read-backwards
      4=Re-write-record  5=stride-read       6=fwrite/re-fwrite   7=fread/Re-fread
      8=random_mix       9=pwrite/Re-pwrite 10=pread/Re-pread    11=pwritev/Re-pwritev  12=preadv/Re-preadv

-r  : record size in Kb
      k .. size in kB
      m .. size in MB
      g .. size in GB

-s  : file size in Kb
      k .. size in kB
      m .. size in MB
      g .. size in GB

/tmp: test path

Reclaim Disk Space

cat <<'EXE' | sudo bash
sh -c 'du -sh /var/lib/docker/containers/*'
sh -c 'truncate -s 0 /var/lib/docker/containers/*/*-json.log' 2>/dev/null

docker images -f 'dangling=true' -q
docker rmi $(docker images -f 'dangling=true' -q) 2>/dev/null

docker system  prune -f --volumes
docker builder prune -f -a
docker network prune -f
docker volume  prune -f

apt-get clean
apt-get autoclean
apt-get autoremove -y

journalctl --disk-usage
journalctl --vacuum-time=90d

find /tmp -type f -mtime +7
find /tmp -type f -mtime +7 -delete

find /var/log/nginx  -type f -mtime +90 
find /var/log/nginx  -type f -mtime +90 -delete
EXE

Playground

echo 'sync;echo 3 >/proc/sys/vm/drop_caches && swapoff -a && swapon -a'|sudo bash
free -th
echo 'apt update;apt list --upgradable;apt upgrade'|sudo bash
bottom

docker network prune -f
docker volume  prune -f
docker system  prune -f
docker image ls
cat <<'EXE' | bash
for d in system network volume
do docker ${d} prune -f;done
EXE
cat <<'EXE' | ssh deploy@ci.chorke.org
for d in system network volume
do docker ${d} prune -f;done
EXE

cat <<'EXE' | sudo bash
apt-get update;echo
apt-get install -y iozone3
echo;iozone -v
EXE
lsblk
nvme0n1        259:0    0 953.9G  0 disk  
├─nvme0n1p1    259:1    0     1G  0 part  /boot/efi
├─nvme0n1p2    259:2    0     2G  0 part  /boot
└─nvme0n1p3    259:3    0 950.8G  0 part  /

References