Skip to content

doc2.md

Latest commit

 

History

History
500 lines (376 loc) · 15.6 KB

doc2.md

File metadata and controls

500 lines (376 loc) · 15.6 KB
Raw

01.04.2022.

RAID polja i file sistemi

Dodali smo nekoliko diskova u VM, velićine 1GB.

korisnik@ODJ-O365-118:~$ ssh fidit@192.168.122.152
fidit@192.168.122.152's password: 
Last login: Fri Apr  1 12:18:14 2022
[fidit@archlinux ~]$ ls /dev/vd*
/dev/vda   /dev/vda2  /dev/vdc  /dev/vde
/dev/vda1  /dev/vdb   /dev/vdd  /dev/vdf

'vda' 'vdb'... su diskovi

'sudo fdisk -l' za detaljniji pregled diskova.

[fidit@archlinux ~]$ sudo fdisk -l
Disk /dev/vda: 12 GiB, 12884901888 bytes, 25165824 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: gpt
Disk identifier: 902FD2FE-154A-4635-9BF8-3FAB93BA67FC

Device     Start      End  Sectors Size Type
/dev/vda1   2048     4095     2048   1M BIOS boot
/dev/vda2   4096 25165790 25161695  12G Linux filesystem


Disk /dev/vdb: 1 GiB, 1073741824 bytes, 2097152 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
(...)

sudo pacman -Syu za full nadogradnju VM-a. Onda rebootamo da dobijemo novu verziju jezgre (linux 5.17) i systemd-a.

ZFS

Sun Microsystemsov file system i upravitelj volumena, često se koristi na Linux serverima. Nije dio jezgre Linuxa.

Za instalaciju paketa potrebno ih je samostalno kompajlirati (nalaze se na AUR - Arch User Repository).

Hardened linux predviđa sigurnosne probleme koji bi mogli nastat i ograničava ponašanje aplikacija i OSa, Zen Linux kernel je optimiziran za igre i multimediju.

Verziju kernela pronalazimo sa uname -a.

[fidit@archlinux ~]$ uname -a
Linux archlinux 5.17.1-arch1-1 #1 SMP PREEMPT Mon, 28 Mar 2022 20:55:33 +0000 x86_64 GNU/Linux

https://aur.archlinux.org/packages/zfs-dkms

provjeri sto tocno je dkms To je upravitelj dodataka za linux.

Kliknemo na view PKGBUILD. To je skripta koju skinemo i pokrenemo.

Stvaramo datoteku 'PKGBUILD' i skriptu zaljepimo u to.

[fidit@archlinux ~]$ makepkg
==> ERROR: Cannot find the fakeroot binary.

Trebamo instalirat fakeroot.

[fidit@archlinux ~]$ sudo pacman -S fakeroot
resolving dependencies...
looking for conflicting packages...

Packages (1) fakeroot-1.28-1

Total Download Size:   0.07 MiB
==> ERROR: 0001-only-build-the-module-in-dkms.conf.patch was not found in the build directory and is not a URL.

Fali nam taj file. U sources nađemo taj file na web stranici (iznad) i skinemo ga. Kliknemo na plain da dobijemo plain file. Link iskoristimo da ga skinemo:

[fidit@archlinux ~]$ curl -o 0001-only-build-the-module-in-dkms.conf.patch "https://aur.archlinux.org/cgit/aur.git/plain/0001-only-build-the-module-in-dkms.conf.patch?h=zfs-dkms"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1112  100  1112    0     0   5082      0 --:--:-- --:--:-- --:--:--  5100
(...)
==> Verifying source file signatures with gpg...
    zfs-2.1.4.tar.gz ... FAILED (unknown public key 6AD860EED4598027)
==> ERROR: One or more PGP signatures could not be verified!

Fale nam PGP signaturesi.

[fidit@archlinux ~]$ pacman-key --list-sigs | grep 6AD860EED4598027
gpg: Note: trustdb not writable

Možemo dodati svoje ključeve, ali moramo bit root korisnik.

[fidit@archlinux ~]$ sudo pacman-key --recv-keys 6AD860EED4598027
gpg: key 6AD860EED4598027: public key "Tony Hutter (GPG key for signing ZFS releases) <hutter2@llnl.gov>" imported
gpg: marginals needed: 3  completes needed: 1  trust model: pgp
gpg: depth: 0  valid:   1  signed:   6  trust: 0-, 0q, 0n, 0m, 0f, 1u
gpg: depth: 1  valid:   6  signed:  94  trust: 0-, 0q, 0n, 6m, 0f, 0u
gpg: depth: 2  valid:  88  signed:  32  trust: 88-, 0q, 0n, 0m, 0f, 0u
gpg: next trustdb check due at 2022-05-06
gpg: Total number processed: 1
gpg:               imported: 1

To jos uvjek ne radi pa je bolje sa gpg samo za svog korisnika dodat key i onda ce radit.

[fidit@archlinux ~]$ gpg --recv-keys 6AD860EED4598027
gpg: /home/fidit/.gnupg/trustdb.gpg: trustdb created
gpg: key 6AD860EED4598027: public key "Tony Hutter (GPG key for signing ZFS releases) <hutter2@llnl.gov>" imported
gpg: Total number processed: 1
gpg:               imported: 1

Moramo instalirati i patch.

[fidit@archlinux ~]$ sudo pacman -S patch

Moramo instalirati i autoconf i automake (to nam fali jer install jos uvijek nece delat). Isto moramo i dkms.

Onda pokrenemo makepkg da buildamo.

[fidit@archlinux ~]$ makepkg
==> Making package: zfs-dkms 2.1.4-1 (Fri 01 Apr 2022 01:04:12 PM UTC)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> Retrieving sources...
  -> Found zfs-2.1.4.tar.gz
  -> Found zfs-2.1.4.tar.gz.asc
  -> Found 0001-only-build-the-module-in-dkms.conf.patch
==> Validating source files with sha256sums...
    zfs-2.1.4.tar.gz ... Passed
    zfs-2.1.4.tar.gz.asc ... Skipped
    0001-only-build-the-module-in-dkms.conf.patch ... Passed
==> Validating source files with b2sums...
    zfs-2.1.4.tar.gz ... Passed
    zfs-2.1.4.tar.gz.asc ... Skipped
    0001-only-build-the-module-in-dkms.conf.patch ... Passed
==> Verifying source file signatures with gpg...
    zfs-2.1.4.tar.gz ... Passed
==> Extracting sources...
  -> Extracting zfs-2.1.4.tar.gz with bsdtar
==> Starting prepare()...
patching file scripts/dkms.mkconf
configure.ac: warning: AM_GNU_GETTEXT is used, but not AM_GNU_GETTEXT_VERSION or AM_GNU_GETTEXT_REQUIRE_VERSION
libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, 'config'.
libtoolize: copying file 'config/ltmain.sh'
libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'config'.
libtoolize: copying file 'config/libtool.m4'
libtoolize: copying file 'config/ltoptions.m4'
libtoolize: copying file 'config/ltsugar.m4'
libtoolize: copying file 'config/ltversion.m4'
libtoolize: copying file 'config/lt~obsolete.m4'
configure.ac:48: installing 'config/compile'
configure.ac:42: installing 'config/missing'
==> Starting build()...
==> Entering fakeroot environment...
==> Starting package()...
==> Tidying install...
  -> Removing libtool files...
  -> Purging unwanted files...
  -> Removing static library files...
  -> Stripping unneeded symbols from binaries and libraries...
  -> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "zfs-dkms"...
  -> Generating .PKGINFO file...
  -> Generating .BUILDINFO file...
  -> Generating .MTREE file...
  -> Compressing package...
==> Leaving fakeroot environment.
==> Finished making: zfs-dkms 2.1.4-1 (Fri 01 Apr 2022 01:04:32 PM UTC)

zfs-dkms-2.1.4-1-any.pkg.tar.zst je kernel modul kojeg smo izgradili u obliku paketa za pacman.

[fidit@archlinux ~]$ sudo pacman -U zfs-dkms-2.1.4-1-any.pkg.tar.zst 
loading packages...
resolving dependencies...
warning: cannot resolve "zfs-utils=2.1.4", a dependency of "zfs-dkms"
:: The following package cannot be upgraded due to unresolvable dependencies:
      zfs-dkms

:: Do you want to skip the above package for this upgrade? [y/N] n
error: failed to prepare transaction (could not satisfy dependencies)
:: unable to satisfy dependency 'zfs-utils=2.1.4' required by zfs-dkms

Fale nam zfs-utils. To mozemo sami compileat. https://aur.archlinux.org/packages/zfs-utils



    https://github.com/zfsonlinux/zfs/releases/download/zfs-2.1.4/zfs-2.1.4.tar.gz
    https://github.com/zfsonlinux/zfs/releases/download/zfs-2.1.4/zfs-2.1.4.tar.gz.asc
    zfs.initcpio.hook
    zfs.initcpio.install

Prva dva vec imamo, druga dva moramo preuzeti.

[fidit@archlinux ~]$ curl -o zfs.initcpio.hook "https://aur.archlinux.org/cgit/aur.git/plain/zfs.initcpio.hook?h=zfs-utils"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  3620  100  3620    0     0  16028      0 --:--:-- --:--:-- --:--:-- 16088
[fidit@archlinux ~]$ curl -o zfs.initcpio.install "https://aur.archlinux.org/cgit/aur.git/plain/zfs.initcpio.install?h=zfs-utils"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  2301  100  2301    0     0  11099      0 --:--:-- --:--:-- --:--:-- 11115

Skinemo i PKGBUILD za zfs utils i nazovemo ga drugacije (inace to ne radimo ali mozemo ovdje iznimno).

pkgbuild -p (ili c, ne znam) PKGBUILD-utils

Kad je kompajlanje gotovo:

[fidit@archlinux ~]$ sudo pacman -U zfs-dkms-2.1.4-1-any.pkg.tar.zst zfs-utils-2.1.4-1-x86_64.pkg.tar.zst 
loading packages...
resolving dependencies...

Za upravljanje ZFS volumenima su zfs i zfs pool.

[fidit@archlinux ~]$ sudo modprobe zfs
modprobe: FATAL: Module zfs not found in directory /lib/modules/5.17.1-arch1-1

ZFS nam trenutno ne radi, moramo imat instalirane linux headers. (https://wiki.archlinux.org/title/Dynamic_Kernel_Module_Support)

[fidit@archlinux ~]$ sudo pacman -S linux-headers

Trebamo pricekat dulje jer ponovo kompajlira zfs da ispravi mane koje su nastale kad smo ga instalirali bez headera.

Da bi radili sa zfsom, prvo ga moramo ucitati:

[fidit@archlinux ~]$ sudo modprobe zfs

zpool niski nivo, zfs visoki nivo

[fidit@archlinux ~]$ sudo fdisk /dev/vde

Welcome to fdisk (util-linux 2.38).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.

Device does not contain a recognized partition table.
Created a new DOS disklabel with disk identifier 0x5a6de21c.

Command (m for help): g
Created a new GPT disklabel (GUID: D7631690-4538-384F-87C7-4D057B0E55F1).

Command (m for help): n
Partition number (1-128, default 1): 
First sector (2048-2097118, default 2048): 
Last sector, +/-sectors or +/-size{K,M,G,T,P} (2048-2097118, default 2095103): 

Created a new partition 1 of type 'Linux filesystem' and of size 1022 MiB.

Command (m for help): T
T: unknown command

Command (m for help): t

Selected partition 1
Partition type or alias (type L to list all): L
  1 EFI System                     C12A7328-F81F-11D2-BA4B-00A0C93EC93B
  2 MBR partition scheme           024DEE41-33E7-11D3-9D69-0008C781F39F
  3 Intel Fast Flash               D3BFE2DE-3DAF-11DF-BA40-E3A556D89593
(...)
156 Solaris root                   6A85CF4D-1DD2-11B2-99A6-080020736631
157 Solaris /usr & Apple ZFS       6A898CC3-1DD2-11B2-99A6-080020736631
158 Solaris swap                   6A87C46F-1DD2-11B2-99A6-080020736631
159 Solaris backup                 6A8B642B-1DD2-11B2-99A6-080020736631

sa q izlazimo iz liste

Partition type or alias (type L to list all): 157
Changed type of partition 'Linux filesystem' to 'Solaris /usr & Apple ZFS'.

onda napisemo w da zapise

mozemo d da izbrisemo sve sa diska

Napravimo zpool:

[fidit@archlinux ~]$ sudo zpool create mojbazen /dev/vdb1
[fidit@archlinux ~]$ zpool list
NAME       SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
mojbazen   960M   120K   960M        -         -     0%     0%  1.00x    ONLINE  -

Za brisanje poola:

[fidit@archlinux ~]$ sudo zpool destroy mojbazen
[fidit@archlinux ~]$ zpool list
no pools available

Mirroranje:

[fidit@archlinux ~]$ sudo zpool create -m /mojbazen mojbazen mirror /dev/vdb1 /dev/vdc1
[fidit@archlinux ~]$ zpool list
NAME       SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
mojbazen   960M   120K   960M        -         -     0%     0%  1.00x    ONLINE  -
[fidit@archlinux ~]$ ls /mojbazen
[fidit@archlinux ~]$ mount | grep baz
mojbazen on /mojbazen type zfs (rw,xattr,noacl)

Dodavanje datoteka:

[fidit@archlinux ~]$ cd /mojbazen/
[fidit@archlinux mojbazen]$ sudo mkdir mojdirektorij
[fidit@archlinux mojbazen]$ sudo touch mojadatoteka
[fidit@archlinux mojbazen]$ ls .la
ls: cannot access '.la': No such file or directory
[fidit@archlinux mojbazen]$ ls -la
total 18
drwxr-xr-x 3 root root   4 Apr  1 14:17 .
drwxr-xr-x 1 root root 146 Apr  1 14:15 ..
-rw-r--r-- 1 root root   0 Apr  1 14:17 mojadatoteka
drwxr-xr-x 2 root root   2 Apr  1 14:17 mojdirektorij
[fidit@archlinux mojbazen]$ sudo chown fidit:fidit mojadatoteka

Detachanje diska iz poola:

[fidit@archlinux mojbazen]$ zpool status
  pool: mojbazen
 state: ONLINE
config:

	NAME        STATE     READ WRITE CKSUM
	mojbazen    ONLINE       0     0     0
	  mirror-0  ONLINE       0     0     0
	    vdb1    ONLINE       0     0     0
	    vdc1    ONLINE       0     0     0

errors: No known data errors
[fidit@archlinux mojbazen]$ sudo zpool detach mojbazen vdb1
[fidit@archlinux mojbazen]$ zpool status
  pool: mojbazen
 state: ONLINE
config:

	NAME        STATE     READ WRITE CKSUM
	mojbazen    ONLINE       0     0     0
	  vdc1      ONLINE       0     0     0

errors: No known data errors

RAID 0:

[fidit@archlinux mojbazen]$ sudo zpool add mojbazen /dev/vdb1
[fidit@archlinux mojbazen]$ sudo zpool add mojbazen /dev/vde1
[fidit@archlinux mojbazen]$ zpool status
  pool: mojbazen
 state: ONLINE
config:

	NAME        STATE     READ WRITE CKSUM
	mojbazen    ONLINE       0     0     0
	  vdc1      ONLINE       0     0     0
	  vdd1      ONLINE       0     0     0
	  vdb1      ONLINE       0     0     0
	  vde1      ONLINE       0     0     0

errors: No known data errors

[fidit@archlinux mojbazen]$ df -h
Filesystem      Size  Used Avail Use% Mounted on
(...)
mojbazen        3.7G  128K  3.7G   1% /mojbazen

U RAIDu 0 mojbazen sada ima 3.7GB prostora.

RAID Z:

[fidit@archlinux ~]$ sudo zpool create -m /mojbazen mojbazen raidz /dev/vdb1 /dev/vdc1 /dev/vdd1 /dev/vde1
[fidit@archlinux ~]$ zpool status
  pool: mojbazen
 state: ONLINE
config:

	NAME        STATE     READ WRITE CKSUM
	mojbazen    ONLINE       0     0     0
	  raidz1-0  ONLINE       0     0     0
	    vdb1    ONLINE       0     0     0
	    vdc1    ONLINE       0     0     0
	    vdd1    ONLINE       0     0     0
	    vde1    ONLINE       0     0     0

errors: No known data errors

Sa attach dodajemo driveove u RAID mirror.

sudo zpool attach mojbazen /dev/vdc1 /dev/vdd1

Prvo odredimo jedan disk u poolu, onda odredimo kojeg diska dodajemo u pool.

Postavljanje i dobivanje vrijednosti:

[fidit@archlinux ~]$ zfs get compression
NAME      PROPERTY     VALUE           SOURCE
mojbazen  compression  off             default
[fidit@archlinux ~]$ zfs get compressratio
NAME      PROPERTY       VALUE  SOURCE
mojbazen  compressratio  1.00x  -
[fidit@archlinux ~]$ sudo zfs set compression=zstd mojbazen
[fidit@archlinux ~]$ zfs get compression
NAME      PROPERTY     VALUE           SOURCE
mojbazen  compression  zstd            local

Resilvering - ZFS cita sve podatke sa svih uredaja i uvjerava se da se oni mogu ispravno procitati.

[fidit@archlinux ~]$ sudo zpool resilver mojbazen
[fidit@archlinux ~]$ sudo zpool scrub mojbazen

Resilver je selektivan, scrub je temeljit.

Kolokvij

miletic.net/urs1.pdf

5 - VM kad nam treba okolina i kad ne deployamo nesto sto je inace u docker containerima.

6 - hardver, storage, mrezna oprema, softver za upravljanje oblakom(npr kreiranje VMa, kao na aws gdje korisnici imaju svoje sucelje i rade vm od doma)

8 - infrastruktura kao usluga (kad unajmimo VM negdje), platforma kao usluga (heroku)

9 - user, grupa, ostali

10 - "od pokretanja servisa jedan sat. ako se restarta, timer ide ispocetka"

11 - korisnik 0 je root, ovi moduli ispod su biblioteke koje program koristi

12 - ne, pise unmanaged. onda time upravlja network manager (to mi ne znamo iz slike ali samo FYI)