1 |
Am 27.05.2014 15:03, schrieb Stefan G. Weichinger: |
2 |
|
3 |
>> way too slow ... |
4 |
> |
5 |
> I think I have some IO-topic going on ... very likely some mismatch of |
6 |
> block sizes ... |
7 |
> |
8 |
> the hw-raid, then LVM, then the snapshot on top of that ... and a |
9 |
> filesystem with properties as target ... oh my. |
10 |
> |
11 |
> Chosing noop as IO-scheduler helps a bit but maybe I have to roll back |
12 |
> and rebuild one of the HW-RAID-Arrays with a different blocksize. |
13 |
|
14 |
back from short vacation and re-attacking this one ... |
15 |
|
16 |
I am not sure if I set up the HW-RAIDs correctly and want to move data |
17 |
away from the LVM (yes, again) to try to rebuild the array /dev/sdc |
18 |
|
19 |
I have: |
20 |
|
21 |
# lsblk -o NAME,FSTYPE,UUID,SIZE,TYPE,MOUNTPOINT,LABEL,MODEL,PHY-SEC,MIN-IO |
22 |
NAME FSTYPE UUID |
23 |
SIZE TYPE MOUNTPOINT LABEL MODEL PHY-SEC MIN-IO |
24 |
sda btrfs 9133c469-df1e-45f5-a09f-d1b9c75c69da |
25 |
500G disk /mnt/defvol ROOT RAID 5/6 SAS 6G 4096 4096 |
26 |
|
27 |
sdb swap 102d41a8-848d-4525-b39e-d9b543355b71 |
28 |
8G disk [SWAP] SWAP RAID 5/6 SAS 6G 4096 4096 |
29 |
|
30 |
sdc LVM2_member |
31 |
Z2LEVf-ZJch-cqi3-GVob-Jpd2-eweJ-sDtW7H 1,3T disk |
32 |
RAID 5/6 SAS 6G 4096 4096 |
33 |
├─vg01-amhold xfs 96b7395b-6e81-4660-9459-6a7ad83d8861 |
34 |
400G lvm /mnt/amhold AMHOLD 4096 4096 |
35 |
└─vg01-winserver_disk0 |
36 |
244,1G lvm 4096 4096 |
37 |
|
38 |
|
39 |
|
40 |
(sorry for the ugly format ... should I post a URL?) |
41 |
|
42 |
Is the value for PHY-SEC my problem? The 4 MB ... ? |
43 |
|
44 |
- |
45 |
|
46 |
So sdc is a PV in VG vg01 ... which contains a KVM-diskimage |
47 |
|
48 |
/dev/vg01/winserver_disk0 |
49 |
|
50 |
I use the noop scheduler btw ... |
51 |
|
52 |
I try a dd (or ddrescue) from that LV to somewhere else and only get |
53 |
around 1-5 MB/s ... this takes way too long. |
54 |
|
55 |
--- example with external disk as target: |
56 |
|
57 |
ddrescue -v --block-size=4M /dev/vg01/winserver_disk0 |
58 |
/mnt/ext/virt-backup/windows-server/windows-server_vda.img |
59 |
|
60 |
tried local root-fs as target, different block sizes etc. |
61 |
|
62 |
--- |
63 |
|
64 |
The system is an updated and stable gentoo amd64 box -> |
65 |
|
66 |
# emerge --info |
67 |
Portage 2.2.8-r1 (default/linux/amd64/13.0, gcc-4.7.3, glibc-2.17, |
68 |
3.12.21-gentoo-r1 x86_64) |
69 |
================================================================= |
70 |
System uname: |
71 |
Linux-3.12.21-gentoo-r1-x86_64-Intel-R-_Xeon-R-_CPU_E5-2407_0_@_2.20GHz-with-gentoo-2.2 |
72 |
KiB Mem: 16413444 total, 9252100 free |
73 |
KiB Swap: 8388604 total, 8388604 free |
74 |
Timestamp of tree: Tue, 10 Jun 2014 07:30:01 +0000 |
75 |
ld GNU ld (GNU Binutils) 2.23.2 |
76 |
app-shells/bash: 4.2_p45 |
77 |
dev-lang/python: 2.7.6, 3.2.5-r2, 3.3.3 |
78 |
dev-util/cmake: 2.8.11.2 |
79 |
dev-util/pkgconfig: 0.28 |
80 |
sys-apps/baselayout: 2.2 |
81 |
sys-apps/openrc: 0.12.4 |
82 |
sys-apps/sandbox: 2.6-r1 |
83 |
sys-devel/autoconf: 2.69 |
84 |
sys-devel/automake: 1.13.4 |
85 |
sys-devel/binutils: 2.23.2 |
86 |
sys-devel/gcc: 4.7.3-r1 |
87 |
sys-devel/gcc-config: 1.7.3 |
88 |
sys-devel/libtool: 2.4.2 |
89 |
sys-devel/make: 3.82-r4 |
90 |
sys-kernel/linux-headers: 3.13 (virtual/os-headers) |
91 |
sys-libs/glibc: 2.17 |
92 |
Repositories: gentoo hiro-oops-intern |
93 |
ACCEPT_KEYWORDS="amd64" |
94 |
ACCEPT_LICENSE="* -@EULA" |
95 |
CBUILD="x86_64-pc-linux-gnu" |
96 |
CFLAGS="-march=corei7-avx -O2 -pipe" |
97 |
CHOST="x86_64-pc-linux-gnu" |
98 |
CONFIG_PROTECT="/etc /usr/share/gnupg/qualified.txt" |
99 |
CONFIG_PROTECT_MASK="/etc/ca-certificates.conf /etc/env.d /etc/gconf |
100 |
/etc/gentoo-release /etc/revdep-rebuild /etc/sandbox.d /etc/terminfo" |
101 |
CXXFLAGS="-march=corei7-avx -O2 -pipe" |
102 |
DISTDIR="/usr/portage/distfiles" |
103 |
FCFLAGS="-O2 -pipe" |
104 |
FEATURES="assume-digests binpkg-logs config-protect-if-modified |
105 |
distlocks ebuild-locks fixlafiles merge-sync news notitles |
106 |
parallel-fetch preserve-libs protect-owned sandbox sfperms strict |
107 |
unknown-features-warn unmerge-logs unmerge-orphans userfetch userpriv |
108 |
usersandbox usersync" |
109 |
FFLAGS="-O2 -pipe" |
110 |
GENTOO_MIRRORS="http://distfiles.gentoo.org" |
111 |
LANG="de_DE.UTF-8" |
112 |
LDFLAGS="-Wl,-O1 -Wl,--as-needed" |
113 |
MAKEOPTS="-j5" |
114 |
PKGDIR="/var/portage/packages" |
115 |
PORTAGE_CONFIGROOT="/" |
116 |
PORTAGE_RSYNC_OPTS="--recursive --links --safe-links --perms --times |
117 |
--omit-dir-times --compress --force --whole-file --delete --stats |
118 |
--human-readable --timeout=180 --exclude=/distfiles --exclude=/local |
119 |
--exclude=/packages" |
120 |
PORTAGE_TMPDIR="/var/tmp" |
121 |
PORTDIR="/usr/portage" |
122 |
PORTDIR_OVERLAY="/usr/local/portage" |
123 |
SYNC="rsync://172.32.99.6/gentoo-portage" |
124 |
USE="acl amd64 berkdb bzip2 cli cracklib crypt cxx dri fortran gdbm |
125 |
iconv ipv6 mmx modules multilib ncurses nls nptl openmp pam pcre |
126 |
readline session sse sse2 ssl systemd tcpd udev unicode zlib" |
127 |
ABI_X86="64" ALSA_CARDS="ali5451 als4000 atiixp atiixp-modem bt87x |
128 |
ca0106 cmipci emu10k1x ens1370 ens1371 es1938 es1968 fm801 hda-intel |
129 |
intel8x0 intel8x0m maestro3 trident usb-audio via82xx via82xx-modem |
130 |
ymfpci" APACHE2_MODULES="alias cgi headers filter deflate perl" |
131 |
CALLIGRA_FEATURES="kexi words flow plan sheets stage tables krita karbon |
132 |
braindump author" CAMERAS="ptp2" COLLECTD_PLUGINS="df interface irq load |
133 |
memory rrdtool swap syslog" CURL_SSL="openssl" |
134 |
DRACUT_MODULES="biosdevname btrfs caps lvm mdraid" ELIBC="glibc" |
135 |
GPSD_PROTOCOLS="ashtech aivdm earthmate evermore fv18 garmin garmintxt |
136 |
gpsclock itrax mtk3301 nmea ntrip navcom oceanserver oldstyle oncore |
137 |
rtcm104v2 rtcm104v3 sirf superstar2 timing tsip tripmate tnt ublox ubx" |
138 |
INPUT_DEVICES="keyboard mouse evdev" KERNEL="linux" LCD_DEVICES="bayrad |
139 |
cfontz cfontz633 glk hd44780 lb216 lcdm001 mtxorb ncurses text" |
140 |
LIBREOFFICE_EXTENSIONS="presenter-console presenter-minimizer" |
141 |
OFFICE_IMPLEMENTATION="libreoffice" PHP_TARGETS="php5-5" |
142 |
PYTHON_SINGLE_TARGET="python2_7" PYTHON_TARGETS="python2_7 python3_3" |
143 |
RUBY_TARGETS="ruby19 ruby20" USERLAND="GNU" VIDEO_CARDS="fbdev glint |
144 |
intel mach64 mga nouveau nv r128 radeon savage sis tdfx trident vesa via |
145 |
vmware dummy v4l" XTABLES_ADDONS="quota2 psd pknock lscan length2 |
146 |
ipv4options ipset ipp2p iface geoip fuzzy condition tee tarpit sysrq |
147 |
steal rawnat logmark ipmark dhcpmac delude chaos account" |
148 |
Unset: CPPFLAGS, CTARGET, EMERGE_DEFAULT_OPTS, INSTALL_MASK, LC_ALL, |
149 |
PORTAGE_BUNZIP2_COMMAND, PORTAGE_COMPRESS, PORTAGE_COMPRESS_FLAGS, |
150 |
PORTAGE_RSYNC_EXTRA_OPTS, USE_PYTHON |
151 |
|
152 |
|
153 |
|
154 |
Taking the hardware it should be much much faster, right? |
155 |
|
156 |
I would appreciate some hints to debug this. |
157 |
|
158 |
Maybe I have to remove the OS and the VM again and rebuild the RAIDs |
159 |
from scratch ... |
160 |
|
161 |
|
162 |
thanks, Stefan |