1 |
On Wed, Feb 2, 2022 at 7:37 AM Andreas K. Huettel <dilfridge@g.o> wrote: |
2 |
> |
3 |
> > We are relatively sure about the Networking portion, so I'll present |
4 |
> > that first. This is the most flexible option we put together, without |
5 |
> > spending a lot more money for 100Gbit networking options (which are |
6 |
> > probably overkill). |
7 |
> > |
8 |
> > Networking Total: $4159-$4559 USD plus taxes & shipping |
9 |
> > |
10 |
> > 1x FS.com S5860-20SQ (high-speed systems) - $1600 USD |
11 |
> > 1x FS.com S3910-24TF (OOB/IPMI/embedded/non-10G systems) - $369 USD ** |
12 |
> > Nx DAC/optics/cables - up to $1690 USD |
13 |
> > Nx optical cables - up to $500 USD |
14 |
> > |
15 |
> > We also discussed if we might end up with a lot of 1G systems connected |
16 |
> > to the 2nd switch, and if it should have a 10Gbit uplink to the other |
17 |
> > switch. I think this is a GOOD idea and we should go ahead with it. In |
18 |
> > which case there is a slightly fancier model: |
19 |
> > 1x FS.com S3910-24TS (OOB/IPMI/embedded/non-10G systems), adds 10G uplink - $769 USD |
20 |
> > |
21 |
> > DAC/optics/cables: these are the direct-attach fancy cables or fiber |
22 |
> > optic transceivers along with cables. We need at most 26x pieces |
23 |
> > (probably much less), and the most expensive variants are $65/ea for |
24 |
> > transceiver + cable. |
25 |
> > |
26 |
> > Links for the hardware: |
27 |
> > S5860-20SQ https://www.fs.com/products/108710.html |
28 |
> > S3910-24TF https://www.fs.com/products/115382.html |
29 |
> > S3910-24TS https://www.fs.com/products/108712.html |
30 |
> |
31 |
> You're essentially writing what you want, but not why you need it. :) |
32 |
> |
33 |
> (And no, "we must spend money" is not a good reason.) |
34 |
> |
35 |
> Care to explain a bit please what the needs and criteria are? I mean, |
36 |
> if this were a grant proposal it would be shot down immediately. |
37 |
|
38 |
Briefly on needs, |
39 |
|
40 |
Our existing switch is a loaner from OSUOSL. |
41 |
Our existing switch does not support network technologies we would |
42 |
likely need when purchasing new server hardware, specifically SFP |
43 |
connections and 10-25gbps connectivity. |
44 |
The connectivity is needed for IO that we use to provide virtualized |
45 |
environments for the community (basically we replicate disks between |
46 |
physical hosts to enable failover.) |
47 |
|
48 |
The SFP technology is backwards compatible with converters (to convert |
49 |
from SFP to ethernet / RJ45 tech), but the converters are a bit |
50 |
expensive; so it's likely cheaper to buy two switches. |
51 |
The expensive switch (supports SFP28, 25gpbs, newer tech stack) will |
52 |
be available for modern hardware. |
53 |
The cheaper switch (supports ethernet / RJ45) is for ethernet enabled |
54 |
machines and management ports (OOB, IPMI) |
55 |
|
56 |
For connectors we will likely need at least 5 SFP cables (2 to connect |
57 |
the 2 VM hosts together to form a 50gbps bonded link, 2 to connect the |
58 |
VM hosts to the switch, and 1 uplink from the switch to the OSL.) |
59 |
We then need: an DAC, to connect the cheaper switch to the faster |
60 |
switch. We will likely order some spares just to have on hand. |
61 |
We can re-use the rest of our existing cabling; basically just moving |
62 |
the ethernet hosts from the loaner switch to the cheap switch; it |
63 |
should be all RJ45. |
64 |
|
65 |
-A |
66 |
|
67 |
> |
68 |
> Cheers, |
69 |
> Andreas |
70 |
> |
71 |
> -- |
72 |
> Andreas K. Hüttel |
73 |
> dilfridge@g.o |
74 |
> Gentoo Linux developer |
75 |
> (council, toolchain, base-system, perl, libreoffice) |