Difference between revisions of "Hall Network Specifications"

Revision as of 16:20, 14 October 2013

Below we propose a design for fiber connections between the Rack Room and the Hall, and network switch and terminal server placement.

Elliott Wolin, Mark Dalton

14-Oct-2013

Notes

Based on 10**8 photons/sec, 200 kHz trigger rate, existing L1 rejection algorithm, block=1 mode, no compression.
Ethernet port counts from Fernando's rack layouts and information from Dave Butler concerning other controls requirements.
We own about 15 24-port managed switches with 10 GBit/s fiber uplinks, some being used in EEL building and other places.
Switches can uplink 1.25 GBytes/sec.
8-port managed switches with 1 GBit/s fiber uplinks exist.
Only managed switches (no hubs!) allowed in hall.
Fibers come in bundles of 12 or 24, 2 fibers needed for one uplink.
Standard JLab practice is to terminate all fibers in patch panel when bundles installed.
Bundle/patch panel installation is expensive, can run much cheaper patch fibers from switch in one rack area to patch panel in nearby rack area.
DAQ crates require two Ethernet connections each, one for the ROC and one for the fan tray.
Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser).
ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection.
Each terminal server has 32 ports.
Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area.
Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec.

Finally

No multi-mode fibers are included below, let us know if you need them run anywhere.

Hall D Fiber Requirements and Specifications for 10**8 photons/sec
Rack	DAQ Connections	Controls Connections	TS Connections	Max Single ROC Bandwidth	Total Uplink Bandwidth	Fiber Bundle	Switches	Terminal Servers	Possible ROC Fiber Uplinks	Comment
T1	6	12	6	<80 MB/s	151 MB/s	12 strand	1	1	0
U1A	0	7	1	0	low	none	1	0	0	Fiber patch to U1B, TS patch to U1B
U1B	5	8	5	<50 MB/s	93 MB/s	12 strand	1	1	0	Fiber uplinks from U1A, U1C, UN1
U1C	2	3	2	low	low	none	1	0	0	Fiber patch to U1B, TS patch to U1B
U1D	0	1	0	0	0	none	0	0	0	Copper Ethernet patch to U1C
N1	8	13	8	< 80 MB/s	450 MB/s	12 strand	1	1	0
S1	8	13	8	< 80 MB/s	450 MB/s	12 strand	1	1	0
US1	0	0	0	0	0	none	0	0	0	Not sure what's going on here
U2A	9	12	9	100 MB/s	770 MB/s	12 strand	1	1	5	2 fiber patches to D2A if needed
U2B	9	12	9	136 MB/s	916 MB/s	12 strand	1	1	5	2 fiber patches to D2B if needed
D2A	9	19	10	< 80 MB/s	370 MB/s	12 strand	2	1	0	includes 2 gas shed connections
D2B	6	7	6	< 80 Mb/s	300 MB/s	12 strand	1	1	0
UN1	0	20	0	0	low	none	1	0	0	Fiber patch to U1B

Summary

Install 8 x 12 = 96 fiber strands, not including any multi-mode fibers needed.
Install 12 switches total.
Install 8 terminal servers.
10 ROC's may need fiber uplink at 10**8 photons/sec, none needed at 5 10**7 photons/sec.
Inexpensive fiber patch cables used to minimize number of fiber bundles needed.
Inexpensive RS232 patch cables used to minimize number of terminal servers needed.
Important: these recommendations do not follow Fernando's note exactly!

@@ Line 18: / Line 18: @@
 * Some ROC's are only used for control, not DAQ (e.g. BCAL LED Pulser).
 * ROC's each need an RS232 connection to a terminal server, terminal servers require an Ethernet connection.
-* Each terminal server has xxx ports.
+* Each terminal server has 32 ports.
 * Can run copper RS232 patch cable from one rack area to terminal server in nearby rack area.
 * Will eventually need direct fiber link to ROC if max bandwidth > 80 MB/s, assuming 10**8 photons/sec.