BelWü 2016+ NETARCH #3 13.11.2014 Copenhagen, Denmark Tim Kleefass kleefass@belwue.de 1
Baden-Württemberg Extended LAN Academic Network of the Federal State of Baden-Württemberg, Germany We are connecting: 9 Universities 47 Universities for applied sciences, etc. Numerous schools, libraries, student dormitories and other institutes And offering services (mostly for Schools): Webhosting (e.g. Moodle e-learning) and youth protection HTTP proxy E-Mail, SPAM detection Network services (DNS, NTP,...) 2 2
A short history 1987 BelWü was founded First bridged network, later routed, partially IP over X.25 1989 All (BaWü) Universities are connected to BelWü 1994 Full mesh of all Universities with 2-34 Mbit/s 1998 Upgrade to Cisco 7500 and 155 Mbit/s ATM links 2001 Upgrade to Gbit/s-Network with Cisco 12410/GSR SRP/DPT rings with 2.4 Gbit/s and 622 Mbit/s 2006 First 10Gbit/s link 2010 Upgrade to 100Gbit/s-ready-Network with Cisco ASR 9000, own (passive) DWDM and (multiple) 10Gbit/s Ethernet links 2013 June: First 100Gbit/s link 2014 100Gbit/s at each University PoPs 3 3
Current BelWü Network 4
Leitungen BelWü (Fiber) Footprint 42 Leitungslänge in km (ca.) 70 94 Kehl 30 Offenburg Freiburg Lörrach 96 58 (C) BelWü-Koordination (Universität Stuttgart), www.belwue.de (Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.) 10GE Bandbreite optisches Fenster existierende DF Bandbreite 26 Gengenbach 42 25 Rastatt 65 112 76 (~280?) 110? 49 Baden-Baden Freudenstadt Furtwangen V-S 35 23 Pforzheim Horb Frankfurt Mannheim Heidelberg Karlsruhe Trossingen 20 Tuttlingen 40 45 Standorte mit Universität Hochschule Anderer 68 Stuttgart Böblingen Tübingen Rottenburg 100 60 15 50 60 33 Mosbach 28 50 40 60 Albstadt Heilbronn Ludwigsburg PH Konstanz FA Hohenheim Nürtingen Reutlingen Sigmaringen 90 51 Esslingen 50 (~250?) 33 Schw. Gmünd Göppingen Geislingen 100 Künzelsau Schw. Hall 34 Biberach Weingarten 25 Ravensburg Friedrichshafen Stand 12/2012 Ulm Aalen 51 Heidenheim BelWü-Koordination Universität Stuttgart http://www.belwue.de Tue Apr 15 2014 Backbone through Baden-Württemberg > 3.000 km fiber & 10GigE bandwidth 50 POPs, 50 optical amplifiers (spans shorter than 100/120km) p2p lambdas: >80 * 10G & 10 * 100G (lambdas hop-to-hop only) 60/170 * 10GE 260/650 * GE 140 * FE - customer/all IP ports 2 * 100GE - Layer 2 ~200 backbone router 40 * ASR 9000 (, ) 23 * ASR 1000 Cat 6509, Cisco 2821, 2921, 3925 ~2.500 others like Cisco 8xx DSL/ 5 5
BelWü optical and IP Network 2014 On fibers: Static DWDM filter w/ 4-8 Channels and EDFA Colored 10GigE DWDM transceiver (Menara w/ FEC) in IP Router (ASR 9000) Parallel: Ekinops/Opelian 10x10G to 100G Mux Hop-to-hop, no long-run wavelengths Today: Fiber on main paths Redundancy via rented 10GigE bandwidths Target Q2/2016: Continous & redundant fiber-only network 6
(Big) Campus - today Nicht eingezeichnet: Dispersionskompensation 7
BelWü-NeIF 10G bandwidths Paralell to IP Network 10G bandwidths with 10x10G to 100G Mux & 10G matrix Not redundant Backbone capacity Projects Campus-Campus Links (Possible 100G backbone links for IP Routers) Test for bandwidths demand? 8
Netztopologie FA Filmakademie diverse Peerings 100GE DWDM RLP-Net 100G Router (Name und Cisco Modell) aal KIT Campus Nord KIT LSDF URZ LSDF NeIF NeIF NeIF NeIF NeIF NeIF NeIF NeIF NeIF NeIF NeIF Stuttgart Frankfurt DE-CIX Telia manschl-1 Cogent mos 1001 Mannheim Heidelberg Karlsruhe KIT DFN DFN karrz-1 karbib-1 Uni Hoh stual30-1 stunwz-1 ulmn25-1 ulmn26-1 Ulm hlb fradecix-1 kue aal hdh sgd ess nue reu SWITCH fdh rav wei sig alb bib konbib-1 konrz-1 hdl2 1001 shl 1001 rot 1001 loe 1001 tuewae-1 tuemor-1 frbrz-1 frbkg-1 tut tro vil fuw hor ofg keh OSIRIS pfo goe gei boe fds Freiburg Konstanz Tübingen Hohenheim S-IX bad 1001 ras 1001 Mosbach Heilbronn Künzelsau Schw. Hall Schw. Gmünd Aalen Heidenheim Ludwigsburg lbg-fa 1001 FA PH Pforzheim Esslingen Göppingen Nürtingen Geislingen Reutlingen Albstadt Sigmaringen Böblingen Horb Rottenburg Freudenstadt Kehl Straßburg Offenburg Villingen - Schwenningen Furtwangen Tuttlingen Trossingen Kreuzlingen Friedrichshafen Ravensburg Weingarten Biberach Rastatt Baden- Baden diverse Peerings diverse Peerings MANDA RLP-Net Uni Hdl Uni Man Uni Stu Uni Ulm Uni Tue Uni Kon Uni Frb lbgph-1 HS Ess Level3 hdlrz-1 manrz-1 Ein Glasfaserpaar 9
BelWü Services Services: IPv4, IPv6 Firewalling (up to 1G, smaller Universities) Layer 2 VPNs/Bandwidths 1/10G Ethernet over MPLS (via IP/MPLS Router) 10/100G Wavelengths (via DWDM; only few Hops) 10G Bandwidths (10x10G to 100G Mux, BelWü-NeIF) With very different requirements... And of course a lot of Network related Servies... 10
Outlook BelWü 2016+ Ausblick 2014-2016+ 11
Leitungen BelWü (Fiber) Footprint 2016??? Plan 2016+? Frankfurt 112 110? Mannheim 23 76 Heidelberg Mosbach Künzelsau 33 42 Leitungslänge in km (ca.) 25 Karlsruhe Heilbronn Schw. Hall 70 94 Kehl 30 Offenburg Freiburg Lörrach 96 58 26 Gengenbach 42 Rastatt 65 49 Baden-Baden Freudenstadt Furtwangen V-S 35 Pforzheim Horb Trossingen 20 Tuttlingen 40 68 Stuttgart Böblingen 45 Tübingen Rottenburg 100 60 Ludwigsburg 15 60 33 PH 50 28 Konstanz 50 40 60 Albstadt FA Hohenheim Nürtingen Reutlingen Sigmaringen 90 51 Esslingen Göppingen Geislingen 50 Schw. Gmünd 100 34 Biberach Weingarten 25 Ravensburg Friedrichshafen Ulm Aalen 51 Heidenheim 100G IP Ports for clients at yellow dots 100G IP Routers at few central locations only 100G waves in the core network (red lines) (C) BelWü-Koordination (Universität Stuttgart), www.belwue.de (Dieses Bild basiert auf dem Bild "Baden-Wuerttemberg location map.svg" aus http://commons.wikimedia.org und steht unter der GNU-Lizenz für freie Dokumentation. Die Urheber sind Ssch, kjunix.) Bandbreite (10GE) optisches Fenster existierende DF geplant Standorte mit Universität Hochschule Anderer Stand 12/2012 BelWü-Koordination Universität Stuttgart http://www.belwue.de Tue Jul 01 2014 12 12
2014-2016+ Tendering for: 1. Fibers (-only Network) 2. Optical Network 3. 100G IP Router (100G access for bigger Universities) Potential Timeline: 13
Campus - ROADM static 14
Campus - ROADM dynamic 15
Statements / Questions Buying 100G equipment starting end of 2015 seems to be a good time. Smaller chips, more 100G port per line-card (optical and IP) Fixed Questions: Grid-less ROADMs - to have super channels in the future (Dispersion Compensation must be aware of that!) 16
Statements / Questions (cont.) Open: Distribute ROADMs on two Locations on Campus? Dispersion compensation for long-haul 10G waves? Or only short-haul 10G waves (e.g., hop-to-hop)? (Re-use old 10G DWDM transceiver?) Big chassis or small chassis for each degree? Spectrum sharing w/ participants ( customer )? We have that on some links today w/ static filters (Swapping wavelengths with $ISP?) Less IP router, more latency between participants - problem? Is there wavelength rewriting? 17
Challenge Catch up your own team We are new to ROADMs - that took us a while... No fancy/graphical NMS system With optical equipment this would be mandatory? Necessary for tiering NOC structur (?) We overcame ATM/SDH and other circuit switching Now we are back to wavelength/otn/layer 2-VPN/etc. switching...? 18
Questions? 19
DWDM Karlsruhe - Offenburg 20
DWDM Karlsruhe - Offenburg 21
DWDM Karlsruhe - Offenburg 22
DWDM Karlsruhe - Offenburg 23
DWDM Karlsruhe - Offenburg 24