Ari And Tobbe, Will your update of BOM 0 include all this OSC modules for UNI sites and the extra OSC for Malmö and Rätan? Regards Stefan -----Ursprungligt meddelande----- Från: Magnus Bergroth [mailto:bergroth at nordu.net] Skickat: den 6 november 2015 09:10 Till: Björn Lindman <bjorn.lindman at ipnett.com> Kopia: Michał Szpilewicz <MSzpilewicz at advaoptical.com>; Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Ämne: Re: Sunet Adva DCN I created 200 ospf routers in juniper platform, 100 in each mx480 with p2p links inbetween and a /32 loopback. I would like to add them to the Adva lab to see what will happen. <<M Björn Lindman wrote:

Hi All, Me and Magnus had a chat today and we would like to have a call regarding the DCN design. Suggestion is 11:00 tomorrow Wednesday or Thursday afternoon, doable? Best regards/Med vänlig hälsning Björn Lindman  Pre Sales Engineer Tel +46855506907 | Mob +46766292507 | bjorn.lindman at ipnett.com IPnett AB | Dalvägen 8 | 169 56 SOLNA www.ipnett.se | twitter.com/IPnettSE -----Original Message----- From: Michał Szpilewicz [mailto:MSzpilewicz at advaoptical.com] Sent: den 13 november 2015 14:29 To: Magnus Bergroth <bergroth at nordu.net>; Björn Lindman <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: RE: Sunet Adva DCN Hi Magnus, I have discussed the DCN design with colleagues from NetEng and R&D team. Please have a look at attached draft of DCN overview: dcn.overview.3loops.jpg. This is the setup we would like to recommend for your network: - optical rings below 32 NEs - no RSTP enabled on electrical ports - we have less subnets - we could split red LAD into two subnets to limit the problem to smaller segment in case of fiber cut We have done this number of times in such way. I know from practice that this is the most stable DCN we can get. If we would go for version you have suggested: DCN-no-l2-loops.pdf you would be the first one to test it. In theory it should work as well. However we would know it only after adding all the nodes and having network at full capability. Please be aware that this is not something we would usually suggest to customer. In case of fiber cut in such network convergence times will be counted in minutes (around 2 min due to OSPF counters settings) in compare to seconds when RSTP is used. We need to take into account that worst case scenario is that R&D will suggest DCN redesign. When it comes to OSPF area you will have at least 115 POP sites + 13 active UNI sites (128 total). We also need to take into account possibility that the network might extend in the future. R&D wasn't that optimistic to have such amount of NEs in single area. Tests we have performed during the POC only show that NCU can process 10.000 LSA entries. We need to take into account that packets must be passed correctly (e.g. some ping test could have been executed) and that network might work in some overload/unexpected conditions (e.g. link flapping caused by fibercut, faulty hardware in the network). On top of that LSA exchanged to share traffic engineering information are much bigger to usual once for subnets and hosts information exchange. Due to that having single database storing all that data might cause problems. Taking all above into account I think we should divide your network into two OSPF areas. Please let me know what you think about our suggestions. -- BR Michal -----Original Message----- From: Magnus Bergroth [mailto:bergroth at nordu.net] Sent: Thursday, November 05, 2015 11:32 PM To: Michał Szpilewicz <MSzpilewicz at advaoptical.com>; "Björn Lindman (bjorn.lindman at ipnett.com)" <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: Sunet Adva DCN Hi Michal and Björne As we talked to day regarding the DCN design I have now drawn an alternative DCN to show how we would like to have the DCN. Criteria, Only one ospf area No Layer2 loops Simple It ended up with three more broadcasts domains. The suggestion needs two more OSCM cards than the original design one i Malmö and one in Rätan both has 9RU shelfs so I guess they would fit. With some more thoughts it would probably be possible to design it so that it could be divided into two ospf areas, without l2 loops. But we prefer to have every thing i area 0. Would it be possible to build like this and would it have any draw backs? <<Magnus

Thank you! Best regards/Med vänlig hälsning Björn Lindman  Pre Sales Engineer Tel +46855506907 | Mob +46766292507 | bjorn.lindman at ipnett.com IPnett AB | Dalvägen 8 | 169 56 SOLNA www.ipnett.se | twitter.com/IPnettSE -----Original Message----- From: Christiane Hack [mailto:CHack at advaoptical.com] Sent: den 17 november 2015 14:55 To: Björn Lindman <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se; Magnus Bergroth <bergroth at nordu.net>; Michał Szpilewicz <MSzpilewicz at advaoptical.com> Subject: AW: Sunet Adva DCN Hi Björn, As requested, I have scheduled the call for tomorrow 11:00. If there is anything else I can help you with, please let me know. Kind regards, Christiane Christiane Hack Project Manager EMEA   ADVA Optical Networking SE Maerzenquelle 1-3 D-98617 Meiningen-Dreißigacker t: +49 (0)3693 450 431 m: +49 (0)175 4365 431 Let's ADVANCE!   ADVA Optical Networking SE is a European stock corporation ("Societas Europaea") with registered offices at Maerzenquelle 1-3, D-98617 Meiningen, Germany * CEO: Brian L. Protiva, Chief Officers: Dr. Christoph Glingener, Ulrich Dopfer * Chairman of the Supervisory Board: Nikos Theodosopoulos* AG Jena HRB 508155 * VAT No. DE 175 446 349  -----Ursprüngliche Nachricht----- Von: Björn Lindman [mailto:bjorn.lindman at ipnett.com] Gesendet: Dienstag, 17. November 2015 12:59 An: Christiane Hack <CHack at advaoptical.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se; Magnus Bergroth <bergroth at nordu.net>; Michał Szpilewicz <MSzpilewicz at advaoptical.com> Betreff: RE: Sunet Adva DCN Hi All, Me and Magnus had a chat today and we would like to have a call regarding the DCN design. Suggestion is 11:00 tomorrow Wednesday or Thursday afternoon, doable? Best regards/Med vänlig hälsning Björn Lindman  Pre Sales Engineer Tel +46855506907 | Mob +46766292507 | bjorn.lindman at ipnett.com IPnett AB | Dalvägen 8 | 169 56 SOLNA www.ipnett.se | twitter.com/IPnettSE -----Original Message----- From: Michał Szpilewicz [mailto:MSzpilewicz at advaoptical.com] Sent: den 13 november 2015 14:29 To: Magnus Bergroth <bergroth at nordu.net>; Björn Lindman <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: RE: Sunet Adva DCN Hi Magnus, I have discussed the DCN design with colleagues from NetEng and R&D team. Please have a look at attached draft of DCN overview: dcn.overview.3loops.jpg. This is the setup we would like to recommend for your network: - optical rings below 32 NEs - no RSTP enabled on electrical ports - we have less subnets - we could split red LAD into two subnets to limit the problem to smaller segment in case of fiber cut We have done this number of times in such way. I know from practice that this is the most stable DCN we can get. If we would go for version you have suggested: DCN-no-l2-loops.pdf you would be the first one to test it. In theory it should work as well. However we would know it only after adding all the nodes and having network at full capability. Please be aware that this is not something we would usually suggest to customer. In case of fiber cut in such network convergence times will be counted in minutes (around 2 min due to OSPF counters settings) in compare to seconds when RSTP is used. We need to take into account that worst case scenario is that R&D will suggest DCN redesign. When it comes to OSPF area you will have at least 115 POP sites + 13 active UNI sites (128 total). We also need to take into account possibility that the network might extend in the future. R&D wasn't that optimistic to have such amount of NEs in single area. Tests we have performed during the POC only show that NCU can process 10.000 LSA entries. We need to take into account that packets must be passed correctly (e.g. some ping test could have been executed) and that network might work in some overload/unexpected conditions (e.g. link flapping caused by fibercut, faulty hardware in the network). On top of that LSA exchanged to share traffic engineering information are much bigger to usual once for subnets and hosts information exchange. Due to that having single database storing all that data might cause problems. Taking all above into account I think we should divide your network into two OSPF areas. Please let me know what you think about our suggestions. -- BR Michal -----Original Message----- From: Magnus Bergroth [mailto:bergroth at nordu.net] Sent: Thursday, November 05, 2015 11:32 PM To: Michał Szpilewicz <MSzpilewicz at advaoptical.com>; "Björn Lindman (bjorn.lindman at ipnett.com)" <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: Sunet Adva DCN Hi Michal and Björne As we talked to day regarding the DCN design I have now drawn an alternative DCN to show how we would like to have the DCN. Criteria, Only one ospf area No Layer2 loops Simple It ended up with three more broadcasts domains. The suggestion needs two more OSCM cards than the original design one i Malmö and one in Rätan both has 9RU shelfs so I guess they would fit. With some more thoughts it would probably be possible to design it so that it could be divided into two ospf areas, without l2 loops. But we prefer to have every thing i area 0. Would it be possible to build like this and would it have any draw backs? <<Magnus

Hi Yes, it has potential to work. <<Magnus Michał Szpilewicz wrote:

Hi Michal, Added new ip ranges from Magnus in xls. Could you please make the IP address changes in Visio drawing so it corresponds to the xls? Best regards/Med vänlig hälsning Björn Lindman  Pre Sales Engineer Tel +46855506907 | Mob +46766292507 | bjorn.lindman at ipnett.com IPnett AB | Dalvägen 8 | 169 56 SOLNA www.ipnett.se | twitter.com/IPnettSE -----Original Message----- From: Michał Szpilewicz [mailto:MSzpilewicz at advaoptical.com] Sent: den 24 november 2015 17:31 To: Magnus Bergroth <bergroth at nordu.net>; Björn Lindman <bjorn.lindman at ipnett.com> Cc: Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: RE: Sunet Adva DCN Hi Magnus, Bjoern, Please see attached detail diagram of Sunet DCN. Tomorrow I will discuss with Torbjorn what would be the best approach to connect router in both Stockholm nodes. I'm sorry that it took longer than I anticipated. -- BR Michal -----Original Message----- From: Magnus Bergroth [mailto:bergroth at nordu.net] Sent: Wednesday, November 18, 2015 4:57 PM To: Michał Szpilewicz <MSzpilewicz at advaoptical.com> Cc: "Björn Lindman (bjorn.lindman at ipnett.com)" <bjorn.lindman at ipnett.com>; Magnus Bergroth (bergroth at sunet.se) <bergroth at sunet.se>; Ari Salomaa <ASalomaa at advaoptical.com>; Torbjörn Rium <trium at advaoptical.com>; Christiane Hack <CHack at advaoptical.com>; Stefan Josefsson <stefan.josefsson at ipnett.com>; sunetc-teknik at lists.sunet.se Subject: Re: Sunet Adva DCN Hi Yes, it has potential to work. <<Magnus Michał Szpilewicz wrote: