Open Networking Enables Deutsche Telekom to Sail the Cloud Native Seas.pdf

1、Open Networking Enables Deutsche Telekom Sail the Cloud Native SeasDeploymentsOpen Networking Enables Deutsche Telekom Sail the Cloud Native SeasKamran Naqvi,Principal Architect,BroadcomJens Jetzork,DevOps Engineer,Deutsche TelekomIP Fabric Broadcom Silicon based Edge-Core switchesOpen-Source Networ

2、k Operating System-SONiCBGP underlay with VXLAN EVPN based overlays to provide multi-tenancyCaters for multiple connectivity types:MCLAG Routing on the HostInter-VRF Route LeakingFlexible Management Framework facilitates Automation SpineLeafLeafLeafSpineLeafHypervisorHypervisorFRRBGP PeeringVXLAN EV

3、PN“An internal,GitOpsbased Kubernetes Cluster as a Service Platform for Network Technology(NT)Workloads almost exclusively built using open-source components.”Das SCHIFF/T-CaaS in Deutsche Telekom 150+clusters 1200+bare metal servers 6 data centers 170+OCP Accepted SONiC devices 7800+network ports 4

4、0+Apps(e.g.5GC,PCF.)Traditional Layer 2 ModelNetwork#1Network#2VLAN Kubernetes TenantCalico Full-Meshbased on BGP andIPinIP or VXLANGWVLAN/VRF combination for backbone connectivityVLAN/VXLAN for LOM and storageonlyVLAN/VXLAN for customers using SRIOV Static-Anycast-Gateway(SAG)BGP EVPN Type 2 and Ty

5、pe 5BGP unnumbered for underlay and serverBGP numbered for backboneDHCP for LOMUsed Features/ProtocolsNew Cloud VXLAN ModelNetwork#1Network#2Pod IPs per Node announced into Cluster VXLANAttaching standard hosts|Border-Leaf|Spine|Leaf|Leaf-Tbase|ServerBGPNetwork#1Network#2BGP EVPN Type 5(Cloud native

6、)Attaching SRIOV hosts|Border-Leaf|Spine|Leaf|Leaf-Tbase|ServerBGPTrunkNetwork#1Network#2BGP EVPN Type 5(SRIOV)Cross Fabric and Host communication|Border-Leaf|Spine|Leaf|Leaf-TbaseNetwork#1Network#2EVPN Type 2(MGMT)BGP EVPN Type 5(Cluster)BGP EVPN Type 2(SRIOV)|ServerNetwork OperatorNetworkOperatorL

7、ayer2 CRVRF CRSiteConfigFRRLinuxnetlinknetwork-operator translates Kubernetes CRs into netlink and FRR configurationCreates VRF,L2VNI/L3VNI,VXLAN interface and FRR configuration.For L2VNI:Provides Anycast gateway on the nodesFor L3VNI:Configurable peering&route leaking on a hostNetwork OperatorapiVe

8、rsion:.kind:VRFRouteConfigurationmetadata:name:bb-m2m-01spec:vrf:bb_m2mimport:-le:32cidr:0.0.0.0/0action:permitexport:-cidr:10.1.1.1/32action:permitseq:1Monitoring SONiCCo-developed by DT and STORDISOpen-Source Monitoring solution comprising:GrafanaPrometheusNode Exporter,SONiC ExporterReport on Met

9、rics like:Interface Stats,EnvironmentCPU,Disk Usage,DOMBGP Peers,Routes etcProject MonsoonThird Party Container ManagementTPCM allows user to install the third-party components in the form of containers into SONiC.It provides the ability to install TPC(third Party Container)docker from various sourc

10、es.Docker Hub Registry using standard Docker pull/load commands.Installed from storage location in the form of compressed docker image.Load from local file system.Load from remote server using sftp/scpprotocol.Load from external http server using http(s)protocol.TPC can be created from an existing d

11、ocker image.It provides the seamless upgrade support for SONIC and TPC docker.All the docker container images are tightly coupled with SONiC dockerFS.TPCM IntroductionIt supports standard TPC management functionalitiesoInstall -Install the TPC docker from one the sources into SONiC.oUninstall -Remov

12、e the TPC from SONiC.oUpgrade -Upgrade the existing TPC with newer version of TPC.oShow -List the installed TPC dockers.Upgrade framework support.oSONiC upgrade:Seamless infrastructure to migrate all running TPC from currently running SONiC image into newly upgraded SONiC image.oTPC upgrade:Provides

13、 the pre/post hook script support for migrating the TPC private data.Provides the shared data volume for storing the TPC private data.TPC docker service management.oIt creates and manages the systemdservice for each TPC.oAuto start the TPC during cold/fast/warm reboot.KLISH/CLICK CLI support.REST co

14、nfig support for remote access.TPCM FrameworkTPCM InfrastructureSONIC Running ImageTPC(s)Docker OverlayFSSONiC ContainersSONIC New ImageTPC(s)Docker OverlayFSSONiC Containers3.TPC migration2.TPC Upgrade(Pre/Post hook support)TPC imageSONIC Image Upgrade1.TPC Install/Uninstall/Show Open Networking with SONiC provides a powerful&flexible fabric for Cloud Native Applications Network Operator githublink:https:/ More details on Das SCHIFF/T-CaaS https:/youtu.be/s0UKWiNNFTM More details about Monsoon project:https:/ http:/:8080/?orgId=1 SONiC How-To Videos:https:/Y to ActionThank you!