SMB v 3.1, WIN10, Skype+Lync. Bernhard Schnabel Carpe diem GmbH

Transkript

1 SMB v 3.1, WIN10, Skype+Lync Bernhard Schnabel Carpe diem GmbH

2 Warum SMB v3.1? => So>ware defined Storage! Welche Features bietet Windows Server 2012 R2 und vnext? Was bietet SMB v 3.1

3 Probleme bisher Beispiele: Hoher KonfiguraNonsaufwand im SAN bei vielen HyperV Knoten SMB v2 hat Performancegrenzen. Netzwerk Teaming CSV s sind gut aber Etc.

4 File Server Cluster für Hyper- V Hyper-V Clusters SMB3 Storage Network Fabric Scale-Out File Server Clusters Storage Spaces Shared JBOD Storage

5 File Server Cluster für Hyper- V Networking 2+ Interfaces 1 GbE 10 GbE 40 GbE + Optional RDMA InfiniBand RDMA Server 2+ servers 2+ node Cluster- in- a- Box 2+ discrete servers Storage Reliable Shared Storage Storage Spaces Clustered RAID FC / iscsi / SAS fabric Shared JBOD SAS External Storage Arrays RDMA = Remote Direct Memory Access

6 So>ware Defined Storage Storage Stack Scale- Out File Server Access point für Hyper- V Scale- out data access Cluster Shared Volumes Single consistent namespace Fast failover Storage Spaces Storage pooling Virtual disks Hardware - Standard volume hardware - Fast and efficient networking - Shared storage enclosures - SAS SSD - SAS HDD So>ware Defined Storage System Shared JBOD Storage

7 Welche Features bietet Windows Server 2012 R2 und vnext? Storage Spaces Mirror 2- copy mirror, toleriert einen Plaaenausfall 3- copy mirror, toleriert zwei Plaaenausfälle Üblich für Random I/O Mirror Space Mirror Space Mirror Space Parity Space Parity KostengünsNger Speicher Toleriert zwei Plaaenausfälle Üblich für sequennal I/O Drive Failure! Enclosure awareness Toleriert den Ausfall eines Enclosures Parallel rebuild Pseudo- random Verteilung der Last, weniger belastete Plaaen werden bevorzugt. Platz für die Wiederherstellung ist über alle Plaaen verteilt und wird parallel wiederhergestellt. Data is rebuilt to multiple drives simultaneously, using spare capacity Rebuild Metric Measurement Data Rebuilt Time Taken Rebuild Throughput 2,400 GB 49 min > 800 MB/s

8 Storage Spaces Tiering and WBC Üblicherweise verwendet man 2 Tiers. SSD s für schnellen Zugriff und Write Back Cache (WBC) HDD s für Massendaten. Daten, die häufig genutzt werden, kommen automansch in den SSD Tier. Einzelne Files können vom Administrator fest in den SSD Tier gelegt werden. Write Back Cache Daten, die auf SSD s liegen und große Streams werden nicht gecached. Hot Data Compute Nodes I/O AcNvity Accumulates Heat at Sub- File Granularity SAS SSD Cold Data SAS HDD

9 Storage Replica Stretch Cluster Stretch Cluster Synchrone stretch cluster in andere Standorte für HA Synchrone oder asynchrone Replikation Cluster <-> Cluster Server <-> Server Manhattan DC NODE1 in HVCLUS NODE2 in HVCLUS SR over SMB3 NODE3 in HVCLUS NODE4 in HVCLUS Jersey City DC BCDR Server to Server Benefit s Block-level, host-basierende, volume replication End-to-end software stack von Microsoft SMB3 als Transport Manhattan DC SRV1 SR over SMB3 SRV2 Jersey City DC

10 Storage Spaces Shared nothing Unterstützt DAS (Direct Aaached Storage) Ermöglicht große Storage Pools Einfache Erweiterung Ausfallsicherheit mit bis zu 3 Kopien und dual parity Hyper- V Clusters SMB3 Storage Network Fabric Scale- Out File Server Einsatzbeispiele: Storage für HyperV Speicher für ReplikaNonsziele und Backup Braucht keine shared JBODs und SAS fabric am Scale Out File Server

11 CSVFS Komponenten CSV File System (CSVFS) Proxy file system on top of NTFS or ReFS Mounted on every node Decides direct IO vs. file system redirect IO SMB Client (CSV) SMB Server CSVFS CSV Volume Manager Responsible for the creanon of CSV volumes Direct IO for locally aaached spaces and Block- level IO redirect for non- locally aaached spaces CSV Volume Storage Node 1 SMB Server (default) CSV Filter Aaaches to NTFS / ReFS for local clustered spaces Controls access to the on- disk file system Co- ordinates metadata operanons SMB Server (CSV) CSV Filter NTFS / ReFS Volume Space CSVFS CSV Volume Storage Node 2

12 SMB MulNchannel Network throughput and fault tolerance VM VMBUS VM Hyper- V Host Bandwidth aggreganon & link fault tolerance IO balanced over acnve interfaces Replays operanons on alternate channels in channel failure cases RSS aware, LBFO aware, NUMA aware Zero configuranon Client driven NIC discovery and best pair(s) selecnon Transparent fall back to less desirable interfaces in failure cases Periodic re- evaluanon and transparent upgrade CSV traffic to node 2+ SMB Client D B NIC Pair 1 VHD Parser B/W Limiter SMB Client SMBD NDK NIC Pair N SMB Server CSVFS WSK TCP LBFO Resume Key Shared VHD NTFS/ReFS Server Service Witness Client DPM VSS RVSS Provider To Witness Service On SOFS node 2+ Witness Service DNN Resource SOFS Resource Cluster RVSS Service VSS CSV Provider LUN / Space SOFS Node 1

13 SMB Scale- Out Hyper- V Host Scaling out for throughput and management Scale Out AcNve- AcNve SMB shares accessible through all nodes simultaneously Distributed NetName (DNN) Clients re- directed to opnmal server node (CSV/Storage space owner) Management / Backup Simple Management Extensive PowerShell D B NIC Pair 1 VM VHD Parser B/W Limiter SMB Client SMBD NDK VMBUS NIC Pair N SMB Server CSVFS VM WSK TCP LBFO Resume Key Shared VHD NTFS/ReFS LUN / Space Server Service Witness Client DPM VSS RVSS Provider To Witness Service On SOFS node 2+ Witness Service DNN Resource SOFS Resource Cluster RVSS Service VSS CSV Provider SOFS Node 1

14 SMB V3.1 Transparent Failover Geplante und ungeplannte Failover mit zero downnme VM VM Hyper- V Host SMB Client Server node failover is transparent to client side applicanons Small IO delay during failover SMB Server Handles are always opened Write- Through Stores handle state in Resume Key Filter (RKF) DB Resume Key Persists protocol server state to file Reconciles handle reconnects/replays with local file system state Protects file state during reconnect window Witness Service Clients proacnvely nonfied of server node failures Clients can be instructed to switch server nodes D B NIC Pair 1 VHD Parser B/W Limiter SMB Client SMBD NDK VMBUS NIC Pair N SMB Server CSVFS WSK TCP LBFO Resume Key Shared VHD NTFS/ReFS LUN / Space Server Service Witness Client DPM VSS RVSS Provider To Witness Service On SOFS node 2+ Witness Service DNN Resource SOFS Resource Cluster RVSS Service VSS CSV Provider SOFS Node 1

15 SMB Direct Low network latency and low CPU consumpnon SMB Direct Provides sockets- like layer over NDK / RDMA Low latency combinanon of fabric and skipping TCP stack Supports RoCE, iwarp and InfiniBand Efficient cycles/byte comparable with DAS Results >1 Million 8K IOPS demonstrated by Violin Memory 16 GB/s large IOs (mulnple InfiniBand links) with low CPU Also unlized by (SMB Direct + SMB MulNchannel): bandwidth limiter to avoid starving LM traffic CSVFS for internal traffic NDK = Network Direct Kernel Interface

16 Scale- Out File Server is for Hyper- V and SQL Server Technology Area Feature General Use File Server Cluster Scale- Out File Server SMB ConNnuous Availability Yes Yes SMB MulNchannel Yes Yes SMB SMB Direct Yes Yes SMB EncrypNon Yes Yes SMB Transparent failover Yes 1 Yes NTFS Yes NA File System Resilient File System (ReFS) Yes NA Cluster Shared Volume File System (CSV) NA Yes BranchCache Yes No 4 Data DeduplicaNon (Windows Server 2012) Yes No 4 Data DeduplicaNon (Windows Server 2012 R2) Yes Yes DFS Namespace (DFSN) root server root Yes No 4 DFS Namespace (DFSN) folder target server Yes Yes DFS ReplicaNon (DFSR) Yes No 4 File Management File Server Resource Manager (Screens and Yes No 4 Quotas) File ClassificaNon Infrastructure Yes No 4 Dynamic Access Control (claim- based access, Yes No 4 CAP) Folder RedirecNon Yes Yes 2 Offline Files (client side caching) Yes Yes 5 Roaming User Profiles Yes Yes 2 Home Directories Yes Yes 2 Work Folders Yes No 4 NFS NFS Server Yes No 4 ApplicaMons Hyper- V Yes 3 Yes Microso> SQL Server Yes 3 Yes

17 Skype + Lync Die nächste Version von Lync wird im ersten Halbjahr 2015 zu Skype for Business werden. Es gibt einen neuen verbesserten Client und neue Server Releases. Microso>: Indem wir Unternehmen die Möglichkeit geben, Hunderte von Millionen Skype- Nutzern außerhalb ihres Unternehmens zu erreichen, glauben wir, dass Skype for Business die Art und Weise wie Menschen miteinander kommunizieren, erneut verändern wird.

18 Windows 10 DEMO

19 CARPE DIEM