Apache Cloudstack as. Claus Kalle RRZK. Folie: 1. Claus Kalle Universität zu Köln

Transkript

1 Apache Cloudstack as Cloud-Management-Environment Uni Köln, Folie: 1

2 Disclaimer Folie: 2

3 Agenda Cloud VMware OpenSource: Apache Cloudstack Functions Network-Options Functional Comparison Folie: 3

4 Cloud - Recap 1 IAAS PAAS SAAS Folie: 4

5 Cloud - Recap 2 Folie: 5

8 Folie: 8

10 VMware Components Breakout into Layers Folie: 10

11 VMware Products Folie: 11

12 VMware Development ESXi 5.5 vcenter Cloud Director Folie: 12

13 VMware at : Growth Server CPUs Cores 300 Number of Guests Disk/100GB 200 Memory/10GB Folie: 13

14 And again new Bundles in 2014 Folie: 14

15 VMware Pricing vsphere e Enterprise Plus per socket Invest ca Per socket S&S / year ca. 450 (150 sockets ~70000 ) For 2-socket M620 blade, 3 Jahre S&S ca Hardware ca times overcommitment gains10000! Folie: 15

16 VMware core functions vmotion HA Heterogeneous Guests (caveat MS-Licencing) i Import of VLANs Distributed vswitch NSX: virtual Networking LDAP-Integration Templates MISSING: easy to use Self-Service Function Folie: 16

17 Comparison with other Solutions Microsoft Windows Server VMware vsphere 5.5 Enterprise 2012R2 + System Center 2012 R2 Plus + vcenter Server 5.5 Datacenter Editions Unterstützung physikalischer CPUs pro Lizenz 1 2 Managed OSE's pro Lizenz unlimited unlimited Nein, separate Lizenz uber Lizenz für Enterprise Operations Monitoring und vcenter Operations Manager Ja, im System Center 2012 R2 Management der Hosts, Guest VMs und Application oder Upgrade auf vsphere mit enthalten Workloads. die innerhalb der VMs laufen Operations Management et eifoiderlich Lizenz fur Private Cloud Management Fähigkeit Nein, Private Cloud Management Fähigkeit erfordert eine Lizenz fiber VMWare vcloud Suite. Ja, im System Center 2012 R2 enthalten Maximale Anzahl Iogischer Prozessoren pro Host Maximaler physikalischer RAM pro Host 4 TB 4 TB 64 TB Maximale Ausahl aktiver VMs pro Host Maximale Anzahl virtueller CPUs pro VM Maximaler virtueller RAM pro VM 1 TB 1 TB 2 TB Maximale Anzahl physikalischer Hosts je Cluster Maximale Anzahl der VMs je Cluster Virtual Machine Snapshots bis zu 32 Snapshots pro VM bis zu 50 Snapshots pro VM Nein, erfordert die Versionen Application Load Balancing for Scaling Out Ja, über System Center 2012 R2 vcloud Network and Security or Application Tiers VMM dei vcloud Suite Bare metal deployment of new Storage hosts and Ja, über System Center 2012 R2 Nein clusters VMM Virtualization of USB Devices Ja, via Remote Desktop Ja, via USB Passthrough support connections Ja, (limited to 4 concurrent Live Migration of running VMs vmotions per host when using Ja (unlimited concurrent live 1GbE network adapters and 8 VM Migrations) concurrent vmotions per Host when using 10GbE) Live Migration using compression of VM memory state Nein Ja Maximale Anzahl der Nodes pro VM Guest Cluster 5 64 Maximale Anzahl virtueller SCSI HDDs pro VM 60 (PVSCSI) 120 (Virtual SATA) 256 (Virtual SCSI) Native 4K Disk Support Nein Ja Hot Shrink Virtual SCSI Hard Disks for running VMs Nein Ja Ja, aber nur bis max. 400GB des Flash based Read Cache Caches pro virtueller Disk / 2TB zusammengefassten Caches pro Host fur alle virtuellen Disks Ja, limitiert auf his zu 160 physikalische Disks und 480TB gesamter Kapazitat Flash based Writeback Cache Nein Ja Automated Tiered Storage between SSD and HDD using commodity hard disks Nein Ja Storage Encryption Nein Ja, per BitLocker RHEL6 KVM (lt. Redhat Webpage) Folie: 17

18 Get out of the Hidden Cost Trap! Folie: 18

20 4 Opensource-Cloud-Products AK-ZS SYS 2011 AK-ZSYS S 2014 Gekauft von HPC-oriented Small scale, not much network Toolkit, HPC, roll your own cloud Mid- to Hi-End, smaller footprint t Folie: 20

21 Openstack Architecture Thanks to Piotr Kasprzak (GWDG) Folie: 21

22 Openstack Logical Diagram Folie: 22

23 Apache Cloudstack Folie: 23

24 CloudStack Architecture User Interface Developer API ment, Etc) egration y Managem tional Inte ng, Identity Operat S, Monitorin (OSS/BSS ration API Integ Administrator End User Console Amazon* Availability and Security Image Libraries snapshots LB HA Monitoring Application Catalog Dynamic Workload Management Resource Management Servers Storage Network Custom Templates Operating System ISOs Service Management (Metering, Accounts, etc.) Virtualization Layer Servers Network Storage

25 Vokabulary prior knowledge Folie: 25

26 Cloud Infrastructure Overview Summary One or more hosts grouped into a cluster One or more clusters grouped into a pod One or more pods grouped into a zone One or more zones controlled by y one management server Secondary Storage Management Server M SQL MySQL Cloud_db Pod Zone Zone Z Zone

27 Management Server Managing g Multiple Zones Cloud Data Center 1 Data Center 2 Data Center 2 Managem Data Center 3 ent Server Zone 2 Zone 2 Zone 3 Zone1 Zone 3 Zone 4 Data Center 2 Data Center 2 Data Center 2 Zone 2 Zone 2 Zone 2 Zone 3 Zone 3 Zone 3 Single Management Server can manage multiple zones Zones can be geographically distributed but low latency links are expected for better performance Single MS node can manage up to 10K physical hosts. Multiple MS nodes can be deployed as cluster for scale or redundancy

28 Management Server Deployment Architecture Single-node Deployment Multi-node Deployment User API Admin API Manage ment Server MySQL DB User API Admin API Load Balancer Manage ment Server Manage ment Server MySQL DB Infrastructure Resources MS is stateless. MS can be deployed as physical server or VM Single MS node can manage up to 10K hosts. Multiple nodes can be deployed for scale or redundancy Infrastructure Resources Back Up ReplicationDB

29 Small-Scale Deployment Management Server Primary Storage Secondary Storage Public IP /24 NFS Server Internet Router & Firewall Layer-2 Switch Computing Nodes to

30 Large-Scale Redundant Deployment Internet Internet Layer-3 switches with firewall modules Layer-2 switches Computing Nodes Management Server Cluster Secondary Storage Servers NFS/Swift Secondary Storage NFS/Swift Secondary Storage Clu uster 1 Primary Storage Primary Storage Primary Storage Servers Primary Storage Primary Storage Clu uster 2

31 User/API 80 TCP Ports used by Cloudstack Components HTTP File Share CloudStack Mgmt. Server CloudStack Mgmt. Server 3306 MySQL (Master) 3306 MySQL (Slave) 80/ / / /2049 Virtual Router Secondary Storage SSVM CPVM vcenter XenServer KVM Per Customer Per Availability Zone Per Pod / Cluster

32 Time for a Reward Folie: 36

33 Demo in Preproduction deploy W12KR2 and Centos6.5 Gast To be continued Folie: 37

34 Cloudstack technical Features Guest Migration ( vmotion ), Guest Console Snapshots (cold) Templates (the >Menu<) Multi-Hypervisor (KVM, XEN, VMWARE, HYPER-V, ) Multistorage (primary - nfs, rbd, clvm, Gluster, secondary nfs, smb/cifs, S3, swift),?vsan? HA-feature Firewall, Load-Balancer appliances Private Networking (VPN) Appliances (F5, Netscaler, ) Plugins (openvswitch, ), SDN, isolated+shared networks Folie: 39

35 Cloudstack marketing features Multi-tenant Multi-Hypervisor Well documented, release process API (special and Amazon campatible) Dashboard Roadmaps available Support available (in US and GB) Folie: 40

36 General CloudStack Best Practices (!) A staging system that models the production environment is strongly advised. It is critical if customizations have been applied to CloudStack. Allow adequate time for installation, Proof-of- Concept (POC), and learning the product. Allow at least 4-8 weeks for a POC to work through all of the integration issues. It takes months to gain confidence with CloudStack and related technologies. Folie: 41

37 Cloudstack Network Principle Folie: 42

38 Cloudstack Networking Basic: use ebtables to seperate guest traffic on same broadcast domain Advanced: use VLANs or VNIs to seperate guest traffic - VLANs are rare&precious (network dept.) - VNIs are aedisposable good (>4096) - VNI Usage requires tunnels (GRE, VXLAN) Folie: 43

39 CS Advanced Networking Example 1 VLAN for Guest Separation Folie: 44

40 CS Advanced Networking Example 2 VLAN for Guest Separation Folie: 45

41 Cloudstack Software Defined Networking (SDN) Example 3 VNIs and GRE tunnel as interconnect Folie: 46

42 Break Life Demo: How about our guests? Folie: 47

43 KVMHostSetupfor GRE Tunnel As of Cloudstack 4.3 (April 2014) Gäste Switches Interfaces Folie: 48

44 GRE with 3 hosts N x (N-1) gre interfaces Automatic in Cloudstack4.44 Folie: 49

46 NIST Cloud essential characteristics On-demand self-service Broad network access Resource pooling Rapid elasticity Measured service Quelle: NIST Special Publication , NIST Definition of Cloud Computing, September 2011 Folie: 54

47 Funktioneller Vergleich *** 3 NIST-Points *** ***** 5 NIST-Points ***** VMware vmotion HA Heterogene Gäste Import exist. VLAN-Struktur Distributed vswitch NSX: virtual Networking LDAP-Integration ti Templates MISSING: easy-to-use Self-Service Funktion, Accounting Apache Cloudstack /kvm Life migration HA Heterogene Gäste Import exist. VLAN-Struktur Standard virt. bridge support Openvswitch mit GRE-Tunneln LDAP-Integration ti Templates Self-Service Interface Load-Balancer, Firewall Appliances Accounting Folie: 55

48 Questions? Cloudstack Logos published by Erdősi Péter Folie: 57

49 Folie: 58

50 Folie: 59

51 Folie: 60

52 Folie: 61

53 Folie: 62