SmartCloud Orchestrator 技术架构和 DevOps 实践AgendaHistory and Today如何设计和开发云平台技术架构部署架构多租户设计网络拓扑和 SDNDevOps 实践History and TodayStart as innovation project in CDL from 2010Use High Scale Low Touch from beginningMoved to OpenStack from 20126 个月的发布周期 , follow OpenStack Release Schedule全球 6 个实验室， 60+ developers3 Datacenters for DevOps, China, Rome, RaleighSaaS offering (OaaS) in SoftLayer设计目标企业云计算数据中心的管理平台整合已有的计算，网络，存储资源 ， Legacy Virtualization (VMware, Power,z/VM) , Legacy E nterprise Storage System and Existing network搭建新的私有云， KVM, SDN (OVS, OpenContrail), SDS ( Ceph)利用公有云的服务， SoftLayer and AWS打造生态系统， Cloud MarketplaceAmazon EC2Softlayer软件架构图Infrastructure-as-a-ServiceCloud ResourcesStorageComputeNetworkCost ManagementIBM Cloud MarketplaceMonitoring, Capacity Planning, PerformancePublic Cloud GatewayJazz for Service ManagementClient Data Center DomainsPattern EngineHeat EngineAutomation UIAdmin UISelf Service UIAutomation Process EngineOpenStack APIKeystoneIBM/OEM Cloud ContentPackages新的软件开发方法一切从用户的需求出发 , 重视客户体验使用用户能够理解的商业语言，着重在要解决的重大问题上用户参与精准定位用户需求回放 , 演示紧扣要实现的价值遵循 Cloud Native 软件设计哲学小而精服务而不是大而全组件Highly distributed and resilient smaller servicesFailure is not a option频繁更新，持续升级不断尝试 new idea生产环境是一个可控的测试环 境 , A/B testing happened every day.挑战： 云平台的部署如何在客户的数据中心搭建云Complex customer datacenterCustomerize topologyBaremetal requriement and mixed virtualization environmentHigh available and large scale cloud云平台的部署 Cloud on CloudBootstrap a small cloud in 5 minutesJust in enough services like chef, http,glance, nova, heatUse heat to define the topologyExtend heat api and engine to support existing node, configuration node (like db2, ldap,VMware vCenter), reference nodeExtend heat template to support chef betterOutput to chef environment, resource role mappingProvide new deployment tasks based on heat engineCan be nested to support cascade deployment like mulitple regionRh6.4,6.5云平台的部署 Cloud on CloudDeployment Service NodeHttpBuilt in templatesAll-in-one Distributed ProductionBaremetalSCOLDAP NodeCobbler/xCatChef ServerGlance NovaheatDeploy Engine2. AssociateProvisioning4. configure3. Generate1. RegisterConvert toExisting Machine Existing Machine Rh6.4,6.5 node Rh6.4,6.5sco componentsKeepAlive(slave)Nova-scheduler l2-agentStorage NodeCinder-volumeHigh Available , High Scale Cloud DeploymentCentral NodesHA Proxy(Active) (master) KeepAlive UI service VIPHttp:/sco.comHA Proxy Central Nodes UI service HA Proxy(Slave) KeepAlive UI serviceRegion NodesMysql Galera RabbitMQ HA Proxy Keepalived Nova-api Glance-api Cinder-api .Network Node (Active) l2-agent l3-agent Dhcp-agent Packmaker corosyncVIPNetwork Node (Passive) l2-agent l3-agent Dhcp-agent Packmaker corosyncMgr NetworkCompute NodeCompute NodeNova-computeNova-compute Nova-scheduler l2-agentStorage NodeCinder-volume Cinder-scheduler Ceph OSDMultiple Tenant DesignResource IsolationNetwork segment is the most importantAdministration delegationAllowed to delegate responsibilityUse keystone v3Integrated with LDAPDomain, Project, Role, UserNew Added project admin roleMutliple Domain, Mutliple Tenants, Multiple Resource PoolSoftware Defined Netework - NeutronInternetPublic SwitchStorage SwitchVM Switchmeta-data-agentl2-agentl3-agentStorage NodeNetwork Node eth0Compute Nodeeth0Compute Nodeeth0nova-computeceph-clientnova-computeceph-clientcinder-volumeceph-osdcobblermysqlqueueOpenStack .APIMgr NodeManagement SwitchSoftware Defined Network - SummaryVanilla Neutron is not production ready for large scale cloud deploymentFor KVM, Linux Bridge + VxLan (4k tenants) or Vlan(4k tenants) can serve small scale environment (up to 100 physical nodes)For VMware, Power, z/VM neutron + vlan matches the most existing de ploymentOpenContrail is a new promising opensource SDN projectTry to solve network virtualization and NFVConsists of SDN controller and vRouterControl plane uses BGP, netconf and XMPPData plane supports MPLS over GRECloud Orchestrator DevOps OverviewProcess and MethodologiesAgile and Test Driven DevelopmentDevelopBlueprint (Wiki),Sprint, User Story, TasksGit, Jazz , Girret review ,Jenkins,Jazz Build EngineCloud is used every where when there is VM requiredChef is used every where when there is requriement to install and configure componentOperationMaintain Continuous Delivery InfrastructureUses NodeJS, LogStash, MongoDB,SquidDevOps - Jerney of the codeJazzGithubJazz Build EngineBuild Repository(NFS,HTTP)MSG Queue Cloud Testing Engine(cron)Analysis Engine Testing ResultAPI/UIsubscribeuploadgit clonegit clonefetchpublishdownloadTesting CloudprovisionCloud Provider (knife)DevOps Continuous ImprovementAgilityReduce the package and download timeReduce the installation timeConcurrent running the testcasesQuanlityLog analysis to find hidden error and warningsElastic re-check to skip transient errorDevOps Data and Analysis50+ builds working d ay30 VMs per build3 Production cloudsOn