?!?!? 90%?20%? ? ? ? ?5-10? ? ?70%? ? ? ? ? ? ? ? ?83? ? ?8-10? Webgame? ?!?! 2010?GCP(Game Cloud Platform)? ?IDC? ? ? ? ? ? ? ? ? ?Failover? ? ? ? ?3?IDC?6?900? ?7 * 24? ? ?GCP?99.91% ?10?50?!?Game Cloud Platform(GCP)?!GCP?!GC P.L3 Switch?Cluster,NZone,1?L2 SwitchCluster,1?,Host 1Host 2Host N .Management Server.Zone,N?!?!? ? ? ? ? MMORPG ? Web Game Etc. ? Game Gate Game Server DB ?CPU?disk IO?GG24G60G1030MbpsGS24G60G1010MbpsDB24G150G30010Mbps8VM/HOS TCPU?disk IO?8core36GB600GB450 IOPS100Mbps?!? ? ?8?15? ? ? ? ? ? ? ?!?L3 Switch?Zone!1?L2 SwitchCluster!1Host 1Host 2Host N .! ! ?!Zone?Zone?NFS?!? ? ? ?IOPS, throughput? ? ? SAN?NAS ? Ceph?Sheepdog? ? ? ? ? ?IPSAN ?iSCSI? ? ?!?LunLunLunVM1VM2VM3Raw,iSCSISANVM1VM2VM3SANLunVGLVLVLVVM1VM2VM3SANLunFSQcow2Qcow2Qcow2LVM,+,Raw VolumeFS,+,Qcow2!?!? (Amazon ? ?)?4.0? ?linux?(kernel 3.0)? ?(kernel 2.6.20)?!? ?Flat Networking?Vlan? ? ? ? ? ? ? ? ?IPMI? ? ? ?Vlan?!?!?Admi nUsersGame Cloud Platform?!?HA?User Interface?API? Web UIConsole? & ?!API?Management Server ! ! ! ! ! ! !User!APIWeb!UICommand!ToolUserAdminZone!1ControllerZone!2Controller Zone!NControllerRestfulAPIRestfulAPI?!?(Zone)Zone!ControllerMySQLMQ?Cluster!1Cluster!2Cluster!N ?Restful!APIMonitoringSSH!Tunnel?!? ?Agent?libvirt? ?CRUD? ?libvirt?hook? ? ?IPMI? ? ? ? ?lvm tools? ?CRUD? ? ? ?IP Address?!?Management ServerDistributing SystemAdmin RestfulAPIZone!1 ! ! !ControllerSecondary StorageZone!2 ! ! !ControllerSecondary StorageZone!N ! ! !ControllerSecondary Storage?!?ZoneClusterPrimary!StorageSecondary!StorageHostMgr HostTemplateVMVM ?,? ? ? ? ? ? ? ? ?ip? ? ? ? ? ? ? ? ? ? ?!? ? ? ? ? ? ? ? ?!?!?INPUT? ? ? ? ?IP? ? ? ? ? ?OUTPUT? ?!?NODE?1NODE?2NODE?3NODE?4NODE?5NODE?1NODE?2NODE?3NODE?4NODE?5NODE?5NODE?2NODE?3FiltersWeighting? Filter ?/? ?ip? Cost ?/? ?CPU?/? Weight ? ?!?! ! ! ! !Failover? ? ? ? ? ? ?libvirt? ? ?!?Data Corruption? ? ? ? ? ? ? power fencing ?!? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ?!? ? ? ? ? ? ? ? ?CUD? ?