OpenStack 企业应⽤之路

bx34

贡献于2015-07-31

字数:0 关键词: 分布式/云计算/大数据

Date: 杭州 , 2014年 7⽉ 19⽇ Author: 杜⽟杰 OpenStack企业应⽤之路 learn OpenStack from trystack.cn OSC源创汇 Date: Author: 杭州 , 2014年 7⽉ 19⽇ 杜⽟杰 Du Yujie(Ben) ! TryStack执⾏董事 OpenStack基⾦会独⽴董事 中国企业级云计算联盟( ECA)副秘书⻓ duyujie.dyj@gmail.com http://www.linkedin.com/in/duyujie/ PAGE: 云计算 带来的挑战 KK,互联⺴思维,《失控》,云计算 ! ! ! ! ! ! 3 内容简介 1994年在美国出版,这本关于机器、系 统、⽣物和社会的 “⼤部头 ”,揭⽰了社会进 化、特别是互联⺴发展的 “先知预⾔ ”。作者 凯⽂ ·凯利( Kevin Kelly, 1952〜,⼈们昵称 他为 KK) PAGE: IaaS失控( ≠失败 )图 4 IBM/HP/Dell Oracle x86虚拟化 (VMWare) 杂牌服务器 去中⼼化 去权威化 去⾼富帅 去层级化 (简化 ) 去⾼富帅 去⾼富帅 EMC NetApp HDS 去⾼富帅 ZFS 去⾼富帅 去中⼼化 GlusterFS(Block) Ceph(Block) Swift(Object) HDFS(Bigdata) 私有云⽅案 (IBM/HP/Dell/ Cisco/Microsoft) Openstack 去⾼富帅 Cisco OVS Openflow 失控 失控 失控 服务器 存储 ⺴络 数据库 Oracle 去⾼富帅 去中⼼化 MySQL Hadoop 去⾼富帅 去权威化 去中⼼化 KVM 失控 失控 扩张 萎缩 扩张 私有云 公有云 失控 失控 IBM放弃 X86业务 失控 加⼊ Openstack基⾦会 失 控 AWS公有云技术 IBM Smart Cloud IBM收购 SoftLayer HP Public Cloud Microsoft Azure Oracle Public Cloud Cisco Public Cloud VMWare + Carpathia 建⽴公有云 失控 PAGE: 2~ 5年之后? 5 ZFS GlusterFS(Block) Ceph(Block) Swift(Object) HDFS(Bigdata) Openstack OVS Openflow MySQL Hadoop KVM 加⼊ Openstack基⾦会 AWS公有云技术 IBM Smart Cloud IBM收购 SoftLayer HP Public Cloud Microsoft Azure Oracle Public Cloud Cisco Public Cloud VMWare + Carpathia 建⽴公有云 Software-Define Data Center ? 私有云市场萎缩, 内部架构逐渐被⽇渐成 熟的软件定义数据中⼼( 开放 )组件代替 公有云市场扩张,各⼤传统 IT巨头割地 ⻅分晓 OpenStack or Non-OpenStack PAGE: Is OpenStack a Product? 6 Yes ! No OpenStack will never be ready for the enterprise! It's a technology framework Yes ! No PAGE: Linux & OpenStack 7 PAGE: Why are we succeeding? ‣ Successful platforms have three forces: ‣ Technology ‣ Ecosystem ‣ Users 8 PAGE: OpenStack Foundation 9 Foundation Board of Directors! Represents business interests Technical Committee! Represents developers User Committee! Represents users 8 Platinum! members 8 8 8 19 Gold! members 16,000+Ind members 67 Corp Sponsors 260+ Supp.! Orgs 3 https://wiki.openstack.org/wiki/Governance 13 Other! members Direct Governance Model PAGE: OpenStack Users in China 10 PAGE: 公有云 &私有云之争 11 ! 私有云 Optimized Owner ! Purpose Economics! Direct Control 公有云 ! General Purpose Renter Economics! Large Resource Pool Expensive at scale! Limited control for optimization ! 3rd party dependency & trust Higher upfront capital outlay! IaaS architectural expertise needed! IaaS operational expertise needed PAGE: 业务的转变 12 TRADITIONAL WORKLOADS CLOUD WORKLOADS ●  Stateful VMs, application = VM ●  Big VMs: vCPU, vRAM, storage inside VM ●  Application SLA = SLA of VM ●  SLA requires to keep VMs highly available ●  Lifecycle measured in years ●  VMs scale up: add vCPU, vRAM, etc. ●  Applications not designed to tolerate failure of VMs ● Stateless VMs ● Small VMs: vCPU, vRAM, storage separate ● Application SLA <> SLA of any one VM ● SLA requires to create and destroy VMs where needed ● Lifecycle measured in hours to months ● Applications scale out: add more VMs ● Applications tolerate failure of VMs PAGE: OpenStack项⺫ • 每个项⺫都是⼀个 “top-level” OpenStack组件 • 每个项⺫都有⼀个 “Project Technical Lead” (PTL) • 每个项⺫都有不同的开发⼈员和设计⼈员 • 每个项⺫都拥有设计优良的公共 API • 除了 Horizon, 它是⼀个 Web UI • 其他的项⺫都提供 RESTfull API (JSON/HTTP) • 每个项⺫都有独⽴的数据库和隔离的持久化层 13 PAGE: 从 Cactus开始 14 PAGE: 到 Havana 15 PAGE: Icehouse 16 %QORWVG 0QXC +FGPVKV[ -G[UVQPG 1DLGEV5VQTCIG 5YKHV 0GVYQTMKPI 0GWVTQP $NQEM5VQTCIG %KPFGT &CVCDCUG5GTXKEG 6TQXG &CUJDQCTF *QTK\QP 1TEJGUVTCVKQP *GCV +OCIG5GTXKEG )NCPEG &GXUVCEM3# 6GNGOGVT[ %GKNQOGVGT &CVC2TQEGUUKPI 5CJCTC $CTG/GVCN +TQPKE -G[/CPCIGOGPV $CTDKECP 3WGWG5GTXKEG /CTEQPK Incubated Icehouse release PAGE: 发展趋势 • 功能解耦(如:把 Nova-Volume 独⽴成 Cinder) • 模块之间通过 API通信 • 抽象出通⽤性的 API/Infrastucture (如: Olso项⺫,原 名 openstack-common) • 模块化后端服务 (Backends) & 和可适配的外延 (drivers , everything’s pluggable) • IaaS 到 PaaS的衍⽣ : Heat/Savana/Trove • 分久必合 :Oslo 17 PAGE: OpenStack 项⺫之间关系 18 Neutron Cinder Nova Horizon Glance Swift Keystone Common UI Access Control 不是 OpenStack项⺫,但是 有助于理解 OpenStack组件 间的关系 不是 OpenStack项⺫,但是 有助于理解 OpenStack组件 间的关系 PAGE: OpenStack最佳实践 • 组件部署可以灵活选择 • 基本组件 • Nova • Keystone • Dashboard • Glance • 互斥场景 • 有些组件可能会相互冲突 19 PAGE: OpenStack 部署模型 20 Public Switch 10.10.0.0/24 ! CONTROLLER! ! KEYSTONE! NOVA-COMPONENTS! GLANCE! NEUTRON-SERVER! CINDER ! NETWORK NODE! ! OVS-AGENT! DHCP-AGENT! L3-AGENT! METADATA-AGENT! ! COMPUTE NODE! ! NOVA-COMPUTE! OVS-AGENT Private Switch 172.16.0.0/24 OVS OVS PAGE: TryStack.cn testbed 21 Network br-int eth1 br-eth1(veth) qr-c0bfa11f-ce(tag=1) qr-c0bfa11f-a1(tag=1) qr-c0bfa11f-e2(tag=1) VM eth1 br-int br-eth1(veth) qr-c0bfa11f-ae(tag=1) qr-c0bfa11f-fe(tag=1) br-ex qr-c0bfa11f-ca eth2 Router VLAN TAG compute node network node • VLAN • GRE • VXLAN • FLAT PAGE: What’s the best choice? 22 VLAN or GRE or other? controller1compute2compute1 switch internet test1 test2 test3 Neutron L3 GRE tunnel VLAN tag VLAN tag+physical GW PAGE: TryStack测试场景 23 controller1compute2compute1 switch internet test1 test2 test3 Neutron L3 1 2 compute1->compute2? controller1compute2compute1 switch internet test1 test2 test3 Neutron L3 1 2 test3->controller1(namespace)? controller1compute2compute1 switch internet test1 test2 test3 Neutron L3 1 test1->test2? controller1compute2compute1 switch internet test1 test2 test3 Neutron L3 test1->test3? 1 2 3 4 PAGE: TryStack测试数据 24 930Mbits/sec 935Mbits/sec 940Mbits/sec 945Mbits/sec 950Mbits/sec 5s 10s 15s 20s 25s 30s 946 943 941 942 940 942 947 940 941 941 941 937 946 943 941 941 943 940 VLAN GRE VLAN+ph_gw 880Mbits/sec 897.5Mbits/sec 915Mbits/sec 932.5Mbits/sec 950Mbits/sec 5s 10s 15s 20s 25s 30s 946 943 941 942 940 942 885 882 884 884 884 884 939 939 938 939 939 939 VLAN GRE VLAN+ph_gw 0Gbits/sec 2.25Gbits/sec 4.5Gbits/sec 6.75Gbits/sec 9Gbits/sec 5s 10s 15s 20s 25s 30s 7.69 8.67 8.09 7.79 7.78 7.88 6.85 6.05 6.90 6.42 6.06 7.13 6.63 8.12 8.20 8.20 7.13 6.89 VLAN GRE VLAN+ph_gw 870Mbits/sec 880Mbits/sec 890Mbits/sec 900Mbits/sec 910Mbits/sec 5s 10s 15s 20s 25s 30s 897 893 905 903 905 905 882 878 874 882 876 882 894 900 897 899 901 902 VLAN GRE VLAN+ph_gw PAGE: What’s the next? 25 Other Test Case 1>network node high cpu load 2>neutron use vxlan mode 3>complex networks env 4>and so on…… Some Suggestion 1>private cloud (vlan enough) 2>vlan + physical gateway maybe a good choice 3>Need DHCP service? 4>How to use Neutron in product env? PAGE: TryStack.cn testbed 26 ! CONTROLLER!! CINDER-API! CINDER-SCHEDULER! CINDER-VOLUME ! STORAGE01!! SOLARIS(ZFS)! ! STORAGE02!! SOLARIS(ZFS)! ! COMPUTE NODE!! Send/Receive zfs volume zfs driver ssh shell VM iscsi VM • LVM • GlusterFS • ZFS • CEPH • Other Storage PAGE: 挂载⼀个云硬盘给虚拟机 27 ! CONTROLLER ! CINDER-API CINDER-SCHEDULER CINDER-VOLUME ! STORAGE01 ! SOLARIS(ZFS) ! STORAGE02 ! SOLARIS(ZFS) ! COMPUTE NODE Send/Receive zfs volume zfs driver ssh shell VM iscsi VM 1.nova通过 api调⽤ cinder • 例如 :主机名、 iSCSI inititor名字、 FC WWPNS 2.cinder-api发送消息给 cinder-volume 3.manager检查合法性并调⽤存储 driver 4.volume driver配置客户端调⽤ • 例如 :计算节点允许访问云盘 5.volume driver返回接⼊信息 • 例如 :iSCSI iqn and portal, FC WWPN 6.计算节点根据返回信息连接存储 7.计算节点把设备和⽂件映射给 VM PAGE: TryStack.cn testbed 28 203.166.x.x 203.166.x.x sw-outside controller1 controller2 sw-inside compute1 compute2 compute3 compute4 compute5 storage1 stroage2 203.166.x.x 203.166.x.x 172.16.x.6/24 172.16.x.7/24 172.16.x.2/24 172.16.x.3/24 172.16.x.4/24 172.16.x.8/24 172.16.x.10/24 172.16.x.5/24 172.16.x.9/24 172.16.x.253/24 172.16.x.252/24 PAGE: TryStack.cn RA 29 Users Nginx/ HA Proxdy Nova API Keystone API Neutron API Cinder API Glance API Swift Proxy Compute Manager Volume Manager ZFS KVM Guest images Host Swift Storage PAGE: www.trystack.cn TryStack.cn参考架构 30 序号 主机名 配置 1 compute1 CPU: E5-2650 x 1 RAM: 8G x 6 HD: SAS 600G x 12/NIC: 4x1G + 2x10G 2 compute2 CPU: E5-2650 x 1 RAM: 8G x 6 HD: SAS 600G x 12/NIC: 4x1G + 2x10G 3 compute3 CPU: E5-2620 x 1 RAM: 4G x 8 HD: SATA 1T x 12/NIC: 4x1G 4 storage1 CPU: E5-2620 x 1 RAM: 4G x 8 HD: SATA 1T x 12 RAID: RMS25JB080/NIC: 4 x 1G 5 controller2 CPU: E5-2680 x 2 RAM: 4G x 16 HD: SAS 300G * 6/NIC: 4 x 1G + 2x 10G 6 controller1 CPU: E5-2680 x 2 RAM: 4G x 16 HD: SAS 300G * 6/NIC: 4 x 1G + 2 x 10G 7 compute4 CPU: E5-2650 x 1 RAM: 8G x 6 HD: SAS 600G x 12/NIC: 4x1G + 2x10G 8 storage2 CPU: E5-2620 x 1 RAM: 4G x 8 HD: SATA 1T x 12/NIC: 4x1G 9 compute5 CPU: E5-2650 x 2 RAM: 8G x 16 HD: SAS 300G x 6/NIC: 4x1G + 2x10G PAGE: www.trystack.cn Thanks 31 Learn OpenStack from TryStack.cn HELLO OpenStack 杜⽟杰( Ben) ! duyujie.dyj@gmail.com! http://www.linkedin.com/in/duyujie/ PAGE: TRYSTACK.CN简介 • 由 OpenStack中国社区发起的社区 项⺫ • 来⾃九州云、 Intel、 IBM、 曙光等⼚商的⽀持和赞助 • 获得来⾃ OpenStack中国社区专家的技术⽀持 • 有⾃⼰的⻔户 www.trystack.cn (⾯向社区 ) • 来⾃社区的虚拟运维团队、开发团队和测试团队 • 覆盖⺴络、虚拟化、存储等各种关键领域 的专家 • 第⼀时间上线的 Folsom、 Grizzly以及 Havana版本测 试平台,⺫前部分已升级到 Icehouse版本 32 PAGE: TRYSTACK.CN使命 • 覆盖全部 OpenStack组件的运⾏环境 • 开放最全⾯的 OpenStack API • 提供管理员、运维⼈员、开发⼈员的最佳实践 • 参考架构 • 来⾃不同⼚商的硬件设备 • 使⽤不同的 OpenStack部署 • 使⽤最新的 OpenStack代码 • TRYSTACK.CN团队会持续向社区贡献代码 • Bug fixes • 更多新功能的实现 • 与合作伙伴、⼚商合作, 并推进 OpenStack在中国产 品落地 33 PAGE: TRYSTACK.CN团队 • Advisors • Alan Clark( OpenStack 基⾦会主席) • Boris (Mirantis 联合创始⼈ ) • Cole Crawford (Open Compute基⾦会⾸席运营官 ) • 陈怀临 (弯曲评论创办⼈ ) • 陈绪(中国开源推进联盟副秘书⻓) • Joe Arnold (SwiftStack CEO) • 蒋清野(曾任 Eucalyptus中国区成就客户总监、天涯云计算部⻔总 监、 Sun⾼级经理) • Community Members • http://wiki.trystack.cn 34 PAGE: OpenStack Training 35 PAGE: TRYSTACK MEETUPS 1. Oct 2012, Grizzly Summit #San Diego www.slideshare.net/openstack/trystack-introfinalpdf 2. Dec 2012, ECUG #ChengDu http://www.slideshare.net/ben_duyujie/learn-openstack-from- trystackcn-folsom-in-practice 3. May 2013, open souce convention #Beijing http://bj-opensource.com/ 4. February 2013 Trystack 1st meetup #Nanjing www.openstack.org/blog/2013/02/trystack- cn-2013-first-meetup/ 5. February 2013, Trystack 2nd meetup #Shanghai http://www.openstack.org/blog/2013/02/ trystack-2nd-meetup-2013/ 6. May 2013 for HP http://www.slideshare.net/ben_duyujie/open-stack2-20130508 7. June 2013, Trystack 3rd meetup #Beijing in IBM http://www.openstack.org/blog/2013/06/trystack- cn-meetup-with-ibm-in-beijing/ 8. June 2013, Trystack 4th meetup #Shenzhen in Huawei 9. June 2013, 8th Open Source China Open World Forum(OCOW) #Beijing http://www.slideshare.net/ ben_duyujie/open-stack-2013 10.OpenStack's 3rd Birthday Celebration http://trystack.eventbrite.com/ 11.November 2013 Pycon China http://www.slideshare.net/ben_duyujie/how-to-master-openstack- in-2-hours 12.January 2014 for Huawei http://www.slideshare.net/ben_duyujie/community-leader-open- dayopenstack-community 13.April 2014 Docker&OpenStack Meetup http://www.slideshare.net/ben_duyujie/docker- openstack2014 14.June 2014 for EMC http://www.slideshare.net/ben_duyujie/hello-open-stack2014 36

下载文档,方便阅读与编辑

文档的实际排版效果,会与网站的显示效果略有不同!!

需要 8 金币 [ 分享文档获得金币 ] 0 人已下载

下载文档

相关文档