settingsLogin | Registersettings

[Openstack] Download file from swift extremely slow

0 votes

Hi experts

I finished the swift installation following the install guide(http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html), file upload is very fast, but file download is extremely slow, why ?

[root@controller admin]# time openstack object create container1 cirros-0.3.4-x8664-disk.img
+------------------------------+------------+----------------------------------+
| object | container | etag |
+------------------------------+------------+----------------------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+----------------------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]# time openstack object save container1 cirros-0.3.4-x86_64-disk.img
real 5m51.489s
user 5m48.172s
sys 0m2.094s

=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
asked Jan 4, 2017 in openstack by dongjh_at_ahope.com. (1,260 points)   3 5 5

21 Responses

0 votes

Anybody knows this ?
------------------ Original ------------------
From: "董建华"dongjh@ahope.com.cn
Date: Wed, Jan 4, 2017 04:59 PM
To: "openstack"openstack@lists.openstack.org;
Subject: [Openstack] Download file from swift extremely slow

Hi experts

I finished the swift installation following the install guide(http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html), file upload is very fast, but file download is extremely slow, why ?

[root@controller admin]# time openstack object create container1 cirros-0.3.4-x8664-disk.img
+------------------------------+------------+----------------------------------+
| object | container | etag |
+------------------------------+------------+----------------------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+----------------------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]# time openstack object save container1 cirros-0.3.4-x86_64-disk.img
real 5m51.489s
user 5m48.172s
sys 0m2.094s

=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

responded Jan 4, 2017 by dongjh_at_ahope.com. (1,260 points)   3 5 5
0 votes

Hi Dongijh,

It depends on your network speed .. in general upload and download speed is
based on internet service provider, check if the speed is same as per
internet provider.

you can check internet speed and compare based on internet provider
bandwidth

http://www.speedtest.net/

On Wed, Jan 4, 2017 at 2:29 PM, dongjh@ahope.com.cn dongjh@ahope.com.cn
wrote:

Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object-storage/draft/get_
started.html), file upload is very fast, but file download is extremely
slow, why ?

[root@controller admin]#
* time openstack object create container1 cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container | etag
|
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 |
ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#
* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack

--


Thanks&Regards,
Balu Mudhavathu
Phone No: 91 8184874772


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by Balu_Mudhavathu (320 points)   1 1
0 votes

Thank you for your response, but our environment is internal network,not internet or wan.
------------------ Original ------------------
From: "Balu Mudhavathu"balu.mudhavathu@gmail.com
Date: Wed, Jan 4, 2017 09:55 PM
To: "dongjh@ahope.com.cn"dongjh@ahope.com.cn;
Cc: "openstack"openstack@lists.openstack.org;
Subject: Re: [Openstack] Download file from swift extremely slow

Hi Dongijh,

It depends on your network speed .. in general upload and download speed is based on internet service provider, check if the speed is same as per internet provider.

you can check internet speed and compare based on internet provider bandwidth 

http://www.speedtest.net/

On Wed, Jan 4, 2017 at 2:29 PM, dongjh@ahope.com.cn dongjh@ahope.com.cn wrote:
Hi experts

I finished the swift installation following the install guide(http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html), file upload  is very fast, but file download is extremely slow, why ?

[root@controller admin]# time openstack object create container1 cirros-0.3.4-x8664-disk.img
+------------------------------+------------+----------------------------------+
| object                       | container  | etag                             |
+------------------------------+------------+----------------------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+----------------------------------+

real    0m3.807s
user    0m2.127s
sys     0m0.161s

[root@controller /]# time  openstack object save container1 cirros-0.3.4-x86_64-disk.img
real    5m51.489s
user    5m48.172s
sys     0m2.094s

=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to     : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

--


Thanks&Regards,
Balu Mudhavathu
Phone No: 91 8184874772
*******************************_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by dongjh_at_ahope.com. (1,260 points)   3 5 5
0 votes

Does doing openstack object save container1 cirros-0.3.4-x86_64-disk.img --debug give any additional information?

What about using the swift CLI? any difference in speed? swift download container1 cirros-0.3.4-x86_64-disk.img ?

On Wed, Jan 4, 2017 at 7:19 AM, wawayu dongjh@ahope.com.cn wrote:

Anybody knows this ?
------------------ Original ------------------
From: "董建华"dongjh@ahope.com.cn
Date: Wed, Jan 4, 2017 04:59 PM
To: "openstack"openstack@lists.openstack.org;
Subject: [Openstack] Download file from swift extremely slow
Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object-storage/draft/get_
started.html), file upload is very fast, but file download is extremely
slow, why ?

[root@controller admin]#* time openstack object create container1
cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container |
etag |
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 |
ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#* time openstack object save container1
cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by s.martinelli_at_gmai (5,460 points)   1 2 2
0 votes

The red lines hang several minutes... Swift CLI is fast...

[root@controller /]# . /demo-openrc
[root@controller /]# openstack object save container1 cirros-0.3.4-x8664-disk.img --debug
START with options: [u'object', u'save', u'container1', u'cirros-0.3.4-x86
64-disk.img', u'--debug']
options: Namespace(accesskey='', accesssecret='', access_token='', accesstokenendpoint='', accesstokentype='', authtype='', authurl='http://controller:5000/v3', authorizationcode='', cacert=None, cert='', clientid='', clientsecret='***', cloud='', consumerkey='', consumersecret='***', debug=True, defaultdomain='default', defaultdomainid='', defaultdomainname='', deferredhelp=False, discoveryendpoint='', domainid='', domainname='', endpoint='', identityprovider='', identityproviderurl='', insecure=None, interface='', key='', logfile=None, oldprofile=None, openidscope='', osbetacommand=False, oscomputeapiversion='', osdataprocessingapiversion='1.1', osdataprocessingurl='', osdnsapiversion='2', osidentityapiversion='3', osimageapiversion='2', oskeymanagerapiversion='1', osnetworkapiversion='', osobjectapiversion='', osorchestrationapiversion='1', osprojectid=None, osprojectname=None, osvolumeapiversion='', osworkflowapiversion='2', passcode='', password='', profile=None, projectdomainid='', projectdomainname='default', projectid='', projectname='demo', protocol='', redirecturi='', regionname='', timing=False, token='', trustid='', url='', userdomainid='', userdomainname='default', userid='', username='demo', verboselevel=3, verify=None)
Auth plugin password selected
auth
confighook(): {'authtype': 'password', 'betacommand': False, u'computeapiversion': u'2', u'orchestrationapiversion': '1', u'databaseapiversion': u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': 'http://controller:5000/v3', u'networkapiversion': u'2', u'message': u'', u'imageformat': u'qcow2', 'networks': [], u'imageapiversion': '2', 'verify': True, u'dnsapiversion': '2', u'objectstoreapiversion': u'1', 'username': 'demo', 'verboselevel': 3, 'regionname': '', 'apitimeout': None, u'baremetalapiversion': u'1', 'auth': {'userdomainname': 'default', 'projectname': 'demo', 'projectdomainname': 'default'}, 'defaultdomain': 'default', 'debug': True, u'imageapiusetasks': False, u'floatingipsource': u'neutron', 'key': None, 'timing': False, 'password': 'demo', 'cacert': None, u'keymanagerapiversion': '1', u'meteringapiversion': u'2', 'deferredhelp': False, u'identityapiversion': '3', 'workflowapiversion': '2', u'volumeapiversion': u'2', 'cert': None, u'secgroupsource': u'neutron', u'status': u'active', u'containerapiversion': u'1', u'interface': None, u'disablevendoragent': {}}
defaults: {u'authtype': 'password', u'status': u'active', u'computeapiversion': u'2', 'key': None, u'databaseapiversion': u'1.0', 'apitimeout': None, u'baremetalapiversion': u'1', u'imageapiversion': u'2', u'meteringapiversion': u'2', u'imageapiusetasks': False, u'floatingipsource': u'neutron', u'orchestrationapiversion': u'1', 'cacert': None, u'networkapiversion': u'2', u'message': u'', u'imageformat': u'qcow2', u'keymanagerapiversion': u'v1', 'verify': True, u'identityapiversion': u'2.0', u'volumeapiversion': u'2', 'cert': None, u'secgroupsource': u'neutron', u'containerapiversion': u'1', u'dnsapiversion': u'2', u'objectstoreapiversion': u'1', u'interface': None, u'disablevendoragent': {}}
cloud cfg: {'auth
type': 'password', 'betacommand': False, u'computeapiversion': u'2', 'key': None, u'databaseapiversion': u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': 'http://controller:5000/v3', u'networkapiversion': u'2', u'message': u'', u'imageformat': u'qcow2', 'networks': [], u'imageapiversion': '2', 'verify': True, u'dnsapiversion': '2', u'objectstoreapiversion': u'1', 'username': 'demo', 'verboselevel': 3, 'regionname': '', 'apitimeout': None, u'baremetalapiversion': u'1', 'auth': {'username': 'demo', 'projectname': 'demo', 'userdomainname': 'default', 'authurl': 'http://controller:5000/v3', 'password': '', 'projectdomainname': 'default'}, 'defaultdomain': 'default', u'containerapiversion': u'1', u'imageapiusetasks': False, u'floatingipsource': u'neutron', u'orchestrationapiversion': '1', 'timing': False, 'password': '', 'cacert': None, u'keymanagerapiversion': '1', u'meteringapiversion': u'2', 'deferredhelp': False, u'identityapiversion': '3', 'workflowapiversion': '2', u'volumeapiversion': u'2', 'cert': None, u'secgroupsource': u'neutron', u'status': u'active', 'debug': True, u'interface': None, u'disablevendoragent': {}}
compute API version 2, cmd group openstack.compute.v2
network API version 2, cmd group openstack.network.v2
image API version 2, cmd group openstack.image.v2
volume API version 2, cmd group openstack.volume.v2
identity API version 3, cmd group openstack.identity.v3
object
store API version 1, cmd group openstack.objectstore.v1
neutronclient API version 2, cmd group openstack.neutronclient.v2
dns API version 2, cmd group openstack.dns.v2
key
manager API version 1, cmd group openstack.keymanager.v1
workflow
engine API version 2, cmd group openstack.workflowengine.v2
orchestration API version 1, cmd group openstack.orchestration.v1
data
processing API version 1.1, cmd group openstack.dataprocessing.v1
Auth plugin password selected
auth
confighook(): {'authtype': 'password', 'betacommand': False, u'computeapiversion': u'2', u'orchestrationapiversion': '1', u'databaseapiversion': u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': 'http://controller:5000/v3', u'networkapiversion': u'2', u'message': u'', u'imageformat': u'qcow2', 'networks': [], u'imageapiversion': '2', 'verify': True, u'dnsapiversion': '2', u'objectstoreapiversion': u'1', 'username': 'demo', 'verboselevel': 3, 'regionname': '', 'apitimeout': None, u'baremetalapiversion': u'1', 'auth': {'userdomainname': 'default', 'projectname': 'demo', 'projectdomainname': 'default'}, 'defaultdomain': 'default', 'debug': True, u'imageapiusetasks': False, u'floatingipsource': u'neutron', 'key': None, 'timing': False, 'password': 'demo', 'cacert': None, u'keymanagerapiversion': '1', u'meteringapiversion': u'2', 'deferredhelp': False, u'identityapiversion': '3', 'workflowapiversion': '2', u'volumeapiversion': u'2', 'cert': None, u'secgroupsource': u'neutron', u'status': u'active', u'containerapiversion': u'1', u'interface': None, u'disablevendoragent': {}}
Auth plugin password selected
authconfighook(): {'authtype': 'password', 'betacommand': False, u'computeapiversion': u'2', u'orchestrationapiversion': '1', u'databaseapiversion': u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': 'http://controller:5000/v3', u'networkapiversion': u'2', u'message': u'', u'imageformat': u'qcow2', 'networks': [], u'imageapiversion': '2', 'verify': True, u'dnsapiversion': '2', u'objectstoreapiversion': u'1', 'username': 'demo', 'verboselevel': 3, 'regionname': '', 'apitimeout': None, u'baremetalapiversion': u'1', 'auth': {'userdomainname': 'default', 'projectname': 'demo', 'projectdomainname': 'default'}, 'defaultdomain': 'default', 'debug': True, u'imageapiusetasks': False, u'floatingipsource': u'neutron', 'key': None, 'timing': False, 'password': 'demo', 'cacert': None, u'keymanagerapiversion': '1', u'meteringapiversion': u'2', 'deferredhelp': False, u'identityapiversion': '3', 'workflowapiversion': '2', u'volumeapiversion': u'2', 'cert': None, u'secgroupsource': u'neutron', u'status': u'active', u'containerapiversion': u'1', u'interface': None, u'disablevendoragent': {}}
command: object save -> openstackclient.object.v1.object.SaveObject
Using auth plugin: password
Using parameters {'username': 'demo', 'project
name': 'demo', 'userdomainname': 'default', 'authurl': 'http://controller:5000/v3', 'password': '***', 'projectdomainname': 'default'}
Get auth
ref
REQ: curl -g -i -X GET http://controller:5000/v3 -H "Accept: application/json" -H "User-Agent: osc-lib keystoneauth1/2.12.2 python-requests/2.10.0 CPython/2.7.5"
Starting new HTTP connection (1): controller
"GET /v3 HTTP/1.1" 200 249
RESP: [200] Date: Wed, 04 Jan 2017 14:16:47 GMT Server: Apache/2.4.6 (CentOS) mod_wsgi/3.4 Python/2.7.5 Vary: X-Auth-Token x-openstack-request-id: req-e87a77cb-ecf2-49a8-9981-82abf8d1505d Content-Length: 249 Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: application/json
RESP BODY: {"version": {"status": "stable", "updated": "2016-10-06T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.7", "links": [{"href": "http://controller:5000/v3/", "rel": "self"}]}}

Making authentication request to http://controller:5000/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 4748
{"token": {"isdomain": false, "methods": ["password"], "roles": [{"id": "f3b5edbdd90a46249c506fd725bea7cc", "name": "user"}], "expiresat": "2017-01-04T15:16:47.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6fc70c831270448296c9c25361769cf5", "name": "demo"}, "catalog": [{"endpoints": [{"url": "http://controller:35357/v3/", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "6748fb0f735e49fea7af7197f5b9fd2e"}, {"url": "http://controller:35357/v3/", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "705880eae3724ad4a7e87ec73abb9f4a"}, {"url": "http://controller:5000/v3/", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "eef092ba38354716a07a8663a8799d3b"}], "type": "identity", "id": "0d2367d19f2249a28bacb407a767f5ea", "name": "keystone"}, {"endpoints": [{"url": "http://controller:9292", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "72cd4dce5fda472c9ee4ccea1763bdd8"}, {"url": "http://controller:9292", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "7f49508e41a7449286bbae22ad3e1009"}, {"url": "http://controller:9292", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "a39ad51dd9044bbbaa15d9b5bb408d63"}], "type": "image", "id": "5aa73a7985914d019e255ba4735c8050", "name": "glance"}, {"endpoints": [{"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "94430dcb24fa4a67866b9211b115ba8d"}, {"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "9679385e8bf646c195b4387d07e39813"}, {"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "b121154b31f74c8f8d1fc45b1f2cf0aa"}], "type": "volume", "id": "74ce6a390216440db29e6ea10f6b91ff", "name": "cinder"}, {"endpoints": [{"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "2e1e0df066594307a01129e260de4347"}, {"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "84fb72a51bc54856a8fc046fd5ae9831"}, {"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "ad77ed7ffd124197a268563a26e18a7c"}], "type": "compute", "id": "83b496cc41eb455ea1cd871b86d76d09", "name": "nova"}, {"endpoints": [{"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "06fb7274890f4e5580aedaa137415b75"}, {"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "660a72066792425392e615b41180eca7"}, {"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "f13771cf78474a0a90eada29257cfb40"}], "type": "volumev2", "id": "897dd05cadf2484f9085f21670aa485a", "name": "cinderv2"}, {"endpoints": [{"url": "http://controller:8080/v1", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "50905aefc490422d8590891af65da487"}, {"url": "http://controller:8080/v1/AUTH_6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "b7106e3ae36b4f8292169a859754a1c9"}, {"url": "http://controller:8080/v1/AUTH_6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "fa222e78266c4f70b8a8267ecc18ef4a"}], "type": "object-store", "id": "d85e6bb55ecf431c8a4693f24c2750df", "name": "swift"}, {"endpoints": [{"url": "http://controller:9696", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "0edaf79aac3f466daa38363e978198ac"}, {"url": "http://controller:9696", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "2bf3f0355f9a448985d1a53cba578e55"}, {"url": "http://controller:9696", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "6d54619f9e72469f92823ab1bad70353"}], "type": "network", "id": "fc04a1ebb8944c709942dd686c42fe94", "name": "neutron"}], "user": {"domain": {"id": "default", "name": "Default"}, "id": "d8acb30b89ed44bea9568d556b54b8d3", "name": "demo"}, "auditids": ["5vRBbs5HSHqKOnZ-9kC2Jw"], "issuedat": "2017-01-04T14:16:47.000000Z"}}
run(Namespace(container=u'container1', file=None, object=u'cirros-0.3.4-x86
64-disk.img'))
Making authentication request to http://controller:5000/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 4748
{"token": {"isdomain": false, "methods": ["password"], "roles": [{"id": "f3b5edbdd90a46249c506fd725bea7cc", "name": "user"}], "expiresat": "2017-01-04T15:16:47.000000Z", "project": {"domain": {"id": "default", "name": "Default"}, "id": "6fc70c831270448296c9c25361769cf5", "name": "demo"}, "catalog": [{"endpoints": [{"url": "http://controller:35357/v3/", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "6748fb0f735e49fea7af7197f5b9fd2e"}, {"url": "http://controller:35357/v3/", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "705880eae3724ad4a7e87ec73abb9f4a"}, {"url": "http://controller:5000/v3/", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "eef092ba38354716a07a8663a8799d3b"}], "type": "identity", "id": "0d2367d19f2249a28bacb407a767f5ea", "name": "keystone"}, {"endpoints": [{"url": "http://controller:9292", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "72cd4dce5fda472c9ee4ccea1763bdd8"}, {"url": "http://controller:9292", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "7f49508e41a7449286bbae22ad3e1009"}, {"url": "http://controller:9292", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "a39ad51dd9044bbbaa15d9b5bb408d63"}], "type": "image", "id": "5aa73a7985914d019e255ba4735c8050", "name": "glance"}, {"endpoints": [{"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "94430dcb24fa4a67866b9211b115ba8d"}, {"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "9679385e8bf646c195b4387d07e39813"}, {"url": "http://controller:8776/v1/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "b121154b31f74c8f8d1fc45b1f2cf0aa"}], "type": "volume", "id": "74ce6a390216440db29e6ea10f6b91ff", "name": "cinder"}, {"endpoints": [{"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "2e1e0df066594307a01129e260de4347"}, {"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "84fb72a51bc54856a8fc046fd5ae9831"}, {"url": "http://controller:8774/v2.1/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "ad77ed7ffd124197a268563a26e18a7c"}], "type": "compute", "id": "83b496cc41eb455ea1cd871b86d76d09", "name": "nova"}, {"endpoints": [{"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "06fb7274890f4e5580aedaa137415b75"}, {"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "660a72066792425392e615b41180eca7"}, {"url": "http://controller:8776/v2/6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "f13771cf78474a0a90eada29257cfb40"}], "type": "volumev2", "id": "897dd05cadf2484f9085f21670aa485a", "name": "cinderv2"}, {"endpoints": [{"url": "http://controller:8080/v1", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "50905aefc490422d8590891af65da487"}, {"url": "http://controller:8080/v1/AUTH_6fc70c831270448296c9c25361769cf5", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "b7106e3ae36b4f8292169a859754a1c9"}, {"url": "http://controller:8080/v1/AUTH_6fc70c831270448296c9c25361769cf5", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "fa222e78266c4f70b8a8267ecc18ef4a"}], "type": "object-store", "id": "d85e6bb55ecf431c8a4693f24c2750df", "name": "swift"}, {"endpoints": [{"url": "http://controller:9696", "interface": "admin", "region": "RegionOne", "regionid": "RegionOne", "id": "0edaf79aac3f466daa38363e978198ac"}, {"url": "http://controller:9696", "interface": "internal", "region": "RegionOne", "regionid": "RegionOne", "id": "2bf3f0355f9a448985d1a53cba578e55"}, {"url": "http://controller:9696", "interface": "public", "region": "RegionOne", "regionid": "RegionOne", "id": "6d54619f9e72469f92823ab1bad70353"}], "type": "network", "id": "fc04a1ebb8944c709942dd686c42fe94", "name": "neutron"}], "user": {"domain": {"id": "default", "name": "Default"}, "id": "d8acb30b89ed44bea9568d556b54b8d3", "name": "demo"}, "auditids": ["sLXGcKSWRpii4eOfA7MKBg"], "issuedat": "2017-01-04T14:16:47.000000Z"}}
REQ: curl -g -i -X GET http://controller:8080/v1/AUTH_6fc70c831270448296c9c25361769cf5/container1/cirros-0.3.4-x86_64-disk.img -H "User-Agent: osc-lib keystoneauth1/2.12.2 python-requests/2.10.0 CPython/2.7.5" -H "X-Auth-Token: {SHA1}222c5064b2a2330eca9637708a40dffecb8bae4c"
Starting new HTTP connection (1): controller
"GET /v1/AUTH
6fc70c831270448296c9c25361769cf5/container1/cirros-0.3.4-x8664-disk.img HTTP/1.1" 200 13287936
RESP: [200] Content-Length: 13287936 Accept-Ranges: bytes Last-Modified: Wed, 04 Jan 2017 08:58:56 GMT Etag: ee1eca47dc88f4879d8a229cc70a07c6 X-Timestamp: 1483520335.80174 Content-Type: application/octet-stream X-Trans-Id: tx559e7d3d28aa49c995467-00586d03cf Date: Wed, 04 Jan 2017 14:16:48 GMT Connection: keep-alive
RESP BODY: QFI�s�
&N�JT� F �BU�@�@@�A��U�$wK@?T���I@<�J@�jU���Q�(Y
�ZL
D�
@
�U
�g�YK���I@$DQ@o�O�1G@p_A@�rD���\������D��/F@R3�K���F� �K�V�Q��t���▒▒���R?mE��WG@ D@ ;�D@ \�D��D� �WA K@ �F�!+�G�!a�B�!�2B�!��C�!�tE@!��G�"
yI�"HlN"��H�#�@�#JAJ@#N�N@#�{H�$wK$YJ�$�6I�%7F%TI�%��D�%�R@%��Q@&��Q�'BN�'��J(�J(�F�(��F�(�vD�)cC)B�M)[K�)��L�*IM*��H�*�*I+1�F@+y�S@+��I�,D�S@,�ZI@-,qE�-vrA@-��N@3nM�3�}M�4N�M@4�L�5%J5��B�5��O�5�#�7�8�9�:�;�<�=�>�?�@�A�B�C�D�E�F�G�H�I�J�K^�L_�L�#_�M��YN��^�O���Q�R�S�T�UY@VSV��T�WbPX

time swift download container1 cirros-0.3.4-x86_64-disk.img

cirros-0.3.4-x86_64-disk.img [auth 1.810s, headers 2.583s, total 2.693s, 15.060 MB/s]

real 0m3.298s
user 0m2.035s
sys 0m0.189s

=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn

From: Steve Martinelli
Date: 2017-01-04 22:05
To: wawayu
CC: openstack
Subject: Re: [Openstack] Download file from swift extremely slow
Does doing openstack object save container1 cirros-0.3.4-x86_64-disk.img --debug give any additional information?

What about using the swift CLI? any difference in speed? swift download container1 cirros-0.3.4-x86_64-disk.img ?

On Wed, Jan 4, 2017 at 7:19 AM, wawayu dongjh@ahope.com.cn wrote:
Anybody knows this ?
------------------ Original ------------------
From: "董建华"dongjh@ahope.com.cn
Date: Wed, Jan 4, 2017 04:59 PM
To: "openstack"openstack@lists.openstack.org;
Subject: [Openstack] Download file from swift extremely slow
Hi experts

I finished the swift installation following the install guide(http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html), file upload is very fast, but file download is extremely slow, why ?

[root@controller admin]# time openstack object create container1 cirros-0.3.4-x8664-disk.img
+------------------------------+------------+----------------------------------+
| object | container | etag |
+------------------------------+------------+----------------------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+----------------------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]# time openstack object save container1 cirros-0.3.4-x86_64-disk.img
real 5m51.489s
user 5m48.172s
sys 0m2.094s

=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by dongjh_at_ahope.com. (1,260 points)   3 5 5
0 votes

This isn't that surprising to me, the CLI support for objects / containers
in OpenStackClient is pretty basic.

I wonder if the swift CLI is doing something different (threading / looking
at different endpoint types). Feel free to open a bug against
OpenStackClient at: https://bugs.launchpad.net/python-openstackclient

On Wed, Jan 4, 2017 at 9:38 AM, dongjh@ahope.com.cn dongjh@ahope.com.cn
wrote:

The red lines hang several minutes... Swift CLI is fast...

[root@controller /]# . /demo-openrc
[root@controller /]# openstack object save container1 cirros-0.3.4-x86_
64-disk.img --debug
START with options: [u'object', u'save', u'container1', u'
cirros-0.3.4-x8664-disk.img', u'--debug']
options: Namespace(access
key='', accesssecret='***',
access
token='', accesstokenendpoint='', access_
tokentype='', authtype='', authurl='http://controller:5000/v3
', authorization
code='', cacert=None, cert='',
clientid='', clientsecret='
', cloud='', consumerkey=''
, consumer
secret='', debug=True, defaultdomain='
default', default
domainid='', defaultdomainname='',
deferred
help=False, discoveryendpoint='', domainid='', domainname='',
endpoint='', identity
provider='', identityproviderurl='', insecure=
None, interface='', key='', logfile=None, oldprofile=
None, openidscope='', osbetacommand=False, os
computeapiversion='', osdataprocessingapiversion='
1.1', osdataprocessingurl='', osdnsapiversion='2', os_
identityapiversion='3', osimageapiversion='2', oskey_
managerapiversion='1', osnetworkapiversion='', os
objectapiversion='', osorchestrationapiversion='1',
os
projectid=None, osprojectname=None, osvolume_
apiversion='', osworkflowapiversion='2', passcode='',
password='
', profile=None, projectdomainid='', project_
domainname='default', projectid='', projectname='
demo', protocol='', redirect
uri='', regionname='',
timing=False, token='***', trust
id='', url='', user_
domainid='', userdomainname='default', userid='',
username='demo', verboselevel=3, verify=None)
Auth plugin password selected
auth
confighook(): {'authtype': 'password', 'beta_
command': False, u'computeapiversion': u'2', u'
orchestrationapiversion': '1', u'databaseapiversion':
u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': '
http://controller:5000/v3', u'networkapiversion': u'2', u'
message': u'', u'imageformat': u'qcow2', 'networks': [], u'
image
apiversion': '2', 'verify': True, u'dnsapi_
version': '2', u'objectstoreapiversion': u'1', 'username'
: 'demo', 'verbose
level': 3, 'regionname': '', 'api
timeout': None, u'baremetalapiversion': u'1', 'auth': {'
userdomainname': 'default', 'projectname': 'demo', '
project
domainname': 'default'}, 'defaultdomain': '
default', 'debug': True, u'imageapiusetasks': False,
u'floating
ipsource': u'neutron', 'key': None, '
timing': False, 'password': 'demo', 'cacert': None, u'key

managerapiversion': '1', u'meteringapiversion': u'2', '
deferredhelp': False, u'identityapiversion': '3', '
workflow
apiversion': '2', u'volumeapiversion': u'2', '
cert': None, u'secgroup
source': u'neutron', u'status'
: u'active', u'containerapiversion': u'1', u'interface':
None, u'disablevendoragent': {}}
defaults: {u'authtype': 'password', u'status': u'active', u'computeapi_
version': u'2', 'key': None, u'databaseapiversion': u'1.
0', 'apitimeout': None, u'baremetalapiversion': u'1',
u'image
apiversion': u'2', u'meteringapiversion': u'2',
u'image
apiusetasks': False, u'floatingipsource': u'
neutron', u'orchestrationapiversion': u'1', 'cacert':
None, u'networkapiversion': u'2', u'message': u'', u'
imageformat': u'qcow2', u'keymanagerapiversion': u'
v1', 'verify': True, u'identityapiversion': u'2.0',
u'volumeapiversion': u'2', 'cert': None, u'secgroup_
source': u'neutron', u'containerapiversion': u'1',
u'dnsapiversion': u'2', u'objectstoreapiversion': u'
1', u'interface': None, u'disable
vendoragent': {}}
cloud cfg: {'auth
type': 'password', 'betacommand':
False, u'compute
apiversion': u'2', 'key': None, u'
database
apiversion': u'1.0', 'dataprocessingapiversion'
: '1.1', 'authurl': 'http://controller:5000/v3', u'
network
apiversion': u'2', u'message': u'', u'imageformat'
: u'qcow2', 'networks': [], u'imageapiversion': '2', '
verify': True, u'dnsapiversion': '2', u'objectstore
apiversion': u'1', 'username': 'demo', 'verboselevel': 3,
'regionname': '', 'apitimeout': None, u'baremetal_
apiversion': u'1', 'auth': {'username': 'demo', 'project
name': 'demo', 'userdomainname': 'default', 'authurl': '
http://controller:5000/v3', 'password': '***', 'project

domainname': 'default'}, 'defaultdomain': 'default', u'
containerapiversion': u'1', u'imageapiusetasks': False,
u'floating
ipsource': u'neutron', u'orchestrationapi_
version': '1', 'timing': False, 'password': '', '
cacert': None, u'keymanagerapiversion': '1', u'metering
apiversion': u'2', 'deferredhelp': False, u'identityapi
version': '3', 'workflowapiversion': '2', u'volumeapi
version': u'2', 'cert': None, u'secgroupsource': u'neutron'
, u'status': u'active', 'debug': True, u'interface':
None, u'disable
vendoragent': {}}
compute API version 2, cmd group openstack.compute.v2
network API version 2, cmd group openstack.network.v2
image API version 2, cmd group openstack.image.v2
volume API version 2, cmd group openstack.volume.v2
identity API version 3, cmd group openstack.identity.v3
object
store API version 1, cmd group openstack.objectstore.v1
neutronclient API version 2, cmd group openstack.neutronclient.v2
dns API version 2, cmd group openstack.dns.v2
key
manager API version 1, cmd group openstack.keymanager.v1
workflow
engine API version 2, cmd group openstack.workflowengine.v2
orchestration API version 1, cmd group openstack.orchestration.v1
data
processing API version 1.1, cmd group openstack.dataprocessing.v1
Auth plugin password selected
auth
confighook(): {'authtype': 'password', 'beta_
command': False, u'computeapiversion': u'2', u'
orchestrationapiversion': '1', u'databaseapiversion':
u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': '
http://controller:5000/v3', u'networkapiversion': u'2', u'
message': u'', u'imageformat': u'qcow2', 'networks': [], u'
image
apiversion': '2', 'verify': True, u'dnsapi_
version': '2', u'objectstoreapiversion': u'1', 'username'
: 'demo', 'verbose
level': 3, 'regionname': '', 'api
timeout': None, u'baremetalapiversion': u'1', 'auth': {'
userdomainname': 'default', 'projectname': 'demo', '
project
domainname': 'default'}, 'defaultdomain': '
default', 'debug': True, u'imageapiusetasks': False,
u'floating
ipsource': u'neutron', 'key': None, '
timing': False, 'password': 'demo', 'cacert': None, u'key

managerapiversion': '1', u'meteringapiversion': u'2', '
deferredhelp': False, u'identityapiversion': '3', '
workflow
apiversion': '2', u'volumeapiversion': u'2', '
cert': None, u'secgroup
source': u'neutron', u'status'
: u'active', u'containerapiversion': u'1', u'interface':
None, u'disablevendoragent': {}}
Auth plugin password selected
authconfighook(): {'authtype': 'password', 'beta
command': False, u'computeapiversion': u'2', u'
orchestrationapiversion': '1', u'databaseapiversion':
u'1.0', 'dataprocessingapiversion': '1.1', 'authurl': '
http://controller:5000/v3', u'networkapiversion': u'2', u'
message': u'', u'imageformat': u'qcow2', 'networks': [], u'
image
apiversion': '2', 'verify': True, u'dnsapi_
version': '2', u'objectstoreapiversion': u'1', 'username'
: 'demo', 'verbose
level': 3, 'regionname': '', 'api
timeout': None, u'baremetalapiversion': u'1', 'auth': {'
userdomainname': 'default', 'projectname': 'demo', '
project
domainname': 'default'}, 'defaultdomain': '
default', 'debug': True, u'imageapiusetasks': False,
u'floating
ipsource': u'neutron', 'key': None, '
timing': False, 'password': 'demo', 'cacert': None, u'key

managerapiversion': '1', u'meteringapiversion': u'2', '
deferredhelp': False, u'identityapiversion': '3', '
workflow
apiversion': '2', u'volumeapiversion': u'2', '
cert': None, u'secgroup
source': u'neutron', u'status'
: u'active', u'containerapiversion': u'1', u'interface':
None, u'disablevendoragent': {}}
command: object save -> openstackclient.object.v1.object.SaveObject
Using auth plugin: password
Using parameters {'username': 'demo', 'projectname': 'demo'
, 'user
domainname': 'default', 'authurl': 'http://controller:5000/v3
', 'password': '
', 'projectdomainname': 'default'}
Get authref
REQ: curl -g -i -X GET http://controller:5000/v3 -H "Accept:
application/json" -H "User-Agent: osc-lib keystoneauth1/
2.12.2 python-requests/2.10.0 CPython/2.7.5"
Starting new HTTP connection (1): controller
"GET /v3 HTTP/1.1" 200 249
RESP: [200] Date: Wed, 04 Jan 2017 14:16:47 GMT Server:
Apache/2.4.6 (CentOS) mod
wsgi/3.4 Python/2.7.5 Vary: X-
Auth-Token x-openstack-request-id: req-e87a77cb-ecf2-
49a8-9981-82abf8d1505d Content-Length: 249 Keep-Alive: timeout=5, max=100
Connection: Keep-Alive Content-Type: application/json
RESP BODY: {"version": {"status": "stable", "updated":
"2016-10-06T00:00:00Z", "media-types": [{"base": "
application/json", "type": "application/vnd.openstack.
identity-v3+json"}], "id": "v3.7", "links": [{"href": "htt
p://controller:5000/v3/", "rel": "self"}]}}

Making authentication request to http://controller:5000/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 4748
{"token": {"isdomain": false, "methods": ["password"], "roles": [{"id": "
f3b5edbdd90a46249c506fd725bea7cc", "name": "user"}], "
expires
at": "2017-01-04T15:16:47.000000Z", "project": {"
domain": {"id": "default", "name": "Default"}, "id": "
6fc70c831270448296c9c25361769cf5", "name": "demo"}, "
catalog": [{"endpoints": [{"url": "http://controller:35357/v3/
", "interface": "internal", "region": "RegionOne", "regionid": "
RegionOne", "id": "6748fb0f735e49fea7af7197f5b9fd2e"}, {"url": "http://
controller:35357/v3/", "interface": "admin", "region":
"RegionOne", "region
id": "RegionOne", "id": "
705880eae3724ad4a7e87ec73abb9f4a"}, {"url": "http://controller:5000/v3/
", "interface": "public", "region": "RegionOne", "regionid": "
RegionOne", "id": "eef092ba38354716a07a8663a8799d
3b"}], "type": "identity", "id": "0d2367d19f2249a28bacb407a767f5
ea", "name": "keystone"}, {"endpoints": [{"url": "http://controller:9292
", "interface": "internal", "region": "RegionOne", "region
id": "
RegionOne", "id": "72cd4dce5fda472c9ee4ccea1763bdd8"}, {"url": "http://
controller:9292", "interface": "admin", "region": "
RegionOne", "regionid": "RegionOne", "id": "
7f49508e41a7449286bbae22ad3e1009"}, {"url": "http://controller:9292
", "interface": "public", "region": "RegionOne", "region
id": "
RegionOne", "id": "a39ad51dd9044bbbaa15d9b5bb408d
63"}], "type": "image", "id": "5aa73a7985914d019e255ba4735c80
50", "name": "glance"}, {"endpoints": [{"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
94430dcb24fa4a67866b9211b115ba8d"}, {"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "region
id": "RegionOne", "id": "
9679385e8bf646c195b4387d07e39813"}, {"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "regionid": "RegionOne", "id": "
b121154b31f74c8f8d1fc45b1f2cf0aa"}], "type": "volume", "id": "
74ce6a390216440db29e6ea10f6b91ff", "name": "cinder"}, {"
endpoints": [{"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "region
id": "RegionOne", "id": "
2e1e0df066594307a01129e260de4347"}, {"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
84fb72a51bc54856a8fc046fd5ae9831"}, {"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "region
id": "RegionOne", "id": "
ad77ed7ffd124197a268563a26e18a7c"}], "type": "compute", "id": "
83b496cc41eb455ea1cd871b86d76d09", "name": "nova"}, {"
endpoints": [{"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
06fb7274890f4e5580aedaa137415b75"}, {"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "region
id": "RegionOne", "id": "
660a72066792425392e615b41180eca7"}, {"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "regionid": "RegionOne", "id": "
f13771cf78474a0a90eada29257cfb40"}], "type": "volumev2", "id": "
897dd05cadf2484f9085f21670aa485a", "name": "cinderv2"}, {"
endpoints": [{"url": "http://controller:8080/v1", "
interface": "admin", "region": "RegionOne", "region
id": "
RegionOne", "id": "50905aefc490422d8590891af65da487"}, {"url": "http://
controller:8080/v1/AUTH6fc70c831270448296c9c25361769cf5
", "interface": "internal", "region": "RegionOne", "
region
id": "RegionOne", "id": "b7106e3ae36b4f8292169a859754a1
c9"}, {"url": "http://controller:8080/v1/AUTH_
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "regionid": "RegionOne", "id": "
fa222e78266c4f70b8a8267ecc18ef4a"}], "type": "object-store", "id": "
d85e6bb55ecf431c8a4693f24c2750df", "name": "swift"}, {"
endpoints": [{"url": "http://controller:9696", "interface":
"admin", "region": "RegionOne", "region
id": "RegionOne", "id": "
0edaf79aac3f466daa38363e978198ac"}, {"url": "http://controller:9696
", "interface": "internal", "region": "RegionOne", "regionid": "
RegionOne", "id": "2bf3f0355f9a448985d1a53cba578e55"}, {"url": "http://
controller:9696", "interface": "public", "region": "
RegionOne", "region
id": "RegionOne", "id": "
6d54619f9e72469f92823ab1bad70353"}], "type": "network", "id": "
fc04a1ebb8944c709942dd686c42fe94", "name": "neutron"}], "
user": {"domain": {"id": "default", "name": "Default"}, "id": "
d8acb30b89ed44bea9568d556b54b8d3", "name": "demo"}, "audit_
ids": ["5vRBbs5HSHqKOnZ-9kC2Jw"], "issuedat": "2017-
01-04T14:16:47.000000Z"}}
run(Namespace(container=u'container1', file=None,
object=u'cirros-0.3.4-x86
64-disk.img'))
Making authentication request to http://controller:5000/v3/auth/tokens
"POST /v3/auth/tokens HTTP/1.1" 201 4748
{"token": {"isdomain": false, "methods": ["password"], "roles": [{"id": "
f3b5edbdd90a46249c506fd725bea7cc", "name": "user"}], "
expires
at": "2017-01-04T15:16:47.000000Z", "project": {"
domain": {"id": "default", "name": "Default"}, "id": "
6fc70c831270448296c9c25361769cf5", "name": "demo"}, "
catalog": [{"endpoints": [{"url": "http://controller:35357/v3/
", "interface": "internal", "region": "RegionOne", "regionid": "
RegionOne", "id": "6748fb0f735e49fea7af7197f5b9fd2e"}, {"url": "http://
controller:35357/v3/", "interface": "admin", "region":
"RegionOne", "region
id": "RegionOne", "id": "
705880eae3724ad4a7e87ec73abb9f4a"}, {"url": "http://controller:5000/v3/
", "interface": "public", "region": "RegionOne", "regionid": "
RegionOne", "id": "eef092ba38354716a07a8663a8799d
3b"}], "type": "identity", "id": "0d2367d19f2249a28bacb407a767f5
ea", "name": "keystone"}, {"endpoints": [{"url": "http://controller:9292
", "interface": "internal", "region": "RegionOne", "region
id": "
RegionOne", "id": "72cd4dce5fda472c9ee4ccea1763bdd8"}, {"url": "http://
controller:9292", "interface": "admin", "region": "
RegionOne", "regionid": "RegionOne", "id": "
7f49508e41a7449286bbae22ad3e1009"}, {"url": "http://controller:9292
", "interface": "public", "region": "RegionOne", "region
id": "
RegionOne", "id": "a39ad51dd9044bbbaa15d9b5bb408d
63"}], "type": "image", "id": "5aa73a7985914d019e255ba4735c80
50", "name": "glance"}, {"endpoints": [{"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
94430dcb24fa4a67866b9211b115ba8d"}, {"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "region
id": "RegionOne", "id": "
9679385e8bf646c195b4387d07e39813"}, {"url": "http://controller:8776/v1/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "regionid": "RegionOne", "id": "
b121154b31f74c8f8d1fc45b1f2cf0aa"}], "type": "volume", "id": "
74ce6a390216440db29e6ea10f6b91ff", "name": "cinder"}, {"
endpoints": [{"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "region
id": "RegionOne", "id": "
2e1e0df066594307a01129e260de4347"}, {"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
84fb72a51bc54856a8fc046fd5ae9831"}, {"url": "http://controller:8774/v2.1/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "region
id": "RegionOne", "id": "
ad77ed7ffd124197a268563a26e18a7c"}], "type": "compute", "id": "
83b496cc41eb455ea1cd871b86d76d09", "name": "nova"}, {"
endpoints": [{"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "admin", "
region": "RegionOne", "regionid": "RegionOne", "id": "
06fb7274890f4e5580aedaa137415b75"}, {"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "internal",
"region": "RegionOne", "region
id": "RegionOne", "id": "
660a72066792425392e615b41180eca7"}, {"url": "http://controller:8776/v2/
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "regionid": "RegionOne", "id": "
f13771cf78474a0a90eada29257cfb40"}], "type": "volumev2", "id": "
897dd05cadf2484f9085f21670aa485a", "name": "cinderv2"}, {"
endpoints": [{"url": "http://controller:8080/v1", "
interface": "admin", "region": "RegionOne", "region
id": "
RegionOne", "id": "50905aefc490422d8590891af65da487"}, {"url": "http://
controller:8080/v1/AUTH6fc70c831270448296c9c25361769cf5
", "interface": "internal", "region": "RegionOne", "
region
id": "RegionOne", "id": "b7106e3ae36b4f8292169a859754a1
c9"}, {"url": "http://controller:8080/v1/AUTH_
6fc70c831270448296c9c25361769cf5", "interface": "public", "
region": "RegionOne", "regionid": "RegionOne", "id": "
fa222e78266c4f70b8a8267ecc18ef4a"}], "type": "object-store", "id": "
d85e6bb55ecf431c8a4693f24c2750df", "name": "swift"}, {"
endpoints": [{"url": "http://controller:9696", "interface":
"admin", "region": "RegionOne", "region
id": "RegionOne", "id": "
0edaf79aac3f466daa38363e978198ac"}, {"url": "http://controller:9696
", "interface": "internal", "region": "RegionOne", "regionid": "
RegionOne", "id": "2bf3f0355f9a448985d1a53cba578e55"}, {"url": "http://
controller:9696", "interface": "public", "region": "
RegionOne", "region
id": "RegionOne", "id": "
6d54619f9e72469f92823ab1bad70353"}], "type": "network", "id": "
fc04a1ebb8944c709942dd686c42fe94", "name": "neutron"}], "
user": {"domain": {"id": "default", "name": "Default"}, "id": "
d8acb30b89ed44bea9568d556b54b8d3", "name": "demo"}, "auditids": ["
sLXGcKSWRpii4eOfA7MKBg"], "issued
at": "2017-01-04T14:16:47.000000Z"}}
REQ: curl -g -i -X GET http://controller:8080/v1/AUTH_
6fc70c831270448296c9c25361769cf5/container1/cirros-0.3.4-x8664-disk.img
-H "User-Agent: osc-lib keystoneauth1/2.12.2 python-requests/2.10.0
CPython/2.7.5" -H "X-Auth-Token: {SHA1}222c5064b2a2330eca9637708a40df
fecb8bae4c"
Starting new HTTP connection (1): controller
"GET /v1/AUTH
6fc70c831270448296c9c25361769cf5/container1/cirros-0.3.4-
x8664-disk.img HTTP/1.1" 200 13287936
RESP: [200] Content-Length: 13287936 Accept-Ranges: bytes
Last-Modified: Wed, 04 Jan 2017 08:58:56 GMT Etag:
ee1eca47dc88f4879d8a229cc70a07c6 X-Timestamp: 1483520335.
80174 Content-Type: application/octet-stream X-Trans-Id:
tx559e7d3d28aa49c995467-00586d03cf Date: Wed, 04 Jan
2017 14:16:48 GMT Connection: keep-alive
RESP BODY: QFI�s�
&N�JT� F �BU�@�@@�A��U�$wK@?T���I@<�J@�jU���Q�(Y
�ZL
D�
@
�U
�g�YK���I@$DQ@o�O�1G@p_A@�rD���\������D��/F@R3�K���F� �K�V�
Q��t���▒▒���R?mE��WG@ D@ ;�D@ \�D��D� �WA K@ �F�!+�G�!a�B�!�2B�!��C�!�tE@
!��G�"
yI�"HlN"��H�#�@�#JAJ@#N�N@#�{H�$wK$YJ�$�6I�%7F%TI�%��D�%�R@%��Q@
&��Q�'BN�'��J(�J(�F�(��F�(�vD�)cC)B�M)[K�)��L�*IM*��H�*�*I+1�F@+y�S@ +��I�,D�S@,�ZI@-,qE�-vrA@-��N@3nM�3�}M�4N�M@4�L�5%J5��B�5��O�5�#�7�8�9�: �;�<�=�>�?�@�A�B�C�D�E�F�G�H�I�J�K^�L_�L�#_�M��YN��^�O���Q�R�S�T�UY@VSV ��T�WbPX

time swift download container1 cirros-0.3.4-x86_64-disk.img

cirros-0.3.4-x86_64-disk.img [auth 1.810s, headers 2.583s,
total 2.693s, 15.060 MB/s]

real 0m3.298s
user 0m2.035s
sys 0m0.189s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn

From: Steve Martinelli s.martinelli@gmail.com
Date: 2017-01-04 22:05
To: wawayu dongjh@ahope.com.cn
CC: openstack openstack@lists.openstack.org
Subject: Re: [Openstack] Download file from swift extremely slow
Does doing openstack object save container1 cirros-0.3.4-x86_64-disk.img --debug give any additional information?

What about using the swift CLI? any difference in speed? swift download container1 cirros-0.3.4-x86_64-disk.img ?

On Wed, Jan 4, 2017 at 7:19 AM, wawayu dongjh@ahope.com.cn wrote:

Anybody knows this ?
------------------ Original ------------------
From: "董建华"dongjh@ahope.com.cn
Date: Wed, Jan 4, 2017 04:59 PM
To: "openstack"openstack@lists.openstack.org;
Subject: [Openstack] Download file from swift extremely slow
Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object
-storage/draft/get_started.html), file upload is very fast, but file
download is extremely slow, why ?

[root@controller admin]#* time openstack object create container1
cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container |
etag |
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 |
ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#* time openstack object save container1
cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by s.martinelli_at_gmai (5,460 points)   1 2 2
0 votes

Can you you find the transaction-id of the GET request for the download in
the logs and inspect the object-server response? Can you duplicate the
results with any other client (e.g. web browser, curl, python-swiftclient,
etc)?

-Clay

On Wed, Jan 4, 2017 at 12:59 AM, dongjh@ahope.com.cn dongjh@ahope.com.cn
wrote:

Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object-storage/draft/get_
started.html), file upload is very fast, but file download is extremely
slow, why ?

[root@controller admin]#
* time openstack object create container1 cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container | etag
|
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 |
ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#
* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by Clay_Gerrard (5,800 points)   1 2 2
0 votes

On 01/04/2017 12:59 AM, dongjh@ahope.com.cn wrote:
Hi experts

I finished the swift installation following the install
guide(http://docs.openstack.org/project-install-guide/object-storage/draft/get_started.html),
file upload is very fast, but file download is extremely slow, why ?

[root@controller admin]#* time openstack object create container1 cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+----------------------------------+
| object | container | etag |
+------------------------------+------------+----------------------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4879d8a229cc70a07c6 |
+------------------------------+------------+----------------------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s

Are you able to run something like netperf or iperf between your client
and the swift proxy? For example:

netperf -H # get a feel for "to swift" basic network perf
netperf -H -t TCP_MAERTS # get a feel for "from swift"

The idea there is to measure the network separate from the storage and
swift processing, and go from there.

If there isn't much else happening on your setup at the time, you could
also look at some snapshots of netstat -s on the proxy when you are
downloading the object - look to see if there are many TCP
retransmissions. You can get something similar "directly" for the
netperf tests with:

netperf -H -- -o
throughput,localtransportretrans,remotetransportretrans

netperf -H -t TCPMAERTS -- -o
throughput,local
transportretrans,remotetransport_retrans

rick jones

responded Jan 4, 2017 by rick.jones2_at_hpe.c (1,600 points)   1
0 votes

Iuppose your auth real isnt overloaded?

On Jan 4, 2017 22:35, "Clay Gerrard" clay.gerrard@gmail.com wrote:

Can you you find the transaction-id of the GET request for the download in
the logs and inspect the object-server response? Can you duplicate the
results with any other client (e.g. web browser, curl, python-swiftclient,
etc)?

-Clay

On Wed, Jan 4, 2017 at 12:59 AM, dongjh@ahope.com.cn dongjh@ahope.com.cn
wrote:

Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object
-storage/draft/get_started.html), file upload is very fast, but file
download is extremely slow, why ?

[root@controller admin]#
* time openstack object create container1 cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container | etag
|
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4
879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#
* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by Nasir_Mahmood (3,100 points)   1 3
0 votes

I suppose your auth realm isnt overloaded?

On Jan 4, 2017 22:50, wrote:

Iuppose your auth real isnt overloaded?

On Jan 4, 2017 22:35, "Clay Gerrard" clay.gerrard@gmail.com wrote:

Can you you find the transaction-id of the GET request for the download
in the logs and inspect the object-server response? Can you duplicate the
results with any other client (e.g. web browser, curl, python-swiftclient,
etc)?

-Clay

On Wed, Jan 4, 2017 at 12:59 AM, dongjh@ahope.com.cn <dongjh@ahope.com.cn

wrote:

Hi experts

I finished the swift installation following the install guide(
http://docs.openstack.org/project-install-guide/object
-storage/draft/get_started.html), file upload is very fast, but file
download is extremely slow, why ?

[root@controller admin]#
* time openstack object create container1 cirros-0.3.4-x8664-disk.img*
+------------------------------+------------+---------------
-------------------+
| object | container | etag
|
+------------------------------+------------+---------------
-------------------+
| cirros-0.3.4-x86
64-disk.img | container1 | ee1eca47dc88f4
879d8a229cc70a07c6 |
+------------------------------+------------+---------------
-------------------+

real 0m3.807s
user 0m2.127s
sys 0m0.161s

[root@controller /]#
* time openstack object save container1 cirros-0.3.4-x86_64-disk.img*
real 5m51.489s
user 5m48.172s
sys 0m2.094s


=========================================
董 建 华
地址:杭州滨江区南环路3766号新世纪办公楼
邮编:310053
手机:13857132818 <(385)%20713-2818>
总机:0571-28996000
传真:0571-28996001
热线:4006728686
网址:www.ahope.com.cn
Email:dongjh@ahope.com.cn


Mailing list: http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack


Mailing list: http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi
-bin/mailman/listinfo/openstack


Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
responded Jan 4, 2017 by Nasir_Mahmood (3,100 points)   1 3
...