FunkLoad bench report

Date:	2013-06-13 04:16:57

Abstract

Simple users test Bench result of StressTest.test_storage_session: No test description

Table of contents

1 Bench configuration

Launched: 2013-06-13 04:16:57
From: ip-10-251-20-131
Test: stress.py StressTest.test_storage_session
Target server: http://this.is.not.used.by.the.tests.but.is.required.by.funkload
Cycles of concurrent users: [50, 50, 50]
Cycle duration: 300s
Sleeptime between request: from 0.0s to 0.1s
Sleeptime between test case: 0.01s
Startup delay between thread: 0.05s
Apdex: _1.5
FunkLoad version: 1.17.0

2 Bench content

The test StressTest.test_storage_session contains:

11 page(s)
0 redirect(s)
0 link(s)
0 image(s)
0 XML RPC call(s)

The bench contains:

40750 tests, 16129 error(s)
82910 pages, 16129 error(s)
82910 requests, 16129 error(s)

3 Test stats

The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).

CUs STPS TOTAL SUCCESS ERROR

50 27.630 13926 8289 40.48%

50 27.497 13671 8249 39.66%

50 26.943 13153 8083 38.55%

CUs	STPS	TOTAL	SUCCESS	ERROR
50	27.630	13926	8289	40.48%
50	27.497	13671	8249	39.66%
50	26.943	13153	8083	38.55%

4 Page stats

The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.

CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.976 Excellent 74.693 134.000 28045 22408 20.10% 0.111 0.410 19.881 0.140 0.243 0.855 1.447

50 0.979 Excellent 74.423 147.000 27749 22327 19.54% 0.112 0.415 10.758 0.143 0.266 0.929 1.385

50 0.973 Excellent 73.487 125.000 27116 22046 18.70% 0.111 0.426 29.647 0.139 0.247 0.998 1.629

* Apdex _1.5

CUs	Apdex*	Rating	SPPS	maxSPPS	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.976	Excellent	74.693	134.000	28045	22408	20.10%	0.111	0.410	19.881	0.140	0.243	0.855	1.447
50	0.979	Excellent	74.423	147.000	27749	22327	19.54%	0.112	0.415	10.758	0.143	0.266	0.929	1.385
50	0.973	Excellent	73.487	125.000	27116	22046	18.70%	0.111	0.426	29.647	0.139	0.247	0.998	1.629

5 Request stats

The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).

CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.976 Excellent 93.483 178.000 28045 22408 20.10% 0.107 0.486 19.881 0.136 0.225 0.797 1.347

50 0.979 Excellent 92.497 165.000 27749 22327 19.54% 0.108 0.492 10.758 0.139 0.246 0.859 1.304

50 0.973 Excellent 90.387 150.000 27116 22046 18.70% 0.105 0.504 40.835 0.134 0.230 0.903 1.522

* Apdex _1.5

CUs	Apdex*	Rating*	RPS	maxRPS	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.976	Excellent	93.483	178.000	28045	22408	20.10%	0.107	0.486	19.881	0.136	0.225	0.797	1.347
50	0.979	Excellent	92.497	165.000	27749	22327	19.54%	0.108	0.492	10.758	0.139	0.246	0.859	1.304
50	0.973	Excellent	90.387	150.000	27116	22046	18.70%	0.105	0.504	40.835	0.134	0.230	0.903	1.522

6 Slowest requests

The 5 slowest average response time during the best cycle with 50 CUs:

In page 008, Apdex rating: Excellent, avg response time: 0.83s, post: /1.1/cuser503973/storage/bookmarks ``
In page 007, Apdex rating: Excellent, avg response time: 0.81s, post: /1.1/cuser503973/storage/passwords ``
In page 005, Apdex rating: Excellent, avg response time: 0.77s, post: /1.1/cuser133936/storage/forms ``
In page 006, Apdex rating: Excellent, avg response time: 0.74s, get: /1.1/cuser518316/storage/bookmarks?full=1&newer=1371062070 ``
In page 004, Apdex rating: Excellent, avg response time: 0.72s, post: /1.1/cuser80399/storage/passwords ``

7 Page detail stats

7.1 PAGE 001: /1.1/cuser3928/info/collections

Req: 001, get, url /1.1/cuser3928/info/collections

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.985 Excellent 13932 8295 40.46% 0.107 0.385 19.272 0.132 0.190 0.484 0.816

50 0.984 Excellent 13679 8260 39.62% 0.108 0.405 10.288 0.135 0.203 0.524 0.894

50 0.988 Excellent 13163 8098 38.48% 0.105 0.379 40.621 0.131 0.194 0.561 0.883

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.985	Excellent	13932	8295	40.46%	0.107	0.385	19.272	0.132	0.190	0.484	0.816
50	0.984	Excellent	13679	8260	39.62%	0.108	0.405	10.288	0.135	0.203	0.524	0.894
50	0.988	Excellent	13163	8098	38.48%	0.105	0.379	40.621	0.131	0.194	0.561	0.883

7.2 PAGE 002: /1.1/cuser495605/storage/history

Req: 001, post, url /1.1/cuser495605/storage/history

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.979 Excellent 6707 6707 0.00% 0.111 0.449 10.601 0.133 0.212 0.735 1.191

50 0.983 Excellent 6679 6678 0.01% 0.112 0.442 10.758 0.133 0.226 0.747 1.178

50 0.979 Excellent 6611 6609 0.03% 0.111 0.454 40.681 0.129 0.210 0.793 1.324

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.979	Excellent	6707	6707	0.00%	0.111	0.449	10.601	0.133	0.212	0.735	1.191
50	0.983	Excellent	6679	6678	0.01%	0.112	0.442	10.758	0.133	0.226	0.747	1.178
50	0.979	Excellent	6611	6609	0.03%	0.111	0.454	40.681	0.129	0.210	0.793	1.324

7.3 PAGE 003: /1.1/cuser277419/storage/history

Req: 001, post, url /1.1/cuser277419/storage/history

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.959 Excellent 3693 3693 0.00% 0.121 0.680 11.388 0.171 0.405 1.221 2.034

50 0.969 Excellent 3631 3629 0.06% 0.124 0.653 10.552 0.178 0.440 1.155 1.623

50 0.941 Excellent 3621 3620 0.03% 0.121 0.767 40.835 0.167 0.402 1.592 2.415

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.959	Excellent	3693	3693	0.00%	0.121	0.680	11.388	0.171	0.405	1.221	2.034
50	0.969	Excellent	3631	3629	0.06%	0.124	0.653	10.552	0.178	0.440	1.155	1.623
50	0.941	Excellent	3621	3620	0.03%	0.121	0.767	40.835	0.167	0.402	1.592	2.415

7.4 PAGE 004: /1.1/cuser80399/storage/passwords

Req: 001, post, url /1.1/cuser80399/storage/passwords

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.955 Excellent 2059 2059 0.00% 0.123 0.720 10.076 0.163 0.415 1.325 2.170

50 0.958 Excellent 2045 2045 0.00% 0.123 0.730 10.745 0.169 0.474 1.264 1.878

50 0.939 Good 1966 1964 0.10% 0.120 0.791 40.243 0.159 0.403 1.612 2.500

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.955	Excellent	2059	2059	0.00%	0.123	0.720	10.076	0.163	0.415	1.325	2.170
50	0.958	Excellent	2045	2045	0.00%	0.123	0.730	10.745	0.169	0.474	1.264	1.878
50	0.939	Good	1966	1964	0.10%	0.120	0.791	40.243	0.159	0.403	1.612	2.500

7.5 PAGE 005: /1.1/cuser133936/storage/forms

Req: 001, post, url /1.1/cuser133936/storage/forms

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.952 Excellent 1017 1017 0.00% 0.122 0.774 19.881 0.170 0.419 1.381 2.373

50 0.963 Excellent 1035 1035 0.00% 0.124 0.725 7.124 0.170 0.478 1.168 1.877

50 0.944 Excellent 1062 1062 0.00% 0.123 0.746 11.467 0.164 0.429 1.521 2.219

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.952	Excellent	1017	1017	0.00%	0.122	0.774	19.881	0.170	0.419	1.381	2.373
50	0.963	Excellent	1035	1035	0.00%	0.124	0.725	7.124	0.170	0.478	1.168	1.877
50	0.944	Excellent	1062	1062	0.00%	0.123	0.746	11.467	0.164	0.429	1.521	2.219

7.6 PAGE 006: /1.1/cuser518316/storage/bookmarks?full=1&newer=1371062070

Req: 001, get, url /1.1/cuser518316/storage/bookmarks?full=1&newer=1371062070

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.954 Excellent 427 427 0.00% 0.126 0.735 7.636 0.179 0.413 1.364 2.192

50 0.961 Excellent 454 454 0.00% 0.127 0.787 6.110 0.197 0.515 1.298 2.192

50 0.931 Good 478 478 0.00% 0.127 0.806 10.363 0.171 0.448 1.719 2.651

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.954	Excellent	427	427	0.00%	0.126	0.735	7.636	0.179	0.413	1.364	2.192
50	0.961	Excellent	454	454	0.00%	0.127	0.787	6.110	0.197	0.515	1.298	2.192
50	0.931	Good	478	478	0.00%	0.127	0.806	10.363	0.171	0.448	1.719	2.651

7.7 PAGE 007: /1.1/cuser503973/storage/passwords

Req: 001, post, url /1.1/cuser503973/storage/passwords

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.941 Excellent 135 135 0.00% 0.171 0.806 7.256 0.197 0.500 1.521 2.707

50 0.957 Excellent 152 152 0.00% 0.161 0.772 5.621 0.197 0.517 1.322 1.824

50 0.925 Good 140 140 0.00% 0.171 0.780 6.077 0.205 0.542 2.011 2.380

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.941	Excellent	135	135	0.00%	0.171	0.806	7.256	0.197	0.500	1.521	2.707
50	0.957	Excellent	152	152	0.00%	0.161	0.772	5.621	0.197	0.517	1.322	1.824
50	0.925	Good	140	140	0.00%	0.171	0.780	6.077	0.205	0.542	2.011	2.380

7.8 PAGE 008: /1.1/cuser503973/storage/bookmarks

Req: 001, post, url /1.1/cuser503973/storage/bookmarks

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.953 Excellent 53 53 0.00% 0.144 0.833 5.292 0.233 0.552 1.372 2.495

50 0.922 Good 51 51 0.00% 0.172 0.874 5.322 0.238 0.621 1.819 2.223

50 0.941 Excellent 51 51 0.00% 0.163 0.775 4.792 0.205 0.565 1.551 2.157

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.953	Excellent	53	53	0.00%	0.144	0.833	5.292	0.233	0.552	1.372	2.495
50	0.922	Good	51	51	0.00%	0.172	0.874	5.322	0.238	0.621	1.819	2.223
50	0.941	Excellent	51	51	0.00%	0.163	0.775	4.792	0.205	0.565	1.551	2.157

7.9 PAGE 009: /1.1/cuser294316/storage/passwords

Req: 001, post, url /1.1/cuser294316/storage/passwords

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 0.933 Good 15 15 0.00% 0.171 0.567 1.743 0.192 0.427 1.517 1.743

50 0.969 Excellent 16 16 0.00% 0.167 0.917 5.715 0.178 0.604 1.227 5.715

50 0.842 FAIR 19 19 0.00% 0.179 1.298 5.498 0.191 0.538 5.353 5.498

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	0.933	Good	15	15	0.00%	0.171	0.567	1.743	0.192	0.427	1.517	1.743
50	0.969	Excellent	16	16	0.00%	0.167	0.917	5.715	0.178	0.604	1.227	5.715
50	0.842	FAIR	19	19	0.00%	0.179	1.298	5.498	0.191	0.538	5.353	5.498

7.10 PAGE 010: /1.1/cuser226376/storage/prefs

Req: 001, delete, url /1.1/cuser226376/storage/prefs

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 1.000 Excellent 5 5 0.00% 0.353 0.513 0.647 0.353 0.485 0.647 0.647

50 0.917 Good 6 6 0.00% 0.383 1.552 5.536 0.383 0.951 5.536 5.536

50 1.000 Excellent 5 5 0.00% 0.178 0.433 0.891 0.178 0.320 0.891 0.891

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	1.000	Excellent	5	5	0.00%	0.353	0.513	0.647	0.353	0.485	0.647	0.647
50	0.917	Good	6	6	0.00%	0.383	1.552	5.536	0.383	0.951	5.536	5.536
50	1.000	Excellent	5	5	0.00%	0.178	0.433	0.891	0.178	0.320	0.891	0.891

7.11 PAGE 011: /1.1/cuser208718/storage/history

Req: 001, post, url /1.1/cuser208718/storage/history

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

50 1.000 Excellent 2 2 0.00% 0.547 0.687 0.827 0.547 0.827 0.827 0.827

50 1.000 Excellent 1 1 0.00% 0.561 0.561 0.561 0.561 0.561 0.561 0.561

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
50	1.000	Excellent	2	2	0.00%	0.547	0.687	0.827	0.547	0.827	0.827	0.827
50	1.000	Excellent	1	1	0.00%	0.561	0.561	0.561	0.561	0.561	0.561	0.561

8 Failures and Errors

8.1 Failures

7 time(s), code: -1:
```
No traceback.
```
16112 time(s), code: 401:
```
No traceback.
```

8.2 Errors

10 time(s), code: -1:

Traceback (most recent call last):

File "build/bdist.linux-x86_64/egg/funkload/FunkLoadTestCase.py", line 208, in _connect
cert_file=self._certfile_path, method=rtype, consumer=consumer)

File "build/bdist.linux-x86_64/egg/funkload/PatchWebunit.py", line 427, in WF_fetch
h.endheaders()

File "/usr/lib/python2.7/httplib.py", line 958, in endheaders
self._send_output(message_body)

File "/usr/lib/python2.7/httplib.py", line 818, in _send_output
self.send(msg)

File "/usr/lib/python2.7/httplib.py", line 780, in send
self.connect()

File "/usr/lib/python2.7/httplib.py", line 1161, in connect
self.timeout, self.source_address)

File "/usr/lib/python2.7/socket.py", line 553, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):

System Message: WARNING/2 (/home/marteau/marteau-web/work/4b2f4a1de7654f5c9f0b906a0c22646f/index.rst, line 354)

Bullet list ends without a blank line; unexpected unindent.

gaierror: [Errno -2] Name or service not known