FunkLoad bench report

Date:	2013-04-21 08:56:43

Abstract

Simple users test Bench result of MarketplaceTest.test_marketplace: No test description

Table of contents

1 Bench configuration

Launched: 2013-04-21 08:56:43
From: ip-10-250-27-168, ip-10-249-34-62
Test: loadtest.py MarketplaceTest.test_marketplace
Target server: https://marketplace.allizom.org
Cycles of concurrent users: [20, 40, 60]
Cycle duration: 10s
Sleeptime between request: from 0.0s to 0.5s
Sleeptime between test case: 0.0s
Startup delay between thread: 0.0s
Apdex: _1.5
FunkLoad version: 1.17.0

2 Bench content

The test MarketplaceTest.test_marketplace contains:

0 page(s)
0 redirect(s)
0 link(s)
0 image(s)
0 XML RPC call(s)

The bench contains:

165 tests, 161 error(s)
1882 pages, 43 error(s)
1882 requests, 43 error(s)

3 Test stats

The number of Successful Tests Per Second (STPS) over Concurrent Users (CUs).

CUs STPS TOTAL SUCCESS ERROR

20 0.100 29 1 96.55%

40 0.300 58 3 94.83%

60 0.000 78 0 100.00%

CUs	STPS	TOTAL	SUCCESS	ERROR
20	0.100	29	1	96.55%
40	0.300	58	3	94.83%
60	0.000	78	0	100.00%

4 Page stats

The number of Successful Pages Per Second (SPPS) over Concurrent Users (CUs). Note that an XML RPC call count like a page.

CUs Apdex* Rating SPPS maxSPPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 0.983 Excellent 27.800 41.000 287 278 3.14% 0.172 0.452 1.834 0.230 0.292 1.263 1.406

40 1.000 Excellent 61.800 76.000 634 618 2.52% 0.169 0.375 1.337 0.233 0.288 0.522 1.113

60 1.000 Excellent 94.300 121.000 961 943 1.87% 0.168 0.375 1.344 0.233 0.286 0.531 1.093

* Apdex _1.5

CUs	Apdex*	Rating	SPPS	maxSPPS	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	0.983	Excellent	27.800	41.000	287	278	3.14%	0.172	0.452	1.834	0.230	0.292	1.263	1.406
40	1.000	Excellent	61.800	76.000	634	618	2.52%	0.169	0.375	1.337	0.233	0.288	0.522	1.113
60	1.000	Excellent	94.300	121.000	961	943	1.87%	0.168	0.375	1.344	0.233	0.286	0.531	1.093

5 Request stats

The number of Requests Per Second (RPS) successful or not over Concurrent Users (CUs).

CUs Apdex* Rating* RPS maxRPS TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 0.983 Excellent 28.700 42.000 287 278 3.14% 0.172 0.461 1.834 0.221 0.291 1.262 1.402

40 1.000 Excellent 63.400 76.000 634 618 2.52% 0.169 0.383 1.337 0.232 0.288 0.521 1.099

60 1.000 Excellent 96.100 121.000 961 943 1.87% 0.168 0.381 1.344 0.233 0.286 0.526 1.090

* Apdex _1.5

CUs	Apdex*	Rating*	RPS	maxRPS	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	0.983	Excellent	28.700	42.000	287	278	3.14%	0.172	0.461	1.834	0.221	0.291	1.262	1.402
40	1.000	Excellent	63.400	76.000	634	618	2.52%	0.169	0.383	1.337	0.232	0.288	0.521	1.099
60	1.000	Excellent	96.100	121.000	961	943	1.87%	0.168	0.381	1.344	0.233	0.286	0.526	1.090

6 Slowest requests

The 5 slowest average response time during the best cycle with 60 CUs:

In page 003, Apdex rating: Excellent, avg response time: 0.67s, get: /search/?q=evernote-web ``
In page 007, Apdex rating: Excellent, avg response time: 0.49s, get: /apps/entertainment-sports ``
In page 001, Apdex rating: Excellent, avg response time: 0.45s, get: / ``
In page 003, Apdex rating: Excellent, avg response time: 0.43s, get: /developers/submit/ ``
In page 004, Apdex rating: Excellent, avg response time: 0.31s, get: /search/?q=wiredcom ``

7 Page detail stats

7.1 PAGE 001: /

Req: 001, get, url /

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 47 47 0.00% 0.392 0.802 1.288 0.424 0.497 1.278 1.281

40 1.000 Excellent 95 95 0.00% 0.388 0.466 0.726 0.407 0.456 0.511 0.536

60 1.000 Excellent 138 138 0.00% 0.356 0.455 0.573 0.395 0.450 0.514 0.524

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	47	47	0.00%	0.392	0.802	1.288	0.424	0.497	1.278	1.281
40	1.000	Excellent	95	95	0.00%	0.388	0.466	0.726	0.407	0.456	0.511	0.536
60	1.000	Excellent	138	138	0.00%	0.356	0.455	0.573	0.395	0.450	0.514	0.524

7.2 PAGE 002: /search/?q=twi

Req: 001, get, url /search/?q=twi

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 46 46 0.00% 0.230 0.270 0.450 0.234 0.265 0.297 0.384

40 1.000 Excellent 93 93 0.00% 0.231 0.258 0.332 0.236 0.257 0.283 0.290

60 1.000 Excellent 137 137 0.00% 0.230 0.260 0.379 0.234 0.261 0.286 0.313

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	46	46	0.00%	0.230	0.270	0.450	0.234	0.265	0.297	0.384
40	1.000	Excellent	93	93	0.00%	0.231	0.258	0.332	0.236	0.257	0.283	0.290
60	1.000	Excellent	137	137	0.00%	0.230	0.260	0.379	0.234	0.261	0.286	0.313

7.3 PAGE 003: /search/?q=facebook-web

Req: 001, get, url /search/?q=facebook-web

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 0.884 Good 43 40 6.98% 0.181 0.836 1.834 0.195 0.398 1.623 1.718

40 1.000 Excellent 89 84 5.62% 0.172 0.679 1.337 0.188 0.386 1.253 1.297

60 1.000 Excellent 135 130 3.70% 0.174 0.673 1.344 0.218 0.437 1.212 1.255

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	0.884	Good	43	40	6.98%	0.181	0.836	1.834	0.195	0.398	1.623	1.718
40	1.000	Excellent	89	84	5.62%	0.172	0.679	1.337	0.188	0.386	1.253	1.297
60	1.000	Excellent	135	130	3.70%	0.174	0.673	1.344	0.218	0.437	1.212	1.255

Req: 002, get, url /app/evernote-web/

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 7 7 0.00% 0.243 0.353 0.555 0.243 0.324 0.555 0.555

40 1.000 Excellent 13 13 0.00% 0.236 0.392 0.665 0.243 0.287 0.607 0.665

60 1.000 Excellent 13 13 0.00% 0.241 0.427 0.898 0.249 0.341 0.633 0.898

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	7	7	0.00%	0.243	0.353	0.555	0.243	0.324	0.555	0.555
40	1.000	Excellent	13	13	0.00%	0.236	0.392	0.665	0.243	0.287	0.607	0.665
60	1.000	Excellent	13	13	0.00%	0.241	0.427	0.898	0.249	0.341	0.633	0.898

7.4 PAGE 004: /search/?q=weather-me

Req: 001, get, url /search/?q=weather-me

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 37 31 16.22% 0.234 0.352 0.548 0.256 0.319 0.481 0.520

40 1.000 Excellent 80 69 13.75% 0.236 0.331 0.561 0.259 0.296 0.485 0.512

60 1.000 Excellent 123 110 10.57% 0.218 0.312 0.504 0.239 0.288 0.440 0.473

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	37	31	16.22%	0.234	0.352	0.548	0.256	0.319	0.481	0.520
40	1.000	Excellent	80	69	13.75%	0.236	0.331	0.561	0.259	0.296	0.485	0.512
60	1.000	Excellent	123	110	10.57%	0.218	0.312	0.504	0.239	0.288	0.440	0.473

7.5 PAGE 005: /search/?q=jauntly

Req: 001, get, url /search/?q=jauntly

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 28 28 0.00% 0.239 0.289 0.369 0.248 0.272 0.353 0.361

40 1.000 Excellent 67 67 0.00% 0.230 0.314 0.502 0.246 0.288 0.405 0.486

60 1.000 Excellent 108 108 0.00% 0.225 0.302 0.494 0.241 0.289 0.372 0.434

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	28	28	0.00%	0.239	0.289	0.369	0.248	0.272	0.353	0.361
40	1.000	Excellent	67	67	0.00%	0.230	0.314	0.502	0.246	0.288	0.405	0.486
60	1.000	Excellent	108	108	0.00%	0.225	0.302	0.494	0.241	0.289	0.372	0.434

7.6 PAGE 006: /search/?q=wiredcom

Req: 001, get, url /search/?q=wiredcom

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 22 22 0.00% 0.245 0.370 0.794 0.255 0.322 0.706 0.721

40 1.000 Excellent 66 66 0.00% 0.230 0.300 0.486 0.243 0.290 0.367 0.429

60 1.000 Excellent 105 105 0.00% 0.232 0.308 0.540 0.242 0.287 0.420 0.444

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	22	22	0.00%	0.245	0.370	0.794	0.255	0.322	0.706	0.721
40	1.000	Excellent	66	66	0.00%	0.230	0.300	0.486	0.243	0.290	0.367	0.429
60	1.000	Excellent	105	105	0.00%	0.232	0.308	0.540	0.242	0.287	0.420	0.444

7.7 PAGE 007: /search/?q=twitter

Req: 001, get, url /search/?q=twitter

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 19 19 0.00% 0.238 0.314 0.463 0.246 0.283 0.463 0.463

40 1.000 Excellent 51 51 0.00% 0.234 0.466 1.113 0.265 0.330 0.969 1.019

60 1.000 Excellent 79 79 0.00% 0.234 0.488 1.128 0.244 0.327 1.085 1.102

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	19	19	0.00%	0.238	0.314	0.463	0.246	0.283	0.463	0.463
40	1.000	Excellent	51	51	0.00%	0.234	0.466	1.113	0.265	0.330	0.969	1.019
60	1.000	Excellent	79	79	0.00%	0.234	0.488	1.128	0.244	0.327	1.085	1.102

7.8 PAGE 008: /en-US/api/apps/category/

Req: 001, get, url /en-US/api/apps/category/

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 19 19 0.00% 0.172 0.198 0.221 0.172 0.206 0.216 0.221

40 1.000 Excellent 40 40 0.00% 0.169 0.196 0.220 0.173 0.206 0.215 0.219

60 1.000 Excellent 63 63 0.00% 0.168 0.218 0.723 0.174 0.202 0.215 0.218

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	19	19	0.00%	0.172	0.198	0.221	0.172	0.206	0.216	0.221
40	1.000	Excellent	40	40	0.00%	0.169	0.196	0.220	0.173	0.206	0.215	0.219
60	1.000	Excellent	63	63	0.00%	0.168	0.218	0.723	0.174	0.202	0.215	0.218

Req: 002, get, url /api/apps/category/?lang=en-us

CUs Apdex* Rating TOTAL SUCCESS ERROR MIN AVG MAX P10 MED P90 P95

20 1.000 Excellent 19 19 0.00% 0.209 0.252 0.279 0.229 0.246 0.271 0.279

40 1.000 Excellent 40 40 0.00% 0.233 0.258 0.290 0.237 0.256 0.283 0.288

60 1.000 Excellent 60 60 0.00% 0.213 0.263 0.326 0.242 0.269 0.282 0.285

* Apdex _1.5

CUs	Apdex*	Rating	TOTAL	SUCCESS	ERROR	MIN	AVG	MAX	P10	MED	P90	P95
20	1.000	Excellent	19	19	0.00%	0.209	0.252	0.279	0.229	0.246	0.271	0.279
40	1.000	Excellent	40	40	0.00%	0.233	0.258	0.290	0.237	0.256	0.283	0.288
60	1.000	Excellent	60	60	0.00%	0.213	0.263	0.326	0.242	0.269	0.282	0.285

8 Failures and Errors

8.1 Failures

13 time(s), code: 401:
```
No traceback.
```
24 time(s), code: 403:
```
No traceback.
```

8.2 Errors

6 time(s), code: -1:

Traceback (most recent call last):

File "build/bdist.linux-x86_64/egg/funkload/FunkLoadTestCase.py", line 208, in _connect
cert_file=self._certfile_path, method=rtype, consumer=consumer)

File "build/bdist.linux-x86_64/egg/funkload/PatchWebunit.py", line 490, in WF_fetch
decodeCookies(url, server, headers, self.cookies)

File "build/bdist.linux-x86_64/egg/funkload/PatchWebunit.py", line 221, in decodeCookies
expire = now + timedelta

System Message: WARNING/2 (/home/marteau/marteau-web/work/0a7bc98291d147be8d8501d67998c626/index.rst, line 318)

Bullet list ends without a blank line; unexpected unindent.

TypeError: unsupported operand type(s) for +: 'datetime.datetime' and 'int'