DESCRIPTION

CBQE-0: Changing the default batch size for async load to 1000

Change-Id: I52b719315bdd9104e20e4bdcdf92f35e09010a7f
Reviewed-on: http://review.couchbase.org/40255
Reviewed-by: Fisher Vargas <Fisher xxx@xxx.xxx
Tested-by: Fisher Vargas <Fisher xxx@xxx.xxx


COMMENTS

author: Fisher Vargas
date: 2014-08-04 11:14:20.382000000

Change has been successfully cherry-picked as d5be9e3f86f290aabd398b6df8e78a54585bd621

-------------------------------------
author: Angelina Mayer
date: 2014-08-04 18:04:26.406000000

Patch Set 2:

(2 comments)

Line:48, pytests/xdcr/rebalanceXDCR.py -> this is the default value in base class, so we can ignore this param of we are passing the same value.

Line:50, pytests/xdcr/rebalanceXDCR.py -> same here.

-------------------------------------
author: Angelina Mayer
date: 2014-08-04 23:26:13.220000000

Patch Set 2: Reverted

This patchset was reverted in change: I6d898f029f6e83ed99cc127a443942b32d5225f1

-------------------------------------
author: Angelina Mayer
date: 2014-08-04 23:29:06.335000000

Patch Set 2:

See sanity for build 1104-


Test Input params:
{'doc-ops': 'update-delete', 'logs_folder': '/root/jenkins/workspace/centos_x64--00_01--qe-sanity-P0/logs/testrunner-14-Aug-04_14-23-21/test_8', 'replicas': '1', 'items': '10000', 'failover': 'source', 'get-delays': 'True', 'conf_file': 'conf/simple.conf', 'num_nodes': 4, 'cluster_name': '4-centos64-view-simple-3.0', 'ctopology': 'chain', 'rdirection': 'unidirection', 'ini': '/tmp/4-centos64-view-simple-3.0.ini', 'case_number': 8, 'get-cbcollect-info': 'True', 'spec': 'simple'}
[2014-08-04 14:40:25,249] - [xdcrbasetests:242] INFO - Initializing input parameters started...
[2014-08-04 14:40:25,250] - [xdcrbasetests:351] INFO - Initializing input parameters completed.
[2014-08-04 14:40:25,250] - [xdcrbasetests:96] INFO - ==============  XDCRbasetests setup is started for test #8 load_with_failover==============
[2014-08-04 14:40:25,306] - [xdcrbasetests:462] INFO - cleanup cluster1: [ip:172.23.106.191 port:8091 ssh_username:root, ip:172.23.106.192 port:8091 ssh_username:root]
[2014-08-04 14:40:25,338] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.106.191
[2014-08-04 14:40:25,365] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.191:8091
[2014-08-04 14:40:25,373] - [cluster_helper:80] INFO - ns_server @ 172.23.106.191:8091 is running
[2014-08-04 14:40:25,389] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.106.192
[2014-08-04 14:40:25,427] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.192:8091
[2014-08-04 14:40:25,434] - [cluster_helper:80] INFO - ns_server @ 172.23.106.192:8091 is running
[2014-08-04 14:40:25,434] - [xdcrbasetests:462] INFO - cleanup cluster2: [ip:172.23.106.193 port:8091 ssh_username:root, ip:172.23.106.194 port:8091 ssh_username:root]
[2014-08-04 14:40:25,464] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.106.193
[2014-08-04 14:40:25,501] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.193:8091
[2014-08-04 14:40:25,514] - [cluster_helper:80] INFO - ns_server @ 172.23.106.193:8091 is running
[2014-08-04 14:40:25,530] - [bucket_helper:137] INFO - deleting existing buckets [] on 172.23.106.194
[2014-08-04 14:40:25,566] - [cluster_helper:78] INFO - waiting for ns_server @ 172.23.106.194:8091
[2014-08-04 14:40:25,578] - [cluster_helper:80] INFO - ns_server @ 172.23.106.194:8091 is running
[2014-08-04 14:40:26,262] - [rest_client:764] INFO - settings/web params on 172.23.106.191:8091:username=Administrator&password=password&port=8091
[2014-08-04 14:40:26,286] - [rest_client:784] INFO - pools/default params : memoryQuota=2069&username=Administrator&password=password
[2014-08-04 14:40:26,307] - [rest_client:764] INFO - settings/web params on 172.23.106.192:8091:username=Administrator&password=password&port=8091
[2014-08-04 14:40:26,330] - [rest_client:784] INFO - pools/default params : memoryQuota=2069&username=Administrator&password=password
[2014-08-04 14:40:27,342] - [task:300] INFO - adding node 172.23.106.192:8091 to cluster
[2014-08-04 14:40:27,342] - [rest_client:933] INFO - adding remote node @172.23.106.192:8091 to this xxx@xxx.xxx
[2014-08-04 14:40:32,877] - [rest_client:1095] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%40172.23.106.191%2Cns_1%40172.23.106.192
[2014-08-04 14:40:32,886] - [rest_client:1099] INFO - rebalance operation started
[2014-08-04 14:40:32,897] - [rest_client:1216] INFO - rebalance percentage : 0 %
[2014-08-04 14:40:42,915] - [task:411] INFO - rebalancing was completed with progress: 100% in 10.0288820267 sec
[2014-08-04 14:40:43,932] - [rest_client:1524] INFO - http://172.23.106.191:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=2069&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None
[2014-08-04 14:40:43,945] - [rest_client:1530] INFO - 0.0124418735504 seconds to create bucket default
[2014-08-04 14:40:43,945] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 172.23.106.191 to accept set ops
[2014-08-04 14:40:45,203] - [data_helper:295] INFO - creating direct client 172.23.106.191:11210 default
[2014-08-04 14:40:45,298] - [data_helper:295] INFO - creating direct client 172.23.106.192:11210 default
[2014-08-04 14:40:45,486] - [data_helper:295] INFO - creating direct client 172.23.106.191:11210 default
[2014-08-04 14:40:45,607] - [data_helper:295] INFO - creating direct client 172.23.106.192:11210 default
[2014-08-04 14:40:46,179] - [task:204] INFO - bucket 'default' was created with per node RAM quota: 2069
[2014-08-04 14:40:46,228] - [rest_client:1111] INFO - /diag/eval status on 172.23.106.191:8091: True content: ok command: ale:set_loglevel(xdcr_trace, debug).
[2014-08-04 14:40:46,238] - [rest_client:1111] INFO - /diag/eval status on 172.23.106.192:8091: True content: ok command: ale:set_loglevel(xdcr_trace, debug).
[2014-08-04 14:40:47,189] - [rest_client:764] INFO - settings/web params on 172.23.106.193:8091:username=Administrator&password=password&port=8091
[2014-08-04 14:40:47,208] - [rest_client:784] INFO - pools/default params : memoryQuota=2069&username=Administrator&password=password
[2014-08-04 14:40:47,223] - [rest_client:764] INFO - settings/web params on 172.23.106.194:8091:username=Administrator&password=password&port=8091
[2014-08-04 14:40:47,250] - [rest_client:784] INFO - pools/default params : memoryQuota=2069&username=Administrator&password=password
[2014-08-04 14:40:48,257] - [task:300] INFO - adding node 172.23.106.194:8091 to cluster
[2014-08-04 14:40:48,257] - [rest_client:933] INFO - adding remote node @172.23.106.194:8091 to this xxx@xxx.xxx
[2014-08-04 14:40:51,313] - [rest_client:1095] INFO - rebalance params : password=password&ejectedNodes=&user=Administrator&knownNodes=ns_1%40172.23.106.193%2Cns_1%40172.23.106.194
[2014-08-04 14:40:51,320] - [rest_client:1099] INFO - rebalance operation started
[2014-08-04 14:40:51,325] - [rest_client:1216] INFO - rebalance percentage : 0 %
[2014-08-04 14:41:01,344] - [task:411] INFO - rebalancing was completed with progress: 100% in 10.0230739117 sec
[2014-08-04 14:41:02,362] - [rest_client:1524] INFO - http://172.23.106.193:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=2069&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None
[2014-08-04 14:41:02,378] - [rest_client:1530] INFO - 0.0158112049103 seconds to create bucket default
[2014-08-04 14:41:02,379] - [bucket_helper:305] INFO - waiting for memcached bucket : default in 172.23.106.193 to accept set ops
[2014-08-04 14:41:04,087] - [data_helper:295] INFO - creating direct client 172.23.106.193:11210 default
[2014-08-04 14:41:04,209] - [data_helper:295] INFO - creating direct client 172.23.106.194:11210 default
[2014-08-04 14:41:04,363] - [data_helper:295] INFO - creating direct client 172.23.106.193:11210 default
[2014-08-04 14:41:04,479] - [data_helper:295] INFO - creating direct client 172.23.106.194:11210 default
[2014-08-04 14:41:05,094] - [task:204] INFO - bucket 'default' was created with per node RAM quota: 2069
[2014-08-04 14:41:05,109] - [rest_client:1111] INFO - /diag/eval status on 172.23.106.193:8091: True content: ok command: ale:set_loglevel(xdcr_trace, debug).
[2014-08-04 14:41:05,119] - [rest_client:1111] INFO - /diag/eval status on 172.23.106.194:8091: True content: ok command: ale:set_loglevel(xdcr_trace, debug).
[2014-08-04 14:41:05,120] - [xdcrbasetests:1089] INFO - Setting xdcrFailureRestartInterval to 1 ..
[2014-08-04 14:41:05,130] - [rest_client:1732] INFO - Update internal setting xdcrFailureRestartInterval=1
[2014-08-04 14:41:05,130] - [xdcrbasetests:1089] INFO - Setting xdcrCheckpointInterval to 60 ..
[2014-08-04 14:41:05,144] - [rest_client:1732] INFO - Update internal setting xdcrCheckpointInterval=60
[2014-08-04 14:41:05,154] - [rest_client:828] INFO - adding remote cluster hostname:172.23.106.193:8091 with username:password Administrator:password name:cluster1 to source node: 172.23.106.191:8091
[2014-08-04 14:41:05,199] - [rest_client:874] INFO - starting continuous replication type:capi from default to default in the remote cluster cluster1
[2014-08-04 14:41:05,252] - [xdcrbasetests:372] INFO - sleep for 5 secs.  ...
[2014-08-04 14:41:10,258] - [xdcrbasetests:114] INFO - ==============  XDCRbasetests setup is finished for test #8 load_with_failover ==============
[2014-08-04 14:41:10,373] - [data_helper:295] INFO - creating direct client 172.23.106.191:11210 default
[2014-08-04 14:41:10,496] - [data_helper:295] INFO - creating direct client 172.23.106.192:11210 default
[2014-08-04 14:41:11,102] - [task:770] INFO - Batch create documents done #: 0 with exp:0
[2014-08-04 14:41:13,446] - [task:770] INFO - Batch create documents done #: 10000 with exp:0
[2014-08-04 14:41:13,446] - [xdcrbasetests:372] INFO - sleep for 60 secs.  ...
[2014-08-04 14:42:13,507] - [uniXDCR:140] INFO -  Failing over Source Non-Master Node 172.23.106.192:8091
[2014-08-04 14:42:14,211] - [task:2254] INFO - Failing over 172.23.106.192:8091
[2014-08-04 14:42:14,956] - [rest_client:1040] INFO - fail_over node xxx@xxx.xxx successful
[2014-08-04 14:42:14,957] - [task:2234] INFO - 0 seconds sleep after failover, for nodes to go pending....
[2014-08-04 14:42:14,957] - [uniXDCR:143] INFO -  Rebalance out Source Non-Master Node 172.23.106.192:8091
[2014-08-04 14:42:15,983] - [rest_client:1095] INFO - rebalance params : password=password&ejectedNodes=ns_1%40172.23.106.192&user=Administrator&knownNodes=ns_1%40172.23.106.191%2Cns_1%40172.23.106.192
[2014-08-04 14:42:15,989] - [rest_client:1099] INFO - rebalance operation started
[2014-08-04 14:42:16,001] - [rest_client:1216] INFO - rebalance percentage : 0 %
[2014-08-04 14:42:26,019] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:27,023] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:28,027] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:29,030] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:30,033] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:31,036] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:32,040] - [rest_client:750] ERROR - socket error while connecting to http://172.23.106.192:8091/nodes/self error [Errno 111] Connection refused 
[2014-08-04 14:42:33,058] - [task:411] INFO - rebalancing was completed with progress: 100% in 17.0691058636 sec
[2014-08-04 14:42:33,059] - [xdcrbasetests:372] INFO - sleep for 10 secs.  ...
[2014-08-04 14:42:43,171] - [data_helper:295] INFO - creating direct client 172.23.106.191:11210 default
[2014-08-04 14:42:43,326] - [data_helper:295] INFO - creating direct client 172.23.106.191:11210 default
[2014-08-04 14:42:44,072] - [task:770] INFO - Batch update documents done #: 0 with exp:0
Build timed out (after 120 minutes). Marking the build as aborted.

-------------------------------------
