DESCRIPTION

CBQE-4391

Change-Id: Ica18413ab1e7afca3d65cc0d7e66e6df3b6f680c


COMMENTS

author: Coleman Colon
date: 2017-11-23 05:29:31.171000000

Uploaded patch set 1.

-------------------------------------
author: Coleman Colon
date: 2017-11-23 05:36:14.531000000

Patch Set 1:

Timothy Maldonados-MBP:testrunner vikaschaudhary$ ./testrunner -i b/resources/4-node-vikas.ini -c conf/eventing/eventing_n1ql.conf 
filename: conf/eventing/eventing_n1ql.conf
prefix: eventing.eventing_n1ql.EventingN1QL
Global Test input params:
{'cluster_name': '4-node-Timothy Maldonado',
 'conf_file': 'conf/eventing/eventing_n1ql.conf',
 'ini': 'b/resources/4-node-Timothy Maldonado.ini',
 'num_nodes': 4,
 'spec': 'eventing_n1ql'}
Logs will be stored at /Users/Timothy Maldonadochaudhary/codebase/testrunner/logs/testrunner-17-Nov-22_15-11-42/test_1

./testrunner -i b/resources/4-node-Timothy Maldonado.ini  -t eventing.eventing_n1ql.EventingN1QL.test_delete_from_n1ql_from_update,nodes_init=4,services_init=kv-eventing-index-n1ql,dataset=default,groups=simple,reset_services=True,skip_cleanup=True

Test Input params:
{'cluster_name': '4-node-Timothy Maldonado', 'conf_file': 'conf/eventing/eventing_n1ql.conf', 'logs_folder': '/Users/vikaschaudhary/codebase/testrunner/logs/testrunner-17-Nov-22_15-11-42/test_1', 'reset_services': 'True', 'dataset': 'default', 'skip_cleanup': 'True', 'services_init': 'kv-eventing-index-n1ql', 'ini': 'b/resources/4-node-vikas.ini', 'groups': 'simple', 'case_number': 1, 'num_nodes': 4, 'spec': 'eventing_n1ql', 'nodes_init': '4'}
Run before suite setup for eventing.eventing_n1ql.EventingN1QL.test_delete_from_n1ql_from_update
2017-11-22 15:11:42 | WARNING | MainProcess | MainThread | [data_helper.<module>] Can not import concurrent module. Data for each server will be loaded/retrieved sequentially
test_delete_from_n1ql_from_update (eventing.eventing_n1ql.EventingN1QL) ... 2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [eventing_base.setUp] 

Starting Test: test_delete_from_n1ql_from_update
2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.101 with username:root password:couchbase ssh_key:
2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.101
2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [rest_client.get_nodes_version] Node version in cluster 5.1.0-1443-enterprise
2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise']
2017-11-22 15:11:42 | INFO | MainProcess | test_thread | [basetestcase.setUp] ==============  basetestcase setup was started for test #1 test_delete_from_n1ql_from_update==============
2017-11-22 15:11:43 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 10.142.170.101
2017-11-22 15:11:43 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets were deleted completely.
2017-11-22 15:11:45 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 10.142.170.102
2017-11-22 15:11:45 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets were deleted completely.
2017-11-22 15:11:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 10.142.170.103
2017-11-22 15:11:47 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets were deleted completely.
2017-11-22 15:11:49 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets [] on 10.142.170.104
2017-11-22 15:11:49 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets were deleted completely.
2017-11-22 15:11:51 | INFO | MainProcess | test_thread | [cluster_helper.cleanup_cluster] rebalancing all nodes in order to remove nodes
2017-11-22 15:11:51 | INFO | MainProcess | test_thread | [rest_client.rebalance] rebalance params : {'password': 'password', 'ejectedNodes': u'ns_1@10.142.170.104', 'user': 'Administrator', 'knownNodes': xxx@xxx.xxx
2017-11-22 15:11:51 | INFO | MainProcess | test_thread | [rest_client.rebalance] rebalance operation started
2017-11-22 15:11:51 | INFO | MainProcess | test_thread | [rest_client._rebalance_status_and_progress] rebalance percentage : 0.00 %
2017-11-22 15:12:01 | INFO | MainProcess | test_thread | [rest_client._rebalance_status_and_progress] rebalance percentage : 100.00 %
2017-11-22 15:12:11 | INFO | MainProcess | test_thread | [rest_client.monitorRebalance] rebalance progress took 20.017441988 seconds 
2017-11-22 15:12:11 | INFO | MainProcess | test_thread | [rest_client.monitorRebalance] sleep for 10 seconds after rebalance...
2017-11-22 15:12:21 | INFO | MainProcess | test_thread | [cluster_helper.cleanup_cluster] removed all the nodes from cluster associated with ip:10.142.170.101 port:8091 ssh_username:root ? xxx@xxx.xxx 8091)]
2017-11-22 15:12:21 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs.  ...
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.142.170.101:8091
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.142.170.101:8091 is running
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.142.170.102:8091
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.142.170.102:8091 is running
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.142.170.103:8091
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.142.170.103:8091 is running
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.142.170.104:8091
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.142.170.104:8091 is running
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] cannot find service node eventing in cluster 
2017-11-22 15:12:31 | WARNING | MainProcess | test_thread | [basetestcase.tearDown] CLEANUP WAS SKIPPED
Cluster instance shutdown with force
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [basetestcase.setUp] initializing cluster
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.101 with username:root password:couchbase ssh_key:
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.101
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.101 with username:root password:couchbase ssh_key:
2017-11-22 15:12:31 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.101
2017-11-22 15:12:32 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.101 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:32 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.101: /etc/init.d/couchbase-server stop
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Stopped couchbase-server
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [basetestcase.stop_server] Couchbase stopped
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.101: rm -rf /opt/couchbase/var/lib/couchbase/data/*
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.101: rm -rf /opt/couchbase/var/lib/couchbase/config/*
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.101 with username:root password:couchbase ssh_key:
2017-11-22 15:12:35 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.101
2017-11-22 15:12:36 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.101 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:36 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.101: /etc/init.d/couchbase-server start
2017-11-22 15:12:39 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:39 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Started couchbase-server
2017-11-22 15:12:39 | INFO | MainProcess | test_thread | [basetestcase.start_server] Couchbase started
2017-11-22 15:12:39 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.102 with username:root password:couchbase ssh_key:
2017-11-22 15:12:39 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.102
2017-11-22 15:12:40 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.102 with username:root password:couchbase ssh_key:
2017-11-22 15:12:40 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.102
2017-11-22 15:12:41 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.102 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:41 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.102: /etc/init.d/couchbase-server stop
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Stopped couchbase-server
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [basetestcase.stop_server] Couchbase stopped
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.102: rm -rf /opt/couchbase/var/lib/couchbase/data/*
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.102: rm -rf /opt/couchbase/var/lib/couchbase/config/*
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.102 with username:root password:couchbase ssh_key:
2017-11-22 15:12:43 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.102
2017-11-22 15:12:44 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.102 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:44 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.102: /etc/init.d/couchbase-server start
2017-11-22 15:12:47 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:47 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Started couchbase-server
2017-11-22 15:12:47 | INFO | MainProcess | test_thread | [basetestcase.start_server] Couchbase started
2017-11-22 15:12:47 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.103 with username:root password:couchbase ssh_key:
2017-11-22 15:12:47 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.103
2017-11-22 15:12:48 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.103 with username:root password:couchbase ssh_key:
2017-11-22 15:12:48 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.103
2017-11-22 15:12:49 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.103 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:49 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.103: /etc/init.d/couchbase-server stop
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Stopped couchbase-server
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [basetestcase.stop_server] Couchbase stopped
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.103: rm -rf /opt/couchbase/var/lib/couchbase/data/*
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.103: rm -rf /opt/couchbase/var/lib/couchbase/config/*
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.103 with username:root password:couchbase ssh_key:
2017-11-22 15:12:51 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.103
2017-11-22 15:12:52 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.103 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:52 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.103: /etc/init.d/couchbase-server start
2017-11-22 15:12:55 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:55 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Started couchbase-server
2017-11-22 15:12:55 | INFO | MainProcess | test_thread | [basetestcase.start_server] Couchbase started
2017-11-22 15:12:55 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.104 with username:root password:couchbase ssh_key:
2017-11-22 15:12:56 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.104
2017-11-22 15:12:56 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.104 with username:root password:couchbase ssh_key:
2017-11-22 15:12:56 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.104
2017-11-22 15:12:57 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.104 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:12:57 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.104: /etc/init.d/couchbase-server stop
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Stopped couchbase-server
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [basetestcase.stop_server] Couchbase stopped
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.104: rm -rf /opt/couchbase/var/lib/couchbase/data/*
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.104: rm -rf /opt/couchbase/var/lib/couchbase/config/*
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.104 with username:root password:couchbase ssh_key:
2017-11-22 15:12:59 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.104
2017-11-22 15:13:00 | INFO | MainProcess | test_thread | [remote_util.is_couchbase_installed] 10.142.170.104 **** The version file /opt/couchbase/ VERSION.txt  exists
2017-11-22 15:13:00 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.104: /etc/init.d/couchbase-server start
2017-11-22 15:13:03 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:13:03 | INFO | MainProcess | test_thread | [remote_util.log_command_output]  * Started couchbase-server
2017-11-22 15:13:03 | INFO | MainProcess | test_thread | [basetestcase.start_server] Couchbase started
2017-11-22 15:13:03 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs.  ...
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.142.170.101 port:8091 ssh_username:root, nodes/self: {'ip': u'10.142.170.101', 'availableStorage': [], 'rest_username': '', 'id': xxx@xxx.xxx 'uptime': u'33', 'mcdMemoryReserved': 795, 'storageTotalRam': 993, 'hostname': u'10.142.170.101:8091', 'storage': [<membase.api.rest_client.NodeDataStorage object at 0x109011c90>], 'moxi': 11211, 'port': u'8091', 'version': u'5.1.0-1443-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 327681, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 731508736, 'memoryTotal': 1042194432, 'memoryQuota': 595, 'mcdMemoryAllocated': 795, 'os': u'x86_64-unknown-linux-gnu', 'ports': []}
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=530
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 10.142.170.101: 8091:services=kv&password=password&hostname=10.142.170.101&user=Administrator
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.142.170.101:8091:username=Administrator&password=password&port=8091
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.142.170.102 port:8091 ssh_username:root, nodes/self: {'ip': u'10.142.170.102', 'availableStorage': [], 'rest_username': '', 'id': xxx@xxx.xxx 'uptime': u'23', 'mcdMemoryReserved': 795, 'storageTotalRam': 993, 'hostname': u'10.142.170.102:8091', 'storage': [<membase.api.rest_client.NodeDataStorage object at 0x109011ad0>], 'moxi': 11211, 'port': u'8091', 'version': u'5.1.0-1443-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 327681, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 727457792, 'memoryTotal': 1042194432, 'memoryQuota': 595, 'mcdMemoryAllocated': 795, 'os': u'x86_64-unknown-linux-gnu', 'ports': []}
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=530
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.142.170.102:8091:username=Administrator&password=password&port=8091
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.142.170.103 port:8091 ssh_username:root, nodes/self: {'ip': u'10.142.170.103', 'availableStorage': [], 'rest_username': '', 'id': xxx@xxx.xxx 'uptime': u'18', 'mcdMemoryReserved': 795, 'storageTotalRam': 993, 'hostname': u'10.142.170.103:8091', 'storage': [<membase.api.rest_client.NodeDataStorage object at 0x109011290>], 'moxi': 11211, 'port': u'8091', 'version': u'5.1.0-1443-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 327681, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 713764864, 'memoryTotal': 1042194432, 'memoryQuota': 595, 'mcdMemoryAllocated': 795, 'os': u'x86_64-unknown-linux-gnu', 'ports': []}
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=530
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.142.170.103:8091:username=Administrator&password=password&port=8091
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.142.170.104 port:8091 ssh_username:root, nodes/self: {'ip': u'10.142.170.104', 'availableStorage': [], 'rest_username': '', 'id': xxx@xxx.xxx 'uptime': u'8', 'mcdMemoryReserved': 795, 'storageTotalRam': 993, 'hostname': u'10.142.170.104:8091', 'storage': [<membase.api.rest_client.NodeDataStorage object at 0x109011e90>], 'moxi': 11211, 'port': u'8091', 'version': u'5.1.0-1443-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 327681, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 710610944, 'memoryTotal': 1042194432, 'memoryQuota': 595, 'mcdMemoryAllocated': 795, 'os': u'x86_64-unknown-linux-gnu', 'ports': []}
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=530
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma
2017-11-22 15:13:14 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.142.170.104:8091:username=Administrator&password=password&port=8091
2017-11-22 15:13:14 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise']
2017-11-22 15:13:14 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 10.142.170.101 ****
2017-11-22 15:13:14 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise']
2017-11-22 15:13:14 | ERROR | MainProcess | test_thread | [rest_client._http_request] DELETE http://10.142.170.101:8091/settings/rbac/users/local/cbadminbucket body:  headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 404 reason: unknown "User was not found." auth: Administrator:password
2017-11-22 15:13:14 | INFO | MainProcess | test_thread | [internal_user.delete_user] Exception while deleting user. Exception is -"User was not found."
2017-11-22 15:13:14 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs.  ...
2017-11-22 15:13:24 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user ****
2017-11-22 15:13:24 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise']
2017-11-22 15:13:24 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs.  ...
2017-11-22 15:13:34 | INFO | MainProcess | test_thread | [basetestcase.setUp] done initializing cluster
2017-11-22 15:13:35 | INFO | MainProcess | Cluster_Thread | [task.add_nodes] adding node 10.142.170.102:8091 to cluster
2017-11-22 15:13:35 | INFO | MainProcess | Cluster_Thread | [rest_client.add_node] adding remote node @10.142.170.102:8091 to this xxx@xxx.xxx
2017-11-22 15:13:37 | INFO | MainProcess | Cluster_Thread | [task.add_nodes] adding node 10.142.170.103:8091 to cluster
2017-11-22 15:13:37 | INFO | MainProcess | Cluster_Thread | [rest_client.add_node] adding remote node @10.142.170.103:8091 to this xxx@xxx.xxx
2017-11-22 15:13:39 | INFO | MainProcess | Cluster_Thread | [task.add_nodes] adding node 10.142.170.104:8091 to cluster
2017-11-22 15:13:39 | INFO | MainProcess | Cluster_Thread | [rest_client.add_node] adding remote node @10.142.170.104:8091 to this xxx@xxx.xxx
2017-11-22 15:13:42 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance params : {'password': 'password', 'ejectedNodes': '', 'user': 'Administrator', 'knownNodes': xxx@xxx.xxx
2017-11-22 15:13:42 | INFO | MainProcess | Cluster_Thread | [rest_client.rebalance] rebalance operation started
2017-11-22 15:13:42 | INFO | MainProcess | Cluster_Thread | [rest_client._rebalance_status_and_progress] rebalance percentage : 0.00 %
2017-11-22 15:13:42 | INFO | MainProcess | Cluster_Thread | [task.check] Rebalance - status: running, progress: 0
2017-11-22 15:13:52 | INFO | MainProcess | Cluster_Thread | [task.check] Rebalance - status: none, progress: 100
2017-11-22 15:13:52 | INFO | MainProcess | Cluster_Thread | [task.check] rebalancing was completed with progress: 100% in 10.060956955 sec
2017-11-22 15:13:52 | INFO | MainProcess | test_thread | [basetestcase.setUp] ==============  basetestcase setup was finished for test #1 test_delete_from_n1ql_from_update ==============
2017-11-22 15:13:52 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs.  ...
2017-11-22 15:14:02 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.101 with username:root password:couchbase ssh_key:
2017-11-22 15:14:02 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.101
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:10.142.170.104 port:8091 ssh_username:root]
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:10.142.170.102 port:8091 ssh_username:root]
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [eventing_base.setUp] Setting the min possible memory quota so that adding mode nodes to the cluster wouldn't be a problem.
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [rest_client.set_service_memoryQuota] pools/default params : memoryQuota=330
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [rest_client.set_service_memoryQuota] pools/default params : indexMemoryQuota=256
2017-11-22 15:14:12 | INFO | MainProcess | test_thread | [eventing_n1ql.setUp] 100
2017-11-22 15:14:12 | INFO | MainProcess | Cluster_Thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise']
2017-11-22 15:14:12 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.142.170.101:8091/pools/default/buckets with param: bucketType=membase&threadsNumber=3&authType=none&replicaIndex=1&name=src_bucket&evictionPolicy=valueOnly&flushEnabled=1&replicaNumber=1&ramQuotaMB=100
2017-11-22 15:14:12 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket src_bucket
2017-11-22 15:14:12 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : src_bucket in 10.142.170.101 to accept set ops
2017-11-22 15:14:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 src_bucket
2017-11-22 15:14:14 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 src_bucket
2017-11-22 15:14:15 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'src_bucket' was created with per node RAM quota: 100
2017-11-22 15:14:16 | INFO | MainProcess | Cluster_Thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise']
2017-11-22 15:14:16 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.142.170.101:8091/pools/default/buckets with param: bucketType=membase&threadsNumber=3&authType=none&replicaIndex=1&name=dst_bucket&evictionPolicy=valueOnly&flushEnabled=1&replicaNumber=1&ramQuotaMB=100
2017-11-22 15:14:16 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket dst_bucket
2017-11-22 15:14:16 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : dst_bucket in 10.142.170.101 to accept set ops
2017-11-22 15:14:17 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 dst_bucket
2017-11-22 15:14:18 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 dst_bucket
2017-11-22 15:14:19 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'dst_bucket' was created with per node RAM quota: 100
2017-11-22 15:14:20 | INFO | MainProcess | Cluster_Thread | [rest_client.get_nodes_versions] Node versions in cluster [u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise', u'5.1.0-1443-enterprise']
2017-11-22 15:14:20 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.142.170.101:8091/pools/default/buckets with param: bucketType=membase&threadsNumber=3&authType=none&replicaIndex=1&name=metadata&evictionPolicy=valueOnly&flushEnabled=1&replicaNumber=1&ramQuotaMB=100
2017-11-22 15:14:20 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket metadata
2017-11-22 15:14:20 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : metadata in 10.142.170.101 to accept set ops
2017-11-22 15:14:22 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 metadata
2017-11-22 15:14:22 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 metadata
2017-11-22 15:14:24 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'metadata' was created with per node RAM quota: 100
2017-11-22 15:14:24 | INFO | MainProcess | test_thread | [basetestcase.load] create 2016 to src_bucket documents...
2017-11-22 15:14:24 | INFO | MainProcess | test_thread | [data_helper.direct_client] creating direct client 10.142.170.101:11210 src_bucket
2017-11-22 15:14:27 | INFO | MainProcess | test_thread | [basetestcase.load] LOAD IS FINISHED
2017-11-22 15:14:27 | INFO | MainProcess | test_thread | [eventing_base.deploy_function] Deploying the following handler code
2017-11-22 15:14:27 | INFO | MainProcess | test_thread | [eventing_base.deploy_function] 
function OnUpdate(doc, meta) {
    log('document', doc);
    try {
        var index=create primary index on `src_bucket`;
        index.execQuery();
    } catch (e) {}
    var query=DELETE from src_bucket where mutated=0;
    query.execQuery();
}
function OnDelete(meta) {
    dst_bucket[meta.id]='deleted';
}
2017-11-22 15:14:27 | INFO | MainProcess | test_thread | [eventing_base.deploy_function] deploy Application : Stored application config in metakv
2017-11-22 15:14:27 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 30 secs. Waiting for eventing node to come out of bootstrap state... ...
2017-11-22 15:14:57 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 30 secs. Waiting for eventing node to come out of bootstrap state... ...
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:10.142.170.102 port:8091 ssh_username:root]
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [eventing_base.verify_eventing_results] Number of DCP_DELETION processed till now : 2016
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [eventing_base.verify_eventing_results] Event execution stats : {}
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [eventing_base.verify_eventing_results] Event failure stats : {}
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [eventing_base.undeploy_function] Undeploy Application : stored settings for app: Function_91610542_test_delete_from_n1ql_from_update
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [eventing_base.delete_function] Delete Application : Function_91610542_test_delete_from_n1ql_from_update
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [basetestcase.get_nodes_from_services_map] list of all nodes in cluster: [ip:10.142.170.102 port:8091 ssh_username:root]
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.142.170.102 with username:root password:couchbase ssh_key:
2017-11-22 15:15:27 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.142.170.102
2017-11-22 15:15:28 | INFO | MainProcess | test_thread | [rest_client.diag_eval] /diag/eval status on 10.142.170.102:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))).
2017-11-22 15:15:28 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.142.170.102: zgrep "panic" "/opt/couchbase/var/lib/couchbase/logs"/eventing.log* | wc -l
2017-11-22 15:15:28 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully
2017-11-22 15:15:28 | INFO | MainProcess | test_thread | [eventing_base.check_eventing_logs_for_panic] ===== PANIC OBSERVED IN EVENTING LOGS ON SERVER 10.142.170.102=====
2017-11-22 15:15:28 | WARNING | MainProcess | test_thread | [basetestcase.tearDown] CLEANUP WAS SKIPPED
Cluster instance shutdown with force
ok

----------------------------------------------------------------------
Ran 1 test in 225.946s

OK
summary so far suite eventing.eventing_n1ql.EventingN1QL , pass 1 , fail 0
testrunner logs, diags and results are available under /Users/Timothy Maldonadochaudhary/codebase/testrunner/logs/testrunner-17-Nov-22_15-11-42/test_1
Run after suite setup for eventing.eventing_n1ql.EventingN1QL.test_delete_from_n1ql_from_update
Thread Thread-42 was not properly terminated, will be terminated now.
Thread Cluster_Thread was not properly terminated, will be terminated now.
Thread Thread-15 was not properly terminated, will be terminated now.
Thread Thread-24 was not properly terminated, will be terminated now.
Thread Thread-33 was not properly terminated, will be terminated now.
Thread Thread-6 was not properly terminated, will be terminated now.
Exception OSError: OSError(3, 'No such process') in <Finalize object, dead> ignored

-------------------------------------
author: Emely Wilson
date: 2017-11-23 06:36:10.420000000

Patch Set 1: Code-Review+1

-------------------------------------
author: Emely Wilson
date: 2017-11-23 06:40:41.156000000

Patch Set 1:

(1 comment)

Line:7, pytests/eventing/handler_code/n1ql_prepare.js -> Can we try adding this prepare in the test instead of handler ?
It will serve us in 2 ways
1) Handler code will get executed faster, as we need this to be executed once, but in handler code it will get executed 2000 odd times
2) we can also verify prepare statement created outside is accessible from handler code

-------------------------------------
author: Emely Wilson
date: 2017-11-23 06:45:17.265000000

Patch Set 1:

(1 comment)

Line:3, pytests/eventing/handler_code/n1ql_delete_update.js -> As discussed over the mail, for now we can move this to test code instead of handler.

-------------------------------------
