Number of Cassandra nodes during installation

anvimalia
Participant III

We have a 27 node cluster for our prod environment. We have 6 nodes for Cass & ZK. During installation for Apigee 19.01 Private cloud, it failed. Not giving enough information. Is there a limit on the number of cass nodes allowed at the time of installation, we tried the same install with 3 nodes in pre-prod and it worked.

	ERROR [main] 2019-05-02 16:14:28,607 CassandraDaemon.java:583 - Exception encountered during startup java.lang.UnsupportedOperationException: Other bootstrapping/leaving/moving nodes detected, cannot bootstrap while cassandra.consistent.rangemovement is true at org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:559) ~[apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:794) ~[apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:726) ~[apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.StorageService.initServer(StorageService.java:617) ~[apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:391) [apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:566) [apache-cassandra-2.1.16.jar:2.1.16] at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:655) [apache-cassandra-2.1.16.jar:2.1.16]
1 1 1,331
1 REPLY 1

Anvi, this issue may have occurred because of multiple Cassandra nodes being started at the same time. When a new Cassandra node joins a ring, it needs to own a new token range and it has a 2 minute wait rule for gossip state to propagate before a node is added. This might be the reason for encountering this issue.

Can you please try starting one node at a time and keeping around two minutes of delay in between?

References:

http://mail-archives.apache.org/mod_mbox/cassandra-user/201905.mbox/%3CE13E45EA-7247-4C5A-AF85-E374C...

https://issues.apache.org/jira/browse/CASSANDRA-7069