Cassandra backup failing in OPDK version 4.14.07.00

Not applicable

WE have 6 nodes DS (3 in DC-1 & 3 more in DC-2). The DC-2 backup of cassandra nodes were failing with below error.

Requested creating snapshot for: user_settings Exception in thread "main" java.io.IOException: Table user_settings does not exist at org.apache.cassandra.service.StorageService.getValidTable(StorageService.java:2267) at org.apache.cassandra.service.StorageService.takeSnapshot(StorageService.java:2222) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93) at com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27) at com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208) at com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120) at com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262) at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836) at com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761) at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1427) at javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72) at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1265) at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1360) at javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:788) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305) at sun.rmi.transport.Transport$1.run(Transport.java:159) at java.security.AccessController.doPrivileged(Native Method) at sun.rmi.transport.Transport.serviceCall(Transport.java:155) at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Error: Cannot backup keyspace 'user_settings' Exiting

Any help on this would be appreciated.

Thanks,

Mani

0 5 468
5 REPLIES 5

Not applicable

@rkmani78@gmail.com user_settings is a valid keyspace.

Can you run show keyspaces from cassandra-cli and see if it lists usersettings and if you can connect to it? like this [default@kms] use user_settings;

Not applicable

Here is the show schema output from the cassandra node. It is not having the user_settings listed in it.

cassandra-schema.txt

How did you try to take the backup? nodetool? @rkmani78@gmail.com and also check if other DC c* nodes has this keyspace?

Not applicable

No, using the <INSTALL_ROOT>/apigee4/bin/backup.sh -i <INSTALL_ROOT>

Thanks,

Mani

the backup.sh uses the nodetool to backup each keyspace which it gets from the show schemas. Can you try nodetool snapshot directly and see if backup works fine?