ERROR: Adding virtual host and alias failed

[#1]

I have recently installed a standalone version of API MAnagement on a centos VM. The installation was successful but I am getting a few errors during creation of environment. Overall I have one VM that hosts the Management Server and the other one has Analytics components.

It would be great if someone explains whats going wrong here.

The error on ./add-env.sh script is as :

Add the virtual host --> curl -X POST http://172.16.32.93:8080/v1/organizations/ci/envi... [...] { "code" : "datastore.ErrorWhileAccessingDataStore", "message" : "Error while accessing datastore;Please retry later", "contexts" : [ ] } ==> 500

Analytics Configuration All Postgres Servers All Qpid Servers Ingest:Qpid-list --> curl -X POST http://172.16.32.93:8080/v1/organizations/ci/envi... [...] { "code" : "No postgres-server specified in servers list", "message" : "No postgres-server specified in servers list", "contexts" : [ ] } ==> 400

The management server system logs has the following trace :

2015-09-24 00:35:25,482 172.16.32.93 management-server org:ci Apigee-Main-9 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.fetchColumnValueAsByteArray() : Exception while fetchColumnValueAsByteArray for rowKey : [ci, organizations, apprepo] from columnFamilyName : com.netflix.astyanax.connectionpool.exceptions.NoAvailableHostsException: NoAvailableHostsException: [host=None(0.0.0.0):0, latency=0(0), attempts=0]No hosts to borrow from in keyspace : {} 2015-09-24 00:35:25,482 172.16.32.93 management-server org:ci Apigee-Main-9 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.logHostPoolInCaseOfErrors() : Cassandra Host Pool under use - All Hosts: . Active Hosts: 2015-09-24 00:35:25,483 172.16.32.93 management-server org:ci Apigee-Main-9 ERROR ORGANIZATIONS - EnvironmentFactory.notifyCreate() : EnvironmentFactory.notifyCreate() : Notifying listener: com.apigee.distribution.OrganizationManager@32f046fe for delete of environment : {}prod1 com.apigee.datastore.DataAccessException: Error while accessing datastore;Please retry later at com.apigee.datastore.client.astyanax.AstyanaxCassandraClient.fetchColumnValueAsByteArray(AstyanaxCassandraClient.java:1122) ~[datastore-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepositoryDelegate.readFromCassandra(CassandraRepositoryDelegate.java:554) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepositoryDelegate.doesPathExistInOrganizationColumnFamily(CassandraRepositoryDelegate.java:1355) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepositoryDelegate.exists(CassandraRepositoryDelegate.java:1338) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepository.exists(CassandraRepository.java:105) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:223) ~[repository-impl-1.0.0.jar:na] at com.apigee.beans.BeanUtil.exists(BeanUtil.java:141) ~[beans-1.0.0.jar:na] at com.apigee.beans.BeanFactory.loadFromRepository(BeanFactory.java:75) ~[beans-1.0.0.jar:na] at com.apigee.beans.AbstractBeanFactory.get(AbstractBeanFactory.java:122) ~[beans-1.0.0.jar:na] at com.apigee.distribution.OrganizationFactory.getOrganization(OrganizationFactory.java:50) ~[application-distribution-1.0.0.jar:na] at com.apigee.distribution.OrganizationManager.getOrganization(OrganizationManager.java:73) ~[application-distribution-1.0.0.jar:na] at com.apigee.distribution.OrganizationManager.onCreate(OrganizationManager.java:103) ~[application-distribution-1.0.0.jar:na] at com.apigee.environments.EnvironmentFactory.notifyCreate(EnvironmentFactory.java:77) [organizations-1.0.0.jar:na] at com.apigee.environments.EnvironmentFactory.create(EnvironmentFactory.java:66) [organizations-1.0.0.jar:na] at com.apigee.organizations.OrganizationBean.createEnvironment(OrganizationBean.java:282) [organizations-1.0.0.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_79] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_79] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_79] at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_79] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173) [cxf-rt-core-2.4.7.jar:2.4.7] at com.apigee.rest.framework.CustomJAXRSInvoker.performInvocation(CustomJAXRSInvoker.java:125) [rest-1.0.0.jar:na] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:165) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:241) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:241) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:92) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) [cxf-rt-core-2.4.7.jar:2.4.7] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_79] at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) [cxf-api-2.4.7.jar:2.4.7] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:207) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:209) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:152) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:114) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:185) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:108) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [servlet-api-3.0.20100224.jar:na] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:164) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:558) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1366) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:77) [jetty-servlets-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:181) [jetty-servlets-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:520) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:973) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:417) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:907) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:110) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.Server.handle(Server.java:350) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:442) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:941) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:801) [jetty-http-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:224) [jetty-http-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:51) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:586) [jetty-io-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:44) [jetty-io-8.0.4.v20111024.jar:8.0.4.v20111024] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_79] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79] 2015-09-24 00:35:25,785 172.16.32.93 management-server Apigee-Main-7 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.insert() : Exception while insert rowkey [0d41bf43-9420-4fd5-b089-7cbd84c5616c, audits, audit] to the columnFamily : com.netflix.astyanax.connectionpool.exceptions.NoAvailableHostsException: NoAvailableHostsException: [host=None(0.0.0.0):0, latency=0(0), attempts=0]No hosts to borrow from in the keyspace {} 2015-09-24 00:35:25,785 172.16.32.93 management-server Apigee-Main-7 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.logHostPoolInCaseOfErrors() : Cassandra Host Pool under use - All Hosts: . Active Hosts: 2015-09-24 00:35:26,134 172.16.32.93 management-server Apigee-Main-8 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.insert() : Exception while insert rowkey [aa627dc0-7c9a-4736-9615-8e35e8ef51f0, audits, audit] to the columnFamily : com.netflix.astyanax.connectionpool.exceptions.NoAvailableHostsException: NoAvailableHostsException: [host=None(0.0.0.0):0, latency=0(0), attempts=0]No hosts to borrow from in the keyspace {} 2015-09-24 00:35:26,135 172.16.32.93 management-server Apigee-Main-8 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.logHostPoolInCaseOfErrors() : Cassandra Host Pool under use - All Hosts: . Active Hosts: 2015-09-24 00:35:26,144 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-6 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.getColumnNames() : Exception while fetching rowKey : [ci, organizations, apprepo] from columnFamilyName : com.netflix.astyanax.connectionpool.exceptions.NoAvailableHostsException: NoAvailableHostsException: [host=None(0.0.0.0):0, latency=0(0), attempts=0]No hosts to borrow from in keyspace : {} 2015-09-24 00:35:26,144 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-6 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.logHostPoolInCaseOfErrors() : Cassandra Host Pool under use - All Hosts: . Active Hosts: 2015-09-24 00:35:26,146 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-6 ERROR REST - CustomJAXRSInvoker.performInvocation() : CustomJAXRSInvoker.performInvocation : Method com.apigee.distribution.EnvironmentAPIImpl.internalGetEnvironment threw an exception. com.apigee.datastore.DataAccessException: Error while accessing datastore;Please retry later at com.apigee.datastore.client.astyanax.AstyanaxCassandraClient.getColumnNames(AstyanaxCassandraClient.java:1251) ~[datastore-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepositoryDelegate.doesPathExistInOrganizationColumnFamily(CassandraRepositoryDelegate.java:1359) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepositoryDelegate.exists(CassandraRepositoryDelegate.java:1338) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.nosql.CassandraRepository.exists(CassandraRepository.java:105) ~[repository-impl-1.0.0.jar:na] at com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:223) ~[repository-impl-1.0.0.jar:na] at com.apigee.beans.BeanFactory.exists(BeanFactory.java:98) ~[beans-1.0.0.jar:na] at com.apigee.distribution.OrganizationFactory.exists(OrganizationFactory.java:92) ~[application-distribution-1.0.0.jar:na] at com.apigee.distribution.OrganizationManager.exists(OrganizationManager.java:77) ~[application-distribution-1.0.0.jar:na] at com.apigee.distribution.EnvironmentAPIImpl.checkIfOrgExists(EnvironmentAPIImpl.java:67) ~[application-distribution-1.0.0.jar:na] at com.apigee.distribution.EnvironmentAPIImpl.internalGetEnvironment(EnvironmentAPIImpl.java:61) ~[application-distribution-1.0.0.jar:na] at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_79] at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_79] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173) [cxf-rt-core-2.4.7.jar:2.4.7] at com.apigee.rest.framework.CustomJAXRSInvoker.performInvocation(CustomJAXRSInvoker.java:125) ~[rest-1.0.0.jar:na] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:165) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:241) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:92) [cxf-rt-frontend-jaxrs-2.4.7.jar:2.4.7] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58) [cxf-rt-core-2.4.7.jar:2.4.7] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_79] at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_79] at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) [cxf-api-2.4.7.jar:2.4.7] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121) [cxf-rt-core-2.4.7.jar:2.4.7] at org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:207) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:209) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:152) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:114) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:185) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:108) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at javax.servlet.http.HttpServlet.service(HttpServlet.java:754) [servlet-api-3.0.20100224.jar:na] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:164) [cxf-rt-transports-http-2.4.7.jar:2.4.7] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:558) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1366) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:77) [jetty-servlets-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:181) [jetty-servlets-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:486) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:520) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:973) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:417) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:907) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:110) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.Server.handle(Server.java:350) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:442) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.HttpConnection$RequestHandler.content(HttpConnection.java:941) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:801) [jetty-http-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:224) [jetty-http-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:51) [jetty-webapp-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:586) [jetty-io-8.0.4.v20111024.jar:8.0.4.v20111024] at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:44) [jetty-io-8.0.4.v20111024.jar:8.0.4.v20111024] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_79] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_79] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_79] 2015-09-24 00:35:26,146 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-6 ERROR REST - ExceptionMapper.toResponse() : Error occurred : Error while accessing datastore;Please retry later com.apigee.datastore.client.astyanax.AstyanaxCassandraClient.getColumnNames(AstyanaxCassandraClient.java:1251) com.apigee.services.repository.nosql.CassandraRepositoryDelegate.doesPathExistInOrganizationColumnFamily(CassandraRepositoryDelegate.java:1359) com.apigee.services.repository.nosql.CassandraRepositoryDelegate.exists(CassandraRepositoryDelegate.java:1338) com.apigee.services.repository.nosql.CassandraRepository.exists(CassandraRepository.java:105) com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:223) com.apigee.beans.BeanFactory.exists(BeanFactory.java:98) com.apigee.distribution.OrganizationFactory.exists(OrganizationFactory.java:92) com.apigee.distribution.OrganizationManager.exists(OrganizationManager.java:77) com.apigee.distribution.EnvironmentAPIImpl.checkIfOrgExists(EnvironmentAPIImpl.java:67) com.apigee.distribution.EnvironmentAPIImpl.internalGetEnvironment(EnvironmentAPIImpl.java:61) sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) java.lang.reflect.Method.invoke(Method.java:606) org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173) com.apigee.rest.framework.CustomJAXRSInvoker.performInvocation(CustomJAXRSInvoker.java:125) 2015-09-24 00:35:26,147 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-6 ERROR REST - ExceptionMapper.toResponse() : Returning error response : ErrorResponse{errorCode = datastore.ErrorWhileAccessingDataStore, errorMessage = Error while accessing datastore;Please retry later} 2015-09-24 00:35:40,947 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-5 ERROR KERNEL - ErrorMessages.getFormattedMessage() : getFormattedMessage() : Unable to locate a resource bundle for error code No postgres-server specified in servers list 2015-09-24 00:35:40,947 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-5 ERROR REST - CustomJAXRSInvoker.performInvocation() : CustomJAXRSInvoker.performInvocation : Method com.apigee.analytics.dataapi.impl.AdminResourceImpl.addCustomerConfig threw an exception. 2015-09-24 00:35:40,948 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-5 ERROR REST - ExceptionMapper.toResponse() : Error occurred : No postgres-server specified in servers list com.apigee.analytics.dataapi.impl.AdminResourceImpl.addCustomerConfig(AdminResourceImpl.java:143) sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2015-09-24 00:35:40,948 172.16.32.93 management-server org:ci env:prod1 Apigee-Main-5 ERROR REST - ExceptionMapper.toResponse() : Returning error response : ErrorResponse{errorCode = No postgres-server specified in servers list, errorMessage = No postgres-server specified in servers list} 2015-09-24 00:35:41,250 172.16.32.93 management-server Apigee-Main-8 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.insert() : Exception while insert rowkey [9aed474d-be0a-4df1-92b4-b427fd8a4b01, audits, audit] to the columnFamily : com.netflix.astyanax.connectionpool.exceptions.NoAvailableHostsException: NoAvailableHostsException: [host=None(0.0.0.0):0, latency=0(0), attempts=0]No hosts to borrow from in the keyspace {} 2015-09-24 00:35:41,250 172.16.32.93 management-server Apigee-Main-8 ERROR DATASTORE.CASSANDRA - AstyanaxCassandraClient.logHostPoolInCaseOfErrors() : Cassandra Host Pool under use - All Hosts: . Active Hosts:

[Former Community Member]

Seems like a configuration / permissions issue. Are your other components like Cassandra/Zookeeper deployed on separate VMs & are all the required network ports open for the different components to communicate with each other? Please consider opening a support ticket for this issue.

[#3]

@Prithpal Bhogill

Cassandra is on the same VM with other components. I am following standalone installation with two servers.

sa : VM1 (Zookeeper,Cassandra,Management server,Edge ui, openLdap, router, message proc)

sax : VM2 (postgres server, qpid server)

Let me try to see if all the ports are open.

FYI : ./all-status.sh script shows all components as up.

IS there any script that I can run to check communication between Cassandra and other components.

[#4]

You cassandra does not seem to be accessible.

[Former Community Member]

Would recommend that you follow steps documented in "How to monitor" section of the Operations Guide. There are steps to check individual components & their connectivity beyond just a simple "are they up" check. Also as I mentioned earlier, you should consider opening a support ticket for this.

[#6]

Thanks!

Issue was regarding noexec access to /temp folder during installation. Made changes to access and exec rights to temp folder and re installed. Issue no longer observed.