Solved: Unable to start Message Processor

Report Inappropriate Content · 06-09-2017 02:56 AM

Please review the below MP error log

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff} p.p2 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff; min-height: 13.0px} span.s1 {font-variant-ligatures: no-common-ligatures} span.Apple-tab-span {white-space:pre}

2017-06-09 09:54:21,371 main ERROR KERNEL.DEPLOYMENT - ServiceDeployer.startService() : ServiceDeployer.deploy() : Got a life cycle exception while starting service [MessageProcessorService, Failed to start server on "/54.246.82.212:8998"] : {}

com.apigee.errors.http.server.ServiceFailureException: Failed to start server on "/54.246.82.212:8998"

at com.apigee.protocol.http.HTTPServer.start(HTTPServer.java:166) ~[http-1.0.0.jar:na]

at com.apigee.messaging.adaptors.http.configuration.MessageProcessorHttpSkeletonFactory$1.start(MessageProcessorHttpSkeletonFactory.java:115) ~[http-adaptor-1.0.0.jar:na]

at com.apigee.messaging.configuration.MessageProcessorServiceImpl.registerHttpServer(MessageProcessorServiceImpl.java:364) ~[message-processor-1.0.0.jar:na]

at com.apigee.messaging.configuration.MessageProcessorServiceImpl.start(MessageProcessorServiceImpl.java:212) ~[message-processor-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.startService(ServiceDeployer.java:168) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deploy(ServiceDeployer.java:71) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deployDependantServices(ServiceDeployer.java:356) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deploy(ServiceDeployer.java:77) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.deployAll(MicroKernel.java:185) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.start(MicroKernel.java:146) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.start(MicroKernel.java:141) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.main(MicroKernel.java:91) [microkernel-1.0.0.jar:na]

Caused by: java.net.BindException: Cannot assign requested address

at sun.nio.ch.Net.bind0(Native Method) ~[na:1.8.0_131]

at sun.nio.ch.Net.bind(Net.java:433) ~[na:1.8.0_131]

at sun.nio.ch.Net.bind(Net.java:425) ~[na:1.8.0_131]

at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[na:1.8.0_131]

at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[na:1.8.0_131]

at com.apigee.nio.ServerChannel.bind(ServerChannel.java:44) ~[nio-1.0.0.jar:na]

at com.apigee.protocol.http.HTTPServer.start(HTTPServer.java:157) ~[http-1.0.0.jar:na]

... 11 common frames omitted

2017-06-09 09:54:21,372 main ERROR KERNEL - MicroKernel.deployAll() : MicroKernel.deployAll() : Error in deploying the deployment : APIClassificationService

com.apigee.errors.http.server.ServiceFailureException: Failed to start server on "/54.246.82.212:8998"

at com.apigee.protocol.http.HTTPServer.start(HTTPServer.java:166) ~[http-1.0.0.jar:na]

at com.apigee.messaging.adaptors.http.configuration.MessageProcessorHttpSkeletonFactory$1.start(MessageProcessorHttpSkeletonFactory.java:115) ~[http-adaptor-1.0.0.jar:na]

at com.apigee.messaging.configuration.MessageProcessorServiceImpl.registerHttpServer(MessageProcessorServiceImpl.java:364) ~[message-processor-1.0.0.jar:na]

at com.apigee.messaging.configuration.MessageProcessorServiceImpl.start(MessageProcessorServiceImpl.java:212) ~[message-processor-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.startService(ServiceDeployer.java:168) ~[microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deploy(ServiceDeployer.java:71) ~[microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deployDependantServices(ServiceDeployer.java:356) ~[microkernel-1.0.0.jar:na]

at com.apigee.kernel.service.deployment.ServiceDeployer.deploy(ServiceDeployer.java:77) ~[microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.deployAll(MicroKernel.java:185) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.start(MicroKernel.java:146) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.start(MicroKernel.java:141) [microkernel-1.0.0.jar:na]

at com.apigee.kernel.MicroKernel.main(MicroKernel.java:91) [microkernel-1.0.0.jar:na]

Caused by: java.net.BindException: Cannot assign requested address

at sun.nio.ch.Net.bind0(Native Method) ~[na:1.8.0_131]

at sun.nio.ch.Net.bind(Net.java:433) ~[na:1.8.0_131]

at sun.nio.ch.Net.bind(Net.java:425) ~[na:1.8.0_131]

at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) ~[na:1.8.0_131]

at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[na:1.8.0_131]

at com.apigee.nio.ServerChannel.bind(ServerChannel.java:44) ~[nio-1.0.0.jar:na]

at com.apigee.protocol.http.HTTPServer.start(HTTPServer.java:157) ~[http-1.0.0.jar:na]

... 11 common frames omitted

2017-06-09 09:54:21,374 Thread-2 INFO KERNEL - ShutdownHook.run() : ShutdownHook.run : System shutdown in progress...

2017-06-09 09:54:21,375 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : ServerBindService

2017-06-09 09:54:21,375 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : ServerRegistrationService

2017-06-09 09:54:21,376 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : RepositoryService

2017-06-09 09:54:21,383 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : ZooKeeperService

2017-06-09 09:54:21,384 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : MachineKeyService

2017-06-09 09:54:21,384 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : EventService

2017-06-09 09:54:22,388 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : CommunicationService

2017-06-09 09:54:22,393 Thread-2 INFO o.e.j.s.AbstractConnector - AbstractConnector.doStop() : Stopped ServerConnector@1f84f25f{HTTP/1.1,[http/1.1]}{0.0.0.0:8082}

2017-06-09 09:54:22,393 Thread-2 INFO o.e.jetty.server.session - HouseKeeper.stopScavenging() : Stopped scavenging

2017-06-09 09:54:22,396 Thread-2 INFO o.e.j.s.h.ContextHandler - ContextHandler.doStop() : Stopped o.e.j.w.WebAppContext@6b777b7e{/,null,UNAVAILABLE}{/api}

2017-06-09 09:54:22,396 Thread-2 INFO KERNEL.DEPLOYMENT - ServiceDeployer.stopService() : ServiceDeployer.unDeploy() : Successfully stopped the service : WebService

Report Inappropriate Content

@Madhu ,

Caused by: java.net.BindException: Cannot assign requested address - Looks like some other process is running on that port (address already in use), run netstat -anp | grep 8998 and check the output.

View solution in original post

Report Inappropriate Content

@Madhu ,

Caused by: java.net.BindException: Cannot assign requested address - Looks like some other process is running on that port (address already in use), run netstat -anp | grep 8998 and check the output.

Report Inappropriate Content

[root@node2 ~]# netstat -anp | grep 8998

[root@node2 ~]#

No output, that means port is not used.

Report Inappropriate Content

Whats your ifconfig and hostname-i outputs?

What value do you have for BIND_ON_ALL_INTERFACES in your config file?

Report Inappropriate Content

Ifconfig output

eth0 Link encap:Ethernet HWaddr 0A:49:8B:F4:1B:E1

inet addr:10.3.5.186 Bcast:10.3.5.255 Mask:255.255.255.0

inet6 addr: fe80::849:8bff:fef4:1be1/64 Scope:Link

UP BROADCAST RUNNING MULTICAST MTU:9001 Metric:1

RX packets:350189 errors:0 dropped:0 overruns:0 frame:0

TX packets:150894 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1000

RX bytes:369884399 (352.7 MiB) TX bytes:16391503 (15.6 MiB)

lo Link encap:Local Loopback

inet addr:127.0.0.1 Mask:255.0.0.0

inet6 addr: ::1/128 Scope:Host

UP LOOPBACK RUNNING MTU:65536 Metric:1

RX packets:20566 errors:0 dropped:0 overruns:0 frame:0

TX packets:20566 errors:0 dropped:0 overruns:0 carrier:0

collisions:0 txqueuelen:1

RX bytes:2961836 (2.8 MiB) TX bytes:2961836 (2.8 MiB)

What value do you have for BIND_ON_ALL_INTERFACES in your config file?

>Can you please let me know where I can find the bind interfaces config file?

Report Inappropriate Content

10.3.5.186 is your internal ip and I believe the 54.246.82.212 is your public IP?
Whats the hostname-i output? that is what you should be using in your config file.
BIND_ON_ALL_INTERFACES is in your installation config file.

check this http://docs.apigee.com/private-cloud/latest/install-edge-components-node

Report Inappropriate Content

Thanks, Maruti, I have resolved the issue. The problem my host entries are pointing to external IP, no have pointed correctly and finally, MP service is started successfully.

[root@node3 ~]# /opt/apigee/apigee-service/bin/apigee-all status

+ apigee-service apigee-cassandra status

apigee-service: apigee-cassandra: OK

+ apigee-service apigee-zookeeper status

apigee-service: apigee-zookeeper: OK

+ apigee-service edge-message-processor status

apigee-service: edge-message-processor: OK

+ apigee-service edge-router status

apigee-service: edge-router: OK

Many Thanks,

Madhu