Build succeed but start mapd_server failed?


#1

Hi,

I’ve successfully built Mapd-core on a Ubuntu 16.04. All test case has been passed. However, when I try to start mapd_server, it always comes with this error:

Thrift: Fri Jul 21 00:20:26 2017 TSocket::open() connect() <Host: localhost Port: 9093>Connection refused
Thrift: Fri Jul 21 00:20:26 2017 TSocket::open() connect() <Host: localhost Port: 9093>Connection refused

It seems that port 9093 is used by calcite but it won’t connect. Can anyone give me some idea about this?

I built mapd-core in an nvidia-docker with Ubuntu 16.04 and CUDA8.0. Here is the docker run statement:
nvidia-docker run -d --privileged -it --name mapd_test_1 -p 9091:9091 -p 9092:9092 -p 9093:9093 nvidia/cuda

Thanks!!!


#2

Hi,

You can safely ignore these messages on startup.

When we start up we poll to see when the calcite service is available, unfortunately that message comes from deep in thrift and we don’t have direct control over it.

The option we have here is to wait more time before looking to see if calcite service is available, would be interested in peoples options as to whether we should wait longer before testing to avoid these messages, at the cost of say a 500ms pause when the DB comes up.

Regards


#3

Hi,

Thank you for your reply! However, if we ignore this problem, the mapd won’t start…
I tried like following:

root@09b44fb09853:/home/mapd-core/build/bin# ./mapdql -u mapd -p HyperInteractive 
Thrift: Mon Jul 24 23:52:14 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
Thrift: Mon Jul 24 23:52:14 2017 TSocket::open() connect() <Host: localhost Port: 9091>Connection refused
terminate called after throwing an instance of 'apache::thrift::transport::TTransportException'
  what():  connect() failed: Connection refused
Aborted

Please help me fix it.

Thank you!


#4

Hi,

Sorry you are still having an issue.

Please share the full mapd_server.INFO log from one of these failed runs plus the mapd.conf file you are using

regards.


#5

Hi,

Thanks! This is the mapd_server.INFO:

Log file created at: 2017/07/24 23:51:20
Running on machine: 09b44fb09853
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0724 23:51:20.527066    52 MapDServer.cpp:495] MapD started with data directory at 'data'
I0724 23:51:20.527262    52 MapDServer.cpp:502]  Watchdog is set to 1
I0724 23:51:20.527273    52 MapDServer.cpp:524]  cuda block size 0
I0724 23:51:20.527277    52 MapDServer.cpp:525]  cuda grid size  0
I0724 23:51:20.527279    52 MapDServer.cpp:526]  calcite JVM max memory  1024
I0724 23:51:20.527282    52 MapDServer.cpp:527]  MapD Server Port  9091
I0724 23:51:20.527285    52 MapDServer.cpp:528]  MapD Calcite Port  9093
I0724 23:51:20.528168    52 MapDHandler.cpp:147] MapD Server 3.1.3dev-20170719-3753c8a
I0724 23:51:26.599884    52 CudaMgr.cpp:127] Using 8 Gpus.
I0724 23:51:26.599993    52 DataMgr.cpp:120] cpuSlabSize is 4096M
I0724 23:51:26.600028    52 DataMgr.cpp:122] reserved GPU memory is 128M includes render buffer allocation
I0724 23:51:26.600040    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600044    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600049    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600054    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600056    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600060    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600064    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600067    52 DataMgr.cpp:132] gpuSlabSize is 2048M
I0724 23:51:26.600581    52 FileMgr.cpp:116] Read table metadata, Epoch is 0 for table data at 'data/mapd_data/table_0_0/'
I0724 23:51:26.600844    52 Calcite.cpp:223] Creating Calcite Handler,  Calcite Port is 9093 base data dir is data
I0724 23:51:26.600853    52 Calcite.cpp:161] Running calcite server as a daemon
I0724 23:51:27.026628    52 Calcite.cpp:190] Calcite server start took 400 ms 
I0724 23:51:27.026664    52 Calcite.cpp:191] ping took 12 ms 
I0724 23:51:27.031975    52 Calcite.cpp:458] [{"name":"Tan","ret":"double","args":["double"]},{"name":"Truncate__","ret":"float","args":["float","i32"]},{"name":"ln","ret":"double","args":["double"]},{"name":"distance_in_meters__","ret":"double","args":["float","float","float","float"]},{"name":"Floor__","ret":"float","args":["float"]},{"name":"Floor__2","ret":"i32","args":["i32"]},{"name":"Floor__3","ret":"i64","args":["i64"]},{"name":"Truncate","ret":"double","args":["double","i32"]},{"name":"Floor__1","ret":"i16","args":["i16"]},{"name":"radians","ret":"double","args":["double"]},{"name":"degrees","ret":"double","args":["double"]},{"name":"Ceil__","ret":"float","args":["float"]},{"name":"ln__","ret":"double","args":["float"]},{"name":"approx_distance_in_meters","ret":"double","args":["float","float","float","float"]},{"name":"Ceil__2","ret":"i32","args":["i32"]},{"name":"Ceil__1","ret":"i16","args":["i16"]},{"name":"Round","ret":"double","args":["double"]},{"name":"Ceil__3","ret":"i64","args":["i64"]},{"name":"power","ret":"double","args":["double","double"]},{"name":"conv_4326_900913_x","ret":"double","args":["double"]},{"name":"conv_4326_900913_y","ret":"double","args":["double"]},{"name":"Atan","ret":"double","args":["double"]},{"name":"Floor","ret":"double","args":["double"]},{"name":"Log10","ret":"double","args":["double"]},{"name":"Truncate__1","ret":"i16","args":["i16","i32"]},{"name":"Truncate__2","ret":"i32","args":["i32","i32"]},{"name":"Log","ret":"double","args":["double"]},{"name":"Truncate__3","ret":"i64","args":["i64","i32"]},{"name":"Cos","ret":"double","args":["double"]},{"name":"Log__","ret":"double","args":["float"]},{"name":"Log10__","ret":"double","args":["float"]},{"name":"Asin","ret":"double","args":["double"]},{"name":"Cot","ret":"double","args":["double"]},{"name":"Tan__","ret":"double","args":["float"]},{"name":"distance_in_meters","ret":"double","args":["double","double","double","double"]},{"name":"round_to_digit","ret":"double","args":["double","i32"]},{"name":"Atan2","ret":"double","args":["double","double"]},{"name":"Acos","ret":"double","args":["double"]},{"name":"pi","ret":"double","args":[]},{"name":"Sin","ret":"double","args":["double"]},{"name":"Ceil","ret":"double","args":["double"]},{"name":"Exp","ret":"double","args":["double"]}]
I0724 23:51:27.032662    52 MapDHandler.cpp:192] Started in GPU mode
I0724 23:51:37.883122    52 MapDServer.cpp:126] Interrupt signal (15) received.

And I couldn’t find a file named as mapd.conf, instead, I found a file named mapd.conf.sample under mapd-core folder with these:

port = 9091
http-port = 9090
data = "data"
read-only = false
verbose = false

[web]
port = 9092
frontend = "frontend"

#6

Hi

Your log looks fine and everything appears to be running as expected and on expected ports.

How are you starting mapd_server in you container?

There did not appear to be any kind of connection attempt in the log, and the error message indicates the same.
Your mapdql client cannot talk to your mapd_server for some reason. This probably means you have a firewall or something mis-configured in your dockers setup stopping the mapdql client from making a connection.

regards


#7

Hi,

I’ve tried to close the firewall of host and started mapd, but failed again. Here is how I started mapd in container: ../startmapd in build folder.


#8

Hi,

Can you see immerse if you go to localhost:9092 in a browser on the machine running the dockers container?

regards


#9

Yes, I can. I did see mapd Immerse on. That’s interesting!


#10

Hi,

Interesting yes, it makes no sense that mapdql would not be able to connect.

If you try to connect via mapdql from the local machine does it still have an issue. Are you sure you have a mapdql from the same release?

regards