Exception: No more data to read


#1

Hi,

I am using the latest version of the MapD Community AMI on AWS to load a slice of the NYC taxi dataset. The load was successful (some records were rejected):
mapdql> COPY jr_nyctaxidata from ‘/home/centos/nyctaxidata/nycyellowtaxi2016_jan_to_june.csv’;
Result
Loaded: 69397033 recs, Rejected: 9487 recs in 44.474000 secs

However, when I try reading the data, I see the following error:
mapdql> select * from jr_nyctaxidata limit 10;
Exception: No more data to read.

I checked the java version and the AMI has java 8 installed:
java -version
openjdk version "1.8.0_144"
OpenJDK Runtime Environment (build 1.8.0_144-b01)
OpenJDK 64-Bit Server VM (build 25.144-b01, mixed mode)

Please advise if I am missing anything here. Thanks.


#2

Try something like an aggregation to test the database ; you query is going to makes the system load all columns in memory and do a projection of the first 10 lines.


#3

Hi

Could you please share the file mapd_server.INFO so we can help diagnose your issue further

regards


#4

Hi,
I am unable to locate the mapd log files. I am using the latest MapD AMI on AWS. The MapD installation is at /opt/mapd/bin/mapd_server.

Thanks for your patience.


#5

Hi,

The log should be here /raidStorage/prod/mapd-storage/data/mapd_log/mapd_server.INFO on a standard AWS marketplace instance

Regards


#6

Thanks! Output of the .INFO log:

Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I1011 20:50:36.236632 1993 MapDServer.cpp:602] MapD started with data directory at '/raidStorage/prod/mapd-storage/data’
I1011 20:50:36.237464 1993 MapDServer.cpp:609] Watchdog is set to 1
I1011 20:50:36.237471 1993 MapDServer.cpp:631] cuda block size 0
I1011 20:50:36.237475 1993 MapDServer.cpp:632] cuda grid size 0
I1011 20:50:36.237479 1993 MapDServer.cpp:633] calcite JVM max memory 1024
I1011 20:50:36.237483 1993 MapDServer.cpp:634] MapD Server Port 9091
I1011 20:50:36.237486 1993 MapDServer.cpp:635] MapD Calcite Port 9093
I1011 20:50:36.237499 1993 MapDHandler.cpp:154] MapD Server 3.2.4-20171006-6a29a52
I1011 20:50:53.349933 1993 CudaMgr.cpp:127] Using 8 Gpus.
I1011 20:50:53.350281 1993 DataMgr.cpp:120] cpuSlabSize is 4096M
I1011 20:50:53.350307 1993 DataMgr.cpp:122] reserved GPU memory is 2035.35M includes render buffer allocation
I1011 20:50:53.351373 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351397 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351405 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351411 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351415 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351420 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351425 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.351433 1993 DataMgr.cpp:132] gpuSlabSize is 2048M
I1011 20:50:53.356129 1993 FileMgr.cpp:173] Completed Reading table’s file metadata, Elasped time : 0ms Epoch: 1 files read: 0 table location: '/raidStorage/prod/mapd-storage/data/mapd_data/table_0_0/'
I1011 20:50:53.356624 1993 Calcite.cpp:156] Creating Calcite Handler, Calcite Port is 9093 base data dir is /raidStorage/prod/mapd-storage/data
I1011 20:50:53.356637 1993 Calcite.cpp:95] Running calcite server as a daemon
I1011 20:50:53.900418 1993 Calcite.cpp:124] Calcite server start took 500 ms
I1011 20:50:53.900451 1993 Calcite.cpp:125] ping took 16 ms
I1011 20:50:53.905419 1993 Calcite.cpp:281] [{“name”:“Tan”,“ret”:“double”,“args”:[“double”]},{“name”:“Truncate__”,“ret”:“float”,“args”:[“float”,“i32”]},{“name”:“ln”,“ret”:“double”,“args”:[“double”]},{“name”:“distance_in_meters__”,“ret”:“double”,“args”:[“float”,“float”,“float”,“float”]},{“name”:“Floor__”,“ret”:“float”,“args”:[“float”]},{“name”:“Floor__2”,“ret”:“i32”,“args”:[“i32”]},{“name”:“Floor__3”,“ret”:“i64”,“args”:[“i64”]},{“name”:“rect_pixel_bin”,“ret”:“float”,“args”:[“float”,“float”,“float”,“i32”,“i32”]},{“name”:“Truncate”,“ret”:“double”,“args”:[“double”,“i32”]},{“name”:“Floor__1”,“ret”:“i16”,“args”:[“i16”]},{“name”:“radians”,“ret”:“double”,“args”:[“double”]},{“name”:“degrees”,“ret”:“double”,“args”:[“double”]},{“name”:“Ceil__”,“ret”:“float”,“args”:[“float”]},{“name”:“ln__”,“ret”:“double”,“args”:[“float”]},{“name”:“approx_distance_in_meters”,“ret”:“double”,“args”:[“float”,“float”,“float”,“float”]},{“name”:“reg_hex_vert_pixel_bin_y”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“i32”,“i32”]},{“name”:“reg_hex_vert_pixel_bin_x”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“i32”,“i32”]},{“name”:“Ceil__2”,“ret”:“i32”,“args”:[“i32”]},{“name”:“Ceil__1”,“ret”:“i16”,“args”:[“i16”]},{“name”:“Ceil__3”,“ret”:“i64”,“args”:[“i64”]},{“name”:“power”,“ret”:“double”,“args”:[“double”,“double”]},{“name”:“conv_4326_900913_x”,“ret”:“double”,“args”:[“double”]},{“name”:“reg_hex_horiz_pixel_bin_y”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“i32”,“i32”]},{“name”:“conv_4326_900913_y”,“ret”:“double”,“args”:[“double”]},{“name”:“Atan”,“ret”:“double”,“args”:[“double”]},{“name”:“reg_hex_horiz_pixel_bin_x”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“float”,“i32”,“i32”]},{“name”:“Floor”,“ret”:“double”,“args”:[“double”]},{“name”:“Log10”,“ret”:“double”,“args”:[“double”]},{“name”:“Truncate__1”,“ret”:“i16”,“args”:[“i16”,“i32”]},{“name”:“Truncate__2”,“ret”:“i32”,“args”:[“i32”,“i32”]},{“name”:“Log”,“ret”:“double”,“args”:[“double”]},{“name”:“Truncate__3”,“ret”:“i64”,“args”:[“i64”,“i32”]},{“name”:“Cos”,“ret”:“double”,“args”:[“double”]},{“name”:“Log__”,“ret”:“double”,“args”:[“float”]},{“name”:“Log10__”,“ret”:“double”,“args”:[“float”]},{“name”:“Asin”,“ret”:“double”,“args”:[“double”]},{“name”:“Cot”,“ret”:“double”,“args”:[“double”]},{“name”:“Tan__”,“ret”:“double”,“args”:[“float”]},{“name”:“rect_pixel_bin_x”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“i32”]},{“name”:“rect_pixel_bin_y”,“ret”:“float”,“args”:[“float”,“float”,“float”,“float”,“float”,“i32”]},{“name”:“distance_in_meters”,“ret”:“double”,“args”:[“double”,“double”,“double”,“double”]},{“name”:“round_to_digit”,“ret”:“double”,“args”:[“double”,“i32”]},{“name”:“Atan2”,“ret”:“double”,“args”:[“double”,“double”]},{“name”:“Acos”,“ret”:“double”,“args”:[“double”]},{“name”:“pi”,“ret”:“double”,“args”:[]},{“name”:“Sin”,“ret”:“double”,“args”:[“double”]},{“name”:“Ceil”,“ret”:“double”,“args”:[“double”]},{“name”:“Exp”,“ret”:“double”,“args”:[“double”]}]
I1011 20:50:53.907193 1993 MapDHandler.cpp:199] Started in GPU mode
I1011 20:50:54.011677 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.012101 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.012117 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.012177 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.067243 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.155200 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.156098 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.156112 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.156147 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.184392 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.194865 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.194917 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.194928 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.194957 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.224006 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.234556 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.235117 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.235143 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.235173 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.263721 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.276664 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.277139 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.277175 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.277207 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.305408 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.318879 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.319095 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.319108 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.319139 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.347491 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.362059 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.363137 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.363173 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.363204 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.391547 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:54.407161 1993 EglGLWindow.cpp:107] Window Setting: DRAWABLE_TYPE: PBUFFER.
I1011 20:50:54.408097 1993 EglUtils.cpp:61] EGL Setting: BITS_RGBA = 8.
I1011 20:50:54.408112 1993 EglUtils.cpp:84] EGL Setting: BITS_ALPHA = 8.
I1011 20:50:54.408141 1993 EglGLRenderer.cpp:101] Renderer Setting: USE_CORE_PROFILE: True.
I1011 20:50:54.436010 1993 EglGLRenderer.cpp:170] Renderer Setting: <OPENGL_MAJOR>.<OPENGL_MINOR>: 4.5.
I1011 20:50:55.129832 1993 QueryRenderManager.cpp:306] QueryRenderManager initialized for rendering. start GPU: 0, num GPUs: 8, Render cache limit: 500


#7

Hi,

you have sent a clean log with no query

In that directory you will see a new log for each start of the server

ls -ltr *INFO*
-rw-r--r--. 1 centos centos 6165 Aug 24 23:18 mapd_server.ip-172-31-0-230.centos.log.INFO.20170824-231708.2760
-rw-r--r--. 1 centos centos 1600 Oct 11 21:34 mapd_server.ip-172-31-37-200.centos.log.INFO.20171011-213357.2481
lrwxrwxrwx. 1 centos centos   65 Oct 11 21:34 mapd_server.INFO -> mapd_server.ip-172-31-37-200.centos.log.INFO.20171011-213403.2547
-rw-r--r--. 1 centos centos 5978 Oct 11 21:34 mapd_server.ip-172-31-37-200.centos.log.INFO.20171011-213403.2547

please gzip one of the ones you were running when you had the error and attach to the thread

regards


#8

Thanks. Please see attached log.mapd_server.log.zip (49.0 KB)


#9

Hi,

Looking at your log it would seem your calcite server is not behaving normally.

How did you start mapd? Is there any chance more than one instance of mapd is trying to run using the same port for the calcite server.

regards