1 follower Follow

Rstudio Server crashing and leaving process in background


I am working with an Rstudio server on a Linux machine, R version 3.4.1 64 bit. I am working with a large data table (~500million rows and ~50 columns) but I am getting random crashes with the message "R session was abnormally terminated due to an unexpected crash". I left some code running overnight on a Friday evening and on Monday I found out the session had crashed but there was a Linux process in the background consuming a lot of memory (200 GB) under the rstudio Linux user. The R sessions I launch use my personal Linux user when I list them using "ps", not the rstudio user. The process was created on Saturday (same day the crash happened), and noone used the server that day. R session timeout is disabled using session-timeout-minutes=0. The process is listed in ps as "/usr/lib/rstudio-server/bin/rsession -u rstudio"

What can be causing the random crashes when working with large datasets? What is the process that is taking that much memory? 

Miguel Rodriguez