JupyterHub user processes aren't properly terminated #123

New issue

Closed

opened 2022-03-11 03:38:32 +00:00 by a · 4 comments

a commented

2022-03-11 03:38:32 +00:00

Owner

For some reason, there are a lot of leftover JupyterHub user processes if you check using htop or ps. They don't really do much but are kind of annoying and take up memory. We currently terminate JupyterLab servers using the idle culler after one hour of inactivity, but apparently not all the processes are terminated.

For some reason, there are a lot of leftover JupyterHub user processes if you check using `htop` or `ps`. They don't really do much but are kind of annoying and take up memory. We currently terminate JupyterLab servers using the [idle culler](https://github.com/jupyterhub/jupyterhub-idle-culler) after one hour of inactivity, but apparently not all the processes are terminated.

a added the

bug

label 2022-03-11 03:38:32 +00:00

a added this to the (deleted) project 2022-03-11 03:38:35 +00:00

a self-assigned this 2022-03-11 03:38:40 +00:00

a started working 2022-03-11 03:47:55 +00:00

a commented

2022-03-11 03:48:59 +00:00

Author

Owner

Yeah, this is a pretty serious memory leak. Currently leaking about 5GB of memory due to this.

a commented

2022-03-11 04:13:48 +00:00

Author

Owner

I added

# shutdown the server after no activity for 20 minutes
c.NotebookApp.shutdown_no_activity_timeout = 20 * 60
# shutdown kernels after no activity for 10 minutes
c.MappingKernelManager.cull_idle_timeout = 10 * 60
# Check every minute
c.MappingKernelManager.cull_interval = 60
# cull connected (e.g. Browser tab open)
c.MappingKernelManager.cull_connected = True

to /etc/jupyter/jupyter_notebook_config.py, hopefully that fixes it.

I added ``` # shutdown the server after no activity for 20 minutes c.NotebookApp.shutdown_no_activity_timeout = 20 * 60 # shutdown kernels after no activity for 10 minutes c.MappingKernelManager.cull_idle_timeout = 10 * 60 # Check every minute c.MappingKernelManager.cull_interval = 60 # cull connected (e.g. Browser tab open) c.MappingKernelManager.cull_connected = True ``` to `/etc/jupyter/jupyter_notebook_config.py`, hopefully that fixes it.

a stopped working 2022-03-11 04:14:09 +00:00

26min 14s

a commented

2022-03-11 04:23:56 +00:00

Author

Owner

Leaving a JupyterHub server open right now, I'll check back tomorrow morning to see if this has been fixed.