Using psutil to investigate "Too many open files"

I was getting this intermittent error running my Datasette test suite:

OSError: [Errno 24] Too many open files

To figure out what was going on, I used the psutil package and its open_files() method.

Here's the documentation for psutil.Process.open_files.

I ran pip install psutil in my virtual environment.

Then I ran pytest --pdb to drop into a Python debugger when a test failed.

In the debugger I ran this:

import psutil
for f in psutil.Process().open_files(): print(f)

This showed the current list of open files for that process, which gave me some clues to help me start resolving the problem.

Related

• pytest Show files opened by pytest tests - 2022-12-11
• macos Using lsof on macOS - 2021-12-11
• python Tracing every executed Python statement - 2021-03-21
• pytest Mocking subprocess with pytest-subprocess - 2023-03-08
• python os.remove() on Windows fails if the file is already open - 2022-10-25
• docker Running gdb against a Python process in a running Docker container - 2021-03-21
• pytest Start a server in a subprocess during a pytest session - 2020-08-31
• python The pdb interact command - 2022-10-31
• pytest Using pytest and Playwright to test a JavaScript web application - 2022-07-24
• python Debugging a Click application using pdb - 2020-09-03

Created 2022-10-13T21:50:23-07:00 · Edit