Whilst the "Keep running in the background when the window is closed" option is enabled. Closing the window still completely closes the program for me.

Copy paste of some system information
Operating System: Arch Linux
KDE Plasma Version: 5.24.4
Kernel Version: 5.17.5-256-tkg-pds (64-bit)
Graphics Platform: Wayland
Processors: 16 × AMD Ryzen 7 3700X 8-Core Processor
Graphics Processor: AMD Radeon RX 550 / 550 Series