Jobs monitor threads may saturate the system

Description

A timer bean in Hopsworks monitors the state of Yarn applications. When applications reach a final state it creates a thread to eventually aggregate the logs. The application might stay in AGGREGATING_LOGS state for more than one run of the monitor-timer bean. This creates multiple threads competing for the same resources but most importantly they can saturate Glassfish thread pool.

Assignee

Antonios Kouzoupis

Reporter

Antonios Kouzoupis

Labels

None

Fix versions

Affects versions

Priority

High
Configure