Set up your permissioned inheritance structure.
Permissions will be granted to agents if no activity is detected for this duration.