There are different ways of looking at this. Where a to-infinitive clause is acting adverbially, then it could be argued to have an implied subject that matches the verb it modifies, if it has any implied subject at all. It can be helpful to mentally remove words to see what is modifying what.
On the other hand, you also have to think about the semantics - if there's an actual action involved, someone must be doing it. Often, there is more than one possible interpretation that might be resolved by the context - or might not be.
Most of the time, native speakers don't really think about the implied subject of a non-finite verb. The meaning is usually clear without bothering to think about it. Hopefully, that will be the case for learners as well, with enough practice.
Temporary unemployment caused by the time required of workers to move from one job to another.
... unemployment caused by the time required ... to move from one job to another.
... the time required to move from one job to another
The to-clause is acting as an adverb on required, not on a verb. It is a parameter saying what the time is required for. It has no subject. However, we can also think about who is doing the moving from one job to another. Obviously, it's the employees. So, from one angle is there is no subject; from another, it's the unspecified, general employees.
He recruited new employees to solve this problem.
He recruited ... to solve this problem.
Here, the to-clause is acting as an adverb on recruited, so grammatically it would appear to have the implied subject he. However, we want to think about who is doing the solving. Thus, it could be the new employees, or it could be the person recruiting them. Either could work; it he could have a problem with staffing levels in his restaurant, and recruiting new employees is the solution, or he could be running a software company and none of the current employees can work out how to do something - so he hired more people so the new people could solve that. You would have to work it out from context.