Perhaps, but that doesn’t sound like you should lower productivity for everyone else hoping that it’ll reduce the need for managers to do their jobs. I’ve seen too many people spend 8 in the office working mostly on fantasy football or Facebook to think that changing locations is an effective solution.
Not OP, but I think most manages genuinely struggle with this because it is hard. Im not sure what the solution is. Perhaps they need to double the pay for management to hire folks who can tell the difference?