> some people just don't do well without the in-person structure

Structure is what makes remote work well. IME places that rely on everyone being together in-person to make sure things get done have poorly-defined structure.