This also likely includes the library table. But you can copy it from one user to another if you have one account that has access to all this directories. I am uncertain if even the admin account would be powerful enough.
Otherwise place your main lib tables somewhere central and use startup scripts to get this files shared with the other users.
But maybe there is a windows internal way that has the config directory somewhere central but looks to kicad as if it was in the users folder. You might even be able to use the environment variable KICAD_CONFIG_HOME to point it to a central setup directory. (problem here is that “recently opened projects” is also stored there which you might not particularly like as there could be privacy concerns. Also it might be annoying to everyone involved if they did not work for some time and suddenly have non of their projects in this list.)
This might be a good read: Where are the configuration files (settings, library tables)?