yeah, sorry i missunderstood. should have payed more attension to your sketch
yeah that looks spot on. It isn't really needed to have the patch panel, but it does make your cable management a lot easier as you should have each port numbered correctly at each end so when you want to enable a port it only takes seconds. We do this at work with about 50 ports shared between phone and data.