IB -> MSF Program and CFA?

I'm currently nearing the end of my first year at a MM coverage group, but don't see myself wanting to stay in IB or pursue PE. I'm interested in pursuing investment management at an endowment / foundation or family office, as well as asset management. Would it be worthwhile for me to pursue a top MSF program (UTA, Vandy, WUSTL, etc.), and eventually the CFA? For additional color, I went to a non-target ACC school for my undergrad (finance).
My reasons in favor of pursuing an MSF are: (1) formally recruit into an investment management type program, (2) better brand at a top program to build network and optionality, and (3) I want to relocate cities and would be most interested in Nashville / Austin / or the Northeast, so pursuing an MSF in one of those places would provide additional access to recruit there.
My reasons against pursuing an MSF are: (1) Wasting the IB experience, as most students in the MSF program came straight from undergrad and are trying to pursue IB. (2) I may end up being a year or two behind other industry peers, and (3) Is it really necessary to do an MSF if I want to pursue investment management, and would it provide enough of an advantage to justify the cost / opportunity cost?
Appreciate any thoughts or advice on the above.
Thanks!