I haven't been in that situation. When I started freelancing my only other commitment was college.
You have to balance a lot of things before deciding to go freelancing full-time. Finances, for me, is a big thing. A lot of people go freelancing without planning and then fail because they can't get enough clients initially to get a good cashflow going.
If your job is good and still gives you the chance of investing in a translators career, why not stick to it until you get enough experience (and training) so you can market yourself better when you decide to go freelancing full time?