I know the shame of liking a lot of things and don't finding the time to master any of them. The only recommendation I can give you is to try to organize yourself better and work harder. I still think that we can learn all this things. With regard on how to get good at physics, I would say follow this three steps. 
1-. Think about what you are doing. The math is very important but so the physical understanding. That and the fact that is based on empirical observation is what makes it different from pure mathematics. 
2-. Do tons of exercises. When I say tons is all you see.
3-. Try to spend at least 10 minutes a day understanding/questioning/digging on things you want to understand from nature and do some research. 

Good luck. 
Paûlos.