If a situation, problem, decision, etc. comes down to something, then that is the thing that will influence it most.