Second that one. Its gotta be the connection.
Also, your connection won't be as good using a wireless setup, seems to work way better hard-wired to your internet router (at least on the Xbox side of things).
But yeah, your connection sounds like its pretty weak if you can't stay in lobby.
Get high-speed cable internet and all problems solved
