For me the biggest difference is the water.

When I use soap I put some water on top of the soap while the brush soaks. Then I dump the soap water into my bowl and completely shake out the brush....