you'll need to set up a Priority queue, which is separate from the one you've already added. It'll actually instantly ask you to place a Priority queue once you toggle the setting on. You then ...

There's also a low-priority queue, too. This'll be familiar to anyone coming over from Dota 2, but essentially, abandoning games or being rude will put you in a queue with other sinners ...