I can't imagine anyone objecting to us only taking in 20,000 refugees a year for the next few years - well, unless they think that's too low. We had no problems taking 55,000 Vietnamese refugees at the same time as 13,000 Cambodian refugees after the Vietnam war. That's 68,000 refugees when Canada's population was about 2/3 of what it is now. That would be the equivalent to over 100,000 refugees now.
And this was just after we took in 13,000 Chilean refugees, 7,000 Ugandan refugees, 20,000 Soviet Jews, and I'm not sure how many Iranian refugees after the fall of the Shah.