“There’s a point at which … it doesn’t make a lot of sense for us to call everybody back in for a one day special session,” the speaker told a gathering of Republican seniors.