Government refugee stance ‘unhelpful’