1.2 million immigrants are gone from the US labor force, data shows