Do we have to sync our whole workforce?

No. Filter by location, employment status, or employment type, and a preview shows exactly who matches and why before anything is shared. If you add no filters, everyone is included.