Will employees be signed in automatically?

That depends on the SSO setup between your identity provider and Udemy Business. The integration points links at your account, but sign-in behavior is controlled by your SSO.