The business mogul’s use of guest workers and contradictions on his trademark issue are causing consternation.