Mass firings have begun at federal agencies, with terminations of probationary employees underway at the Department of Education and the Small Business Administration, federal employees and union sources told CNN Wednesday.