At the trial in summary cases, if by jury, the United States and the accused shall each be entitled to three peremptory challenges. Challenges for cause, in such cases, shall be tried by the court without the aid of triers.