Some Confederate soldiers even stopped by for the occasion