Build times are fixed. The only purpose served by having multiple commanders build a fort is that you won't lose your investment if one of them gets magically sniped.
Troops do not help at all. Soldiers are paid to stick pointy bits of metal into other people, not lift heavy stuff. That's what God made peasants for
.