Definitely only AI, I wouldn't try that against a human with any experience unless I knew where his mages were not. And actually, the same applied to the AI. If I knew there were any serious mages in an enemy army, I avoided it and raided province defense.