Is this game even possible without summons?

I'm in the third act on my first playthrough and I'm already thinking about the next character I want to play as. This time around, I'm full magic - staff in one hand, spell in the other, with healing and summoning on top.

I started thinking about playing the game without summons and just how much harder the game would be without them taking aggro.

Is it just always a good idea to invest a bit into summoning? Or can you effectively just tank crowds as a beastly two-hander warrior?