Simple here means choosing an architecture that gets from input to desired output in as few steps as possible. Easy here means choosing an architecture that can be built quickly, or is in some way convenient.