You can talk about at least two aspects of marriage: legal and ideally/emotionally.
Legally, a spouse gains a bunch of benefits (and some not) of being married. Like if you die, your stuff goes to the spouse, as opposed to if you're just living together, it goes to the next of kin (roughly)...