What happens when the column is set to auto increment and you reach the maximum value for that table ?

It stops incrementing. It does not overflow to 0 to prevent data losses, but further inserts are going to produce an error, since the key has been used already.