Floating-point numbers have values for negative zero, infinity, and negative infinity, which represent overflow and underflow in calculations. They also include not-a-number (NaN) values to represent an invalid or undefined result, such as dividing zero by zero. This behavior is different from integers, which stop the program if they can't represent the result.