Basically, yes! Although Microsoft's Internet Explorer is by far the main browser used throughout the world, you do need to ensure all your site's visitors can see your site as you intended.
The other main browers are Firefox, Opera and Safari. Safari is the main browser used by Apple users.