BORDER is used for image submit buttons. BORDER indicates if there should be a visible border around the image. BORDER only has an effect in Netscape. MSIE does not put any visible border around image submits.
By default, Netscape puts a border around image submit buttons. By setting BORDER to zero you remove that border: