How to use auto fill in Excel 2013 without formatting

This is probably the most annoying default setting in Excel 2013 (and also all other versions) since it's rarely the case that I want to use the default setting of this one. A table often have columns which is just a function of other column. You edit the first line and want to auto fill the rest to the bottom of the table. But if the first line has a border, then this border is copied along making the table ugly.

 

 

Say I want column 4 to auto fill from 1, 2, 3, 4 and so on to the end. Drag and click and the following is your result.

 

 

It copies the top border line of my first cell. It assumes that it should repeat this pattern every third cell, which clearly isn't my intention. But if you click the little box which appears afterwards you can select the option 'Fill Without Formatting'.

 

 

And the result is the way you want it. It's cumbersome, but it works.