Strange? Maybe it's not so obvious because it's not so important at all! :p
But honestly here, I think this is one of those "can't see the forest for the trees" types of situations. For INSERT queries, you should always name the columns within the query. For your LOAD DATA INFILE query, you could write it like so:
LOAD DATA LOCAL INFILE 'data.txt'
INTO TABLE table
FIELDS TERMINATED BY ','
LINES TERMINATED BY '\n'
(id, name, age)
Once again, doing this makes it easy to see which order to have the data in (or the opposite; if the data changes, it's quite simple to adjust the query accordingly).
Finally... if you stubbornly refuse to listen to our advice and would rather use a rather unreliable workaround to avoid fixing your problem, you can use the ALTER TABLE syntax to change the order:
ALTER TABLE myTable MODIFY column_name column_definition AFTER column2_name
Note that this requires you to know the column's definition (get it wrong, and the column will be changed - oops!).