Picture showing how to place 4,7 or 10 ants:
x-axis is time, y-axis is position. The 4 black ants alone are viable as are the blacks together with the 3 blues or all 10.
Ants here move either at speed 1 or 1/3. Except for the first and last ones, the slower ants can be left out.
Therefore this construction yields solutions for 4, 6, 7, 8, 9, 10, 11, ... ants.
P.S.: 5 is also possible: