It is known that a small number of Aboriginal men served in Australian contingents during the South African (Boer) War. However, what of the story of the fifty 'black trackers' and their treatment by the Australian government at the end of their overseas service? This article considers the misunderstandings surrounding the 'fifty black tracker' story. A careful examination of the sources shows that there is no evidence for the claim that the Australian government recruited or sent black trackers to South Africa. There is also no evidence for the view that Aboriginal men serving in the Australian South African War contingents were prevented from returning after the war ended in 1902. An examination of the evidence does, however, reveal interesting aspects of public discussion about Aboriginal trackers, bushmen, and Australian soldiers. The evidence also reveals that two or three Aboriginal men had 'White Australia' restrictions applied to them, later, in the first decade after Federation.