As a result of the increasing demand for higher quality in sports broadcasting, sports video analysis has become a popular research field in computer vision. Innovative replays, content insertion and automated referee systems have become common tools of the trade. Such high level systems require lower level systems capable of extracting basic information automatically. In this paper, drawing on previous work in the field, we present a tennis ball tracking system for offline tennis videos. The system has been on tested on 5 videos extracted from Dubai 2008 and yields promising results.