In this paper a Computer Assisted Semen Analysis (CASA) system designed on a hybrid CPU + FPGA hardware platform is presented. Multiple moving object tracking technique is used for spermatozoa motility analysis and an algorithm consisting of compositely applied various image processing techniques is used for spermatozoa morphology analysis. The parallel processing architecture of FPGA's are utilized for the image and video processing functions that our system use where high speed processing power is required. Various calculations are done on CPU by utilizing developed software. Our system incorporates also an HD digital camera which is mounted on a biological microscope. It has also been foreseen that our system will be a standalone intelligence system and flexibly programmable for different jobs.