We propose an algorithm based on a model of visual perception that is meant to reflect the human judgment about the similarity of handwritten samples. The algorithm builds upon the Fuzzy Feature Contrast model and proposes an implementation of such a model in the domain of handwriting. The algorithm has been validated on the RIMES dataset, by comparing its performance with those of a panel of human experts. The experimental results show that the performance of the proposed algorithm is almost indistinguishable from the expert one and therefore may be a viable tool for handwriting comparison.