In this paper, we present a novel method for recognition of handwritten sketches. Unlike previous approaches, we focus on online retrieval and ability to build our model incrementally, thus we do not need to know all the data in advance and we can achieve very good recognition results after as few as 15 samples. The method is composed of two main parts: feature representation and learning and recognition. In feature representation part, we utilize SIFT-like feature descriptors in combination with soft response Bag-of-Words techniques. Descriptors are extracted locally using our novel sketch-specific sampling strategy and for support regions we follow patch-based approach. For learning and recognition, we use a novel technique based on fuzzy-neural networks, which has shown good performance in incremental learning. The experiments on state-of-the-art benchmarks have shown promising results.