Experiments using real images have confirmed that when 68 pixels are used for matching, the processing time is 18 msec and the recognition success rate is 99.7%. The use of a small number of pixels that are not shared by surrounding objects enables high discriminability and fast matching. The use of color and intensity information makes the method highly versatile for object design. Pixels with a low pixel pattern frequency are selected from color and grayscale images of the target object, and pixels that are highly discriminative from surrounding objects are carefully selected from these pixels. We propose a fast and reliable matching method using these few pixels. In this paper, we optimize the combination of color and intensity information of a small number of pixels used for matching based on the interrelationship between the target object and surrounding objects. Due to the revitalization of the semiconductor industry and efforts to reduce labor and unmanned operations in the retail and food manufacturing industries, objects to be recognized in image processing technology are becoming increasingly colorful and diversified in design.