Search result page filtering

On the search page result, we are presenting attributes for filtring for example color, size, and more
when I am clicking on one of the colors, the color that I clicked on jumps to be the first in the list,
My Q is how can I disable this functionality, I want that the color will stay in the same place that he presented in the beginning?

It sounds like you have isRefined set as your sort by for your refinements. Take a look at the following documentation as it goes over the options to change this.