AB Testing and Re-ranking

Hello there,

Currently trying to implement AB Testing with Algolia.

  • Made a replica of my prod index
  • Prod index is A, replica is B
  • Changed the searchable attributes and the custom ranking for B

But… I’ve got dynamic re-ranking active for A.
For B, I activated it, but since it has had no event, re-ranking is effectively inexistent.

So it’s a pretty big bias: I’m afraid I’ll be testing as much how re-ranking works as the configuration differences between A and B.

To avoid this, should I configure the reranking of B to be based on events of A?

(screenshot of Re-Ranking configuration)

And if I do so, won’t this affect the AB Test CTR/results?


Would love to hear you back! :slight_smile: