we had partial updates enabled in magento. But this seems to miss the situation where an attribute is removed.
Example: Product has msrp of 5, then someone removes the msrp altogether and saves the product. This is uploaded to algolia without msrp, but because of partial updates the msrp stays in the index.
We solved this by switching partial updates off, but I guess this behaviour is not intentional.