What Matters for Ranking?