Change the color of the title numbering in ToC

I have multiple titles in my document that are numbered using lists. These titles are styled as white text on a black background, and for the list I had to set the numbering color to white as well. Now in my ToC, I want do display the different titles as normal black text on the white background of the page. It works for the text of the title, but not for the automatic number, which stays white no matter what, and thus is invisible (see image).

It appears that the color of the numbering can't be different in the actual title than in the ToC, because if I change the color to another one (grey), then both are grey... Is there a way to override the color in the ToC as we can for the text ?