Shouldn’t be an issue but I have always found 1-2nm to be sufficient to remove play - could potentially indicate an issue elsewhere?
I can’t really think of what this could be though other than ensuring the new bearings are fully compatible, the “oil retainer” is fitted (the correct way round) and the end cap is clean and not cross threaded.
It’s probably fine though.