Whether you do the rides TR prescribes or not, you should probably get something in. If you got deep enough in the red to need a full week off doing SSBII you may want to consider another round of base before moving to build.
Fitness only increases if you increase strain. The idea of TR rest weeks is to maintain some strain while allowing your body to recover without losing more fitness than necessary.