I would remove the cover as soon as possible including before you try to start the car again. If the tensioner has worn a hole in the cover that means that it is not in the correct position and has been grinding away metal pieces that are getting into your engine oil. This will ruin an engine !!!!!
You will need to remove the fan and nose piece of the engine to get behind the timing chain cover. This may be possible, though difficult, without removing the radiator.
Seriously I bought a parts car many years ago that was partly disassembled, as it was not running correctly and somebody was trying to find out what was wrong with it. After I removed the timing chain cover I found the tensioner was in pieces. There were metal pieces in the timing chain cover as well as some in the oil pan. I would consider that engine a goner as far as all the bearings and likely much more. Hopefully yours won't be that bad. But don't push it any further than you have already.
Charley Fitch
