Can I clear the case from the Likely to Escalate queue but get back to it later?

Yes. Use the Snooze Escalation Review option to do this. Doing so moves it to the Cases Reviewed Snoozed column. 

The case will be returned to the Likely to Escalate queue after the time period selected if it is still likely to escalate.

Resources:

Escalation Manager Workflow