A simple map on how to make a breakable that only break when an explosive is used. This is done with a func_wall_toggle (the door), that is triggered by a func_breakable (the explosive crate) wich has the "Trigger only" flag enabled. As you can try, this box cannot be destroyed with weapons like the crowbar or the pistol.
There are hidden small invisible breakables that, when broken, destroy the explosives crate and consequently, destroy the door. I'm not sure if i made myself clear, so i'd recommend you to take a look at the example map.
I've set something up like this recently using buttons that activate when damaged and then reset immediately. These buttons then target a multisource entity which targets the breakable door or wall. Unless all of the buttons are hit at the same time with a reasonable amount of damage, it's impossible to break the target, so you can't cheese it by shooting at a single spot.