Stupid question but... are you on the correct side of the ladder... and it's not as to see the ladder, its the func_ladder that has to be there, and be correct.
Which leads me to, for your func_ladder, are you using the AAA texture? Because you have to. =D