well, I finally got it to work. Man, what a pain. Thanks for all your help guys. The ivy was already an entity(func_illusionary) so I tried making the ladder the same shape as the ivy, but I still got the same result. Seems everytime I strafed off or moved off the ladder, I would shoot across the map or somewhere else. I guess the HL engine dosn't like weird shaped ladders? The only way I could make it work was making a ladder like the pic below, because I didnt want people climbing on a plain wall(don't laugh, it's only my 3rd map). I dunno why. I tried every suggestion and anything I could think of. I could just be retarded, which is very possible. Anyway, thanks for the help again. You guys rock.
Oh yeah, making some of the subtle changes I made to entities helped a lot with my compile time. Thanks dude!
http://www.eps4.net/eps4images/details.php?image_id=1065