What were the weather conditions like when the bike was crashed? If it was wet then I'd be very careful with the frame.
Carbon components are precision engineered for compliance and rigidity. The problem is that modern carbon frames (and forks) are so compliant and rigid that external factors such as rain interference combine with the carbon layup to deliver unexpected lateral forces on the material. Therefore, if it was raining at the time of the crash there is a heightened risk of damage.
Considering all of this, I'd agree with
@fossyant - the bike must be replaced. Some parts may be salvageable though, so I'll give you £50 for it!
Seriously though - if you've lost confidence in the component, then either get it checked by someone you trust and knows what they are doing, or get rid of it. If you're anything like me, then a niggling doubt in your mind will play games with you, particularly on descents! I might be inclined to use such an incident as a ride to upgrade city!
