Existence outside Experience

According to von Glasersfeld, we can't speak of our world outside our experiences or better yet a world of real apples; where things exists independent of our perception. Ernst von Glasersfeld proposes that we can only come in a contact with world by means of our perceptions and those we can't talk of something even ourselves without pervieving it. Those how can we talk of something before we percieve it? The moment we start talking about a world where things exist outside our experience we've already crossed over or accessed those things via our perceptions. The world where real apples exist; to borrow von Glasersfeld's example seizes to exist once i talk about it because it becomes a percieve apple and no longer a real apple. With this train of thought it seems like Ernst von Glasersfeld wins no matter what and how. It seems liek we can't access the world let alone the truth of it without percieving it. TO make matters worse, how can we talk of the truth about the world when all we can do as individuals is percieve it. My perceptions of the world differ from each others thus we can't rely on our perceptions to pass judgement on the reality of the world especially since there's no way of proving that, that particular perception is right. so now we are stuck of not having access of to the world we live in but even worse we can't tell if what we percieve of our world is true or not. so we do we go from here? Personally i think i'm worse off now than before when i thought there was a world outside my existence, our world i came into contact with every perception.