If not talking with him hurts you this much, I'm sure he would be touched to know about it.
Family is not about always getting along, it's about moving through hardships together.
Why not find a time in a day where both of you have a good amount of free time, and try to start up a discussion in the most gentle way you can? It will be really difficult for both of you, but I'm sure you will feel much better afterwards, coming to conclusions and having brought the tension to an end.
Besides, parents just want the best for their child. He merely needs to see that you and your brother have different capacities, and you're still doing the best you can in your own capacity.