I guess, it could be (partial one)
Bitter gourd ( vegetable)
I'm sorry to say this, but I've got to come clean.
When taken in diet, bitter gourd is supposed to work as a cleansing agent for one's stomach
I miss all my brothers, and will start to get mean.
It's brothers are - bottle gourd, snake gourd, ridge gourd out of which this one is a kind of odd one - based on its bitter taste
Some may call me yellow, but I'm really quite green.
Bitter gourd can be in these two colours, though mostly it is of green in colour.
I'm rough on the edges, but seldom I'm seen.
Usually has scales/ not a smooth surface, though the smooth ones are rare.
My reason for whining is the job I've been given.
Not sure on this..
I deal with accidents not easily forgiven.
Could be for curing some major gastric diseases, which can be due to accidental eating.
Back and forth I find myself constantly driven.
About symmetry ( vertical) of this vegetable, perhaps.
But just being held is what makes life worth livin'.
Not sure on this part.
I find myself to be in quite a jam...
Yes, bitter gourd juice/jam are possible and in use!