Who should be responsible for the accident if my friend borrowed my car and bumped others?

No, the repair fee will go on your insurance policy because insurance is not on the person driving it but on the car. Also, chances are your auto insurance rates will go up if you file such a claim.
Therefore, make sure your friend has a good driving history before you give your key away.