[chuddo]

by accident is the correct phrase.

though on accident is so widely used it is fine.

"Although you can do things on purpose, you do them by accident."