I was discussing this very question with some friends and co-workers and
wanted to get other designers thoughts on this one.
The definition of "Delete" includes remove;
Delete: to strike out or remove (something written or printed); cancel;
erase; expunge.
But "Remove" does not include "Delete";
Remove: to move from a place or position; take away or off...
(cursory search via Dictionary.com)
I think about deleting as removing too. But I think about removing as, well,
re-moving.