1 has different meanings: needless to say, everyone knows it, needless to say. Needless to say, there is no need to say more.
2. Different parts of speech: it doesn't need to be a verb, but a transitive verb. You can modify verbs without being adverbs.