Yes. If you do not want to use OneDrive at all, first stop its folder backup, then unlink and uninstall it.
Click the OneDrive cloud icon > Settings > Sync and backup > Manage backup, then stop backing up Desktop, Documents and Pictures if they are enabled. Microsoft guide:
https://support.microsoft.com/en-us/onedrive/back-up-your-folders-with-onedrive
Then go to OneDrive Settings > Account > Unlink this PC.
Finally, open Windows 11 Settings > Apps > Installed apps > Microsoft OneDrive > Uninstall. Microsoft guide:
https://support.microsoft.com/en-us/onedrive/turn-off-disable-or-uninstall-onedrive
Before uninstalling, make sure any files you want to keep are already stored locally or on your external drive.