Can't rename server because can't remove distributor

When I try the following to rename a server:

sp_dropserver 'OldServerName'

I get the following error:

There are still remote logins or linked logins for the server 'OldServerName'.

If I try:

select name,is_published,is_subscribed,is_distributor from sys.databases
where is_published = 1 or is_subscribed =1 or is_distributor = 1

I get:

name            is_published     is_subscribed    is_distributor
--------------- ------------      -------------      --------------
distribution      0                    0                    1

Then if I try:

exec sp_dropdistpublisher @publisher ='OLD or New Server name'
GO

exec sp_dropdistributiondb @database = 'distribution'
GO

exec sp_dropdistributor @no_checks = 1, @ignore_distributor = 1
GO

I get:

Msg 14071, Level 16, State 1, Procedure sp_dropdistpublisher, Line 99
Could not find the Distributor or the distribution database for the local server. The Distributor may not be installed, or the local server may not be configured as a Publisher at the Distributor.
Msg 14114, Level 16, State 1, Procedure sp_dropdistributiondb, Line 61
The server 'OLD or New Server name' is not configured as a Distributor.
Msg 21043, Level 16, State 1, Procedure sp_dropdistributor, Line 50
The Distributor is not installed.
Msg 14071, Level 16, State 1, Procedure sp_dropdistpublisher, Line 99
Could not find the Distributor or the distribution database for the local server. The Distributor may not be installed, or the local server may not be configured as a Publisher at the Distributor.
Msg 14114, Level 16, State 1, Procedure sp_dropdistributiondb, Line 61
The server 'OLD or New Server name' is not configured as a Distributor.
Msg 21043, Level 16, State 1, Procedure sp_dropdistributor, Line 50
The Distributor is not installed.

What is the solution please?