I am recently seeing an issue with a volume not detaching properly after node recovery

[lordmuffin]

This is the error I see on the pod description: │ Events: │
│ Type Reason Age From Message │
│ ---- ------ ---- ---- ------- │
│ Normal Scheduled 5m34s default-scheduler Successfully assigned tandoor/tandoor-7478578cdd-r4msf to prod-instance-17 │
│ 51677940607 │
│ Warning FailedAttachVolume 77s (x3 over 5m22s) attachdetach-controller AttachVolume.Attach failed for volume "pvc-1c7b4272-7cf4-4685-b783-328bb98 │
│ 2c8ec" : rpc error: code = Internal desc = [ControllerPublishVolume] failed to get device path of attached volume : can not get device path of volume p │
│ vc-1c7b4272-7cf4-4685-b783-328bb982c8ec, its status is detaching │
│ Warning FailedMount 50s kubelet Unable to attach or mount volumes: unmounted volumes=[recipes-static], una │
│ ttached volumes=[recipes-static], failed to process volumes=[]: error processing PVC tandoor/recipes-static: failed to fetch PVC from API server: Get " │
│ https://hcp-1fca2586-cc0c-4000-8ba8-917383141da9.spot.rackspace.com:443/api/v1/namespaces/tandoor/persistentvolumeclaims/recipes-static": net/http: TLS │
│ handshake timeout

I have tried to force delete the attachment, but it doesnt appear to work.

[lordmuffin]

[email protected], healing-organics organization

[supreeth90]

@lordmuffin thanks for reaching out! We are looking into this. Will get back to you soon.

[supreeth90]

@lordmuffin I tried to find your volume and looks like it was deleted ? Please let us know if you facing any more issues with volumes.

[lordmuffin]

Yea this seems to resolve when I force delete the volume, thankfully I had backups in place.