We can simply remove our cluster using the kops command as follows:
$ kops delete cluster --name my-cluster.k8s-cookbook.net --state s3://kubernetes-cookbook --yes
Deleted cluster: "my-cluster.k8s-cookbook.net"
It will clean the AWS services for you. But some other services created by yourself: S3 bucket, IAM role with powerful authorization, and Route53 domain name; kops will not remove them on user's behavior. Remember to delete the no used AWS services on your side.