How To Train Tensorflow With Cloud Tpus From My Local Machine?

I am trying to do this tutorial(https://www.tensorflow.org/guide/tpu), but using my own provisioned TPU. But when I try to change to my own TPU I cannot resolve the TPU cluster, i.

Solution 1:

I found out what was the problem. The IP in the TPU dashboard is an "Internal IP." The only way to access it is through a Jump server in the same data center as the TPU, i.e., SSH Tunneling.

Here is an article describing the whole process in detail: Train neural networks faster with tpu from your laptop

But the idea is:

1. Create a TPU

2. Create a Jump Server

3. Create a Storage Bucket

4. Run this command to create the SSH Tunnel: ssh $USER@$JUMP -L 2000:$TPU:8470

5. Train your model.