1. My network is underfitting. Shall I gather more data?

  2. A.:

    If the network is underfitting, train error is still high. Instead of gathering more data, try to decrease training error by checking the code, verifying the quality of the data, increasing the network's capacity, etc.