Greedy Pruning For Continually Adapting Networks