Tall, removable fence for a swimming pool