Providing Google Drive link as a data path - Google Colab

data
1

Hi!
I am trying to reproduce the results of someone else’s code using Google Colab but the data is huge. The authors have provided the data in a shared Google Drive folder. Is it possible to specify data path as Google Drive link instead of downloading their data and then uploading in my Google Drive?

I have provided the link as a path but I am getting this error: (please correct me if I am wrong and the link can’t be provided as a path)

Warning: logging configuration file is not found in logger/logger_config.json.
LOG: No saved data found. Making new data directory https://drive.google.com/drive/folders/abc?usp=sharing
Traceback (most recent call last):
  File "/content/abc/train.py", line 84, in <module>
    main(config)
  File "/content/abc/train.py", line 31, in main
    train_data_loader = config.init_obj('train_data_loader', module_data)
  File "/content/abc/parse_config.py", line 103, in init_obj
    return getattr(module, module_name)(*args, **module_args)
  File "/content/abc/data_loader/data_loaders.py", line 32, in __init__
    os.mkdir(data_split_lists_path)
FileNotFoundError: [Errno 2] No such file or directory: 'https://drive.google.com/drive/folders/abc?usp=sharing'

Could someone please tell me what am I doing wrong here?
Thank you!

2

I guess you should be able to use pydrive (or any other Python library handling Google Drive) and load the files from Google Drive with it.

3

@ptrblck Thank you for the reply! I have figured out another way of doing this: I created a shortcut in my drive and the copied the path in Colab. It turned out that the error was due to some empty folder.
Yet, I still can’t figure out, why am I getting this Warning: logging configuration file is not found in logger/logger_config.json even though logger_config.json is there.