Marcus Christie [Wed, 4 Aug 2021 16:05:55 +0000 (12:05 -0400)]
AIRAVATA-3420 Change remote API implementation of get_download_url to resolve to local URL and stream from remote server
Marcus Christie [Wed, 4 Aug 2021 16:05:23 +0000 (12:05 -0400)]
AIRAVATA-3420 Utility method to get the default storage id
Storage id is set on the ExperimentModel so provide a proper function to get it.
Marcus Christie [Wed, 4 Aug 2021 16:04:01 +0000 (12:04 -0400)]
AIRAVATA-3420 Remove redundant parameter
Marcus Christie [Wed, 4 Aug 2021 14:21:55 +0000 (10:21 -0400)]
Bump version to 1.2.dev1
Marcus Christie [Wed, 4 Aug 2021 14:19:16 +0000 (10:19 -0400)]
AIRAVATA-3420 Implement get_download_url for REMOTE API, return full URL
Marcus Christie [Wed, 4 Aug 2021 13:26:36 +0000 (09:26 -0400)]
AIRAVATA-3420 Allow reading just a few bytes from very large files by streaming http download (initial use case is to determine file type)
Marcus Christie [Tue, 3 Aug 2021 22:03:05 +0000 (18:03 -0400)]
AIRAVATA-3420 Fix computing path when relative, and allow optimization where base resource path is configured
Marcus Christie [Tue, 3 Aug 2021 22:01:35 +0000 (18:01 -0400)]
AIRAVATA-3420 Regenerate the grpc stubs
Marcus Christie [Thu, 29 Jul 2021 20:10:06 +0000 (16:10 -0400)]
AIRAVATA-3485 Bump version to 1.1.dev8
Marcus Christie [Thu, 29 Jul 2021 20:08:34 +0000 (16:08 -0400)]
AIRAVATA-3485 Fix looking up/creating data products for experiment files owned by experiment owner
Marcus Christie [Thu, 29 Jul 2021 18:13:46 +0000 (14:13 -0400)]
AIRAVATA-3485 Bump version to 1.1.dev7
Marcus Christie [Thu, 29 Jul 2021 18:01:00 +0000 (14:01 -0400)]
AIRAVATA-3485 Document the optional experiment_id parameter in user_storage API
Marcus Christie [Thu, 29 Jul 2021 17:00:34 +0000 (13:00 -0400)]
AIRAVATA-3420 bug fix: resource_path should be full path
Marcus Christie [Thu, 29 Jul 2021 15:37:09 +0000 (11:37 -0400)]
AIRAVATA-3485 Bump version to 1.1.dev6
Marcus Christie [Thu, 29 Jul 2021 15:36:00 +0000 (11:36 -0400)]
AIRAVATA-3485 Use experiment owner user storage directory for listdir, get_file_metadata
Marcus Christie [Thu, 29 Jul 2021 15:34:48 +0000 (11:34 -0400)]
Pass name of file in remote API call when saving file
Marcus Christie [Mon, 26 Jul 2021 17:02:18 +0000 (13:02 -0400)]
Version bump to 1.1.dev5
Marcus Christie [Mon, 26 Jul 2021 17:01:24 +0000 (13:01 -0400)]
AIRAVATA-3485 POST experiment-id in request body for consistency
Marcus Christie [Thu, 15 Jul 2021 20:13:31 +0000 (16:13 -0400)]
AIRAVATA-3460 Pass path as query param to handle full resource path paths when creating a directory
Marcus Christie [Fri, 9 Jul 2021 13:48:55 +0000 (09:48 -0400)]
AIRAVATA-3485 Bump version to 1.1.dev.4
Marcus Christie [Fri, 9 Jul 2021 13:45:09 +0000 (09:45 -0400)]
AIRAVATA-3485 Support for experiment-id in remote API
Marcus Christie [Fri, 9 Jul 2021 13:31:58 +0000 (09:31 -0400)]
AIRAVATA-3485 Also adding experiment_id to listdir and get_file_metadata, for testing purposes mostly
Marcus Christie [Thu, 8 Jul 2021 13:58:55 +0000 (09:58 -0400)]
AIRAVATA-3485 Accept experiment data dir relative paths in user_storage functions
Marcus Christie [Tue, 6 Jul 2021 18:38:11 +0000 (14:38 -0400)]
AIRAVATA-3431 Copy fix to the SDK download_file view
Marcus Christie [Tue, 6 Jul 2021 14:56:47 +0000 (10:56 -0400)]
AIRAVATA-3420 Preserve mime-type query param
Marcus Christie [Thu, 1 Jul 2021 18:50:04 +0000 (14:50 -0400)]
AIRAVATA-3469 Preserve force download param when redirecting
Marcus Christie [Wed, 30 Jun 2021 19:35:09 +0000 (15:35 -0400)]
Notes on pushing a release to PyPI
Marcus Christie [Wed, 30 Jun 2021 19:33:15 +0000 (15:33 -0400)]
Merge branch 'airavata-3475'
Marcus Christie [Wed, 30 Jun 2021 19:27:57 +0000 (15:27 -0400)]
AIRAVATA-3475 bump version to 1.1.dev3
Marcus Christie [Wed, 30 Jun 2021 18:01:30 +0000 (14:01 -0400)]
AIRAVATA-3475 Adds create_symlink() to user_storage module
Marcus Christie [Tue, 29 Jun 2021 17:55:48 +0000 (13:55 -0400)]
AIRAVATA-3469 Add max zip file size check
Marcus Christie [Fri, 25 Jun 2021 19:05:49 +0000 (15:05 -0400)]
AIRAVATA-3469 Bump version to 1.1.dev2
Marcus Christie [Fri, 25 Jun 2021 19:04:27 +0000 (15:04 -0400)]
Merge branch 'download-folder'
Marcus Christie [Thu, 24 Jun 2021 19:26:35 +0000 (15:26 -0400)]
AIRAVATA-3420 Add get_lazy_download_url
Marcus Christie [Thu, 24 Jun 2021 18:59:10 +0000 (14:59 -0400)]
AIRAVATA-3420 Bump version to 1.1dev1
Marcus Christie [Thu, 24 Jun 2021 18:50:30 +0000 (14:50 -0400)]
Merge branch 'master' into mft-integration
Marcus Christie [Thu, 24 Jun 2021 18:30:48 +0000 (14:30 -0400)]
prep for 1.0 release
Marcus Christie [Thu, 24 Jun 2021 18:26:13 +0000 (14:26 -0400)]
Adding LICENSE file
Marcus Christie [Tue, 22 Jun 2021 20:55:59 +0000 (16:55 -0400)]
AIRAVATA-3420 Check if 'path' in create directory response
Marcus Christie [Tue, 22 Jun 2021 20:45:05 +0000 (16:45 -0400)]
Revert "AIRAVATA-3460 Pass path as request param"
This reverts commit
54914bced9c5724e74005806aa1f798056f8090c.
Marcus Christie [Tue, 22 Jun 2021 20:11:18 +0000 (16:11 -0400)]
AIRAVATA-3420 Fix dependency on DRF
Marcus Christie [Fri, 18 Jun 2021 19:33:07 +0000 (15:33 -0400)]
AIRAVATA-3469 Switch to temporary file for building zip file
Marcus Christie [Fri, 18 Jun 2021 18:59:34 +0000 (14:59 -0400)]
AIRAVATA-3469 Download storage dir and experiment dir
Marcus Christie [Mon, 24 May 2021 21:26:40 +0000 (17:26 -0400)]
AIRAVATA-3420 backwards compatible /api/download
Marcus Christie [Mon, 24 May 2021 19:41:59 +0000 (15:41 -0400)]
AIRAVATA-3420 Add token based auth for downloads
Marcus Christie [Wed, 19 May 2021 21:22:46 +0000 (17:22 -0400)]
AIRAVATA-3420 Pass experiment owner to user storage provider backend
Marcus Christie [Fri, 14 May 2021 18:45:27 +0000 (14:45 -0400)]
AIRAVATA-3460 Pass path as request param
Marcus Christie [Fri, 14 May 2021 16:00:51 +0000 (12:00 -0400)]
AIRAVATA-3420 Fix remote api mode of create_user_dir to return resource id, path tuple
Marcus Christie [Thu, 6 May 2021 15:22:09 +0000 (11:22 -0400)]
AIRAVATA-3458 Support get_data_product_metadata when user isn't owner
Marcus Christie [Thu, 6 May 2021 14:11:42 +0000 (10:11 -0400)]
In remote API `exists()`, handle case where data product itself doesn't exist
Marcus Christie [Thu, 6 May 2021 14:07:37 +0000 (10:07 -0400)]
In remote API `exists()`, handle case where data product itself doesn't exist
Marcus Christie [Wed, 5 May 2021 21:59:08 +0000 (17:59 -0400)]
Fixing linting error (trailing ws)
Marcus Christie [Tue, 4 May 2021 22:14:02 +0000 (18:14 -0400)]
AIRAVATA-3420 Return full path to created directory
Marcus Christie [Mon, 3 May 2021 22:48:34 +0000 (18:48 -0400)]
AIRAVATA-3362 Make sure experiment storage path is relative to experiment data dir
Marcus Christie [Thu, 29 Apr 2021 22:11:16 +0000 (18:11 -0400)]
AIRAVATA-3420 import style fix
Marcus Christie [Thu, 29 Apr 2021 21:56:12 +0000 (17:56 -0400)]
AIRAVATA-3420 Handle special case of creating user's home directory
Marcus Christie [Wed, 28 Apr 2021 22:08:26 +0000 (18:08 -0400)]
AIRAVATA-3458 Add gzip compression to download
Marcus Christie [Wed, 28 Apr 2021 22:02:43 +0000 (18:02 -0400)]
AIRAVATA-3458 Get file metadata for a data product
Marcus Christie [Wed, 28 Apr 2021 20:56:58 +0000 (16:56 -0400)]
AIRAVATA-3420 For backwards compat, keep file hidden attribute
Marcus Christie [Tue, 27 Apr 2021 20:56:59 +0000 (16:56 -0400)]
AIRAVATA-3420 Only load MFTUserStorageProvider if dependencies are also available
Marcus Christie [Tue, 27 Apr 2021 20:18:59 +0000 (16:18 -0400)]
AIRAVATA-3420 Fix flake8 incompatible dependencies
Marcus Christie [Tue, 27 Apr 2021 20:09:42 +0000 (16:09 -0400)]
AIRAVATA-3420 Updating docs
Marcus Christie [Tue, 27 Apr 2021 16:57:59 +0000 (12:57 -0400)]
AIRAVATA-3420 Adding resource id to UserFiles model
Marcus Christie [Tue, 27 Apr 2021 16:22:51 +0000 (12:22 -0400)]
AIRAVATA-3420 Fixing linting, clean up
Marcus Christie [Tue, 27 Apr 2021 16:13:39 +0000 (12:13 -0400)]
AIRAVATA-3420 Fix unit tests
Marcus Christie [Mon, 26 Apr 2021 20:57:55 +0000 (16:57 -0400)]
AIRAVATA-3420 For backwards compat, keep file hidden attribute
Marcus Christie [Mon, 26 Apr 2021 19:54:31 +0000 (15:54 -0400)]
AIRAVATA-3420 /sdk/download redirects to the download url
Marcus Christie [Thu, 15 Apr 2021 21:27:51 +0000 (17:27 -0400)]
AIRAVATA-3420 Revert download url change
Keep old behavior since new behavior requires changes to airavata-django-portal and this
way we can update the SDK first and then the airavata-django-portal
Marcus Christie [Thu, 15 Apr 2021 21:15:13 +0000 (17:15 -0400)]
AIRAVATA-3420 Fix content type determination by switching to UserStorageProvider.open
Marcus Christie [Thu, 15 Apr 2021 18:43:05 +0000 (14:43 -0400)]
AIRAVATA-3420 Implementing get_download_url, moving download view to sdk
Marcus Christie [Wed, 14 Apr 2021 22:03:12 +0000 (18:03 -0400)]
AIRAVATA-3420 Implement browsing methods of MFTUserStorageProvider
Marcus Christie [Wed, 7 Apr 2021 22:17:16 +0000 (18:17 -0400)]
AIRAVATA-3420 Implements DjangoFileSystemProvider, refactored user_storage module to use UserStorageProvider
Marcus Christie [Tue, 23 Mar 2021 19:28:25 +0000 (15:28 -0400)]
WIP: UserStorageProvider abstraction
Marcus Christie [Fri, 9 Apr 2021 20:32:24 +0000 (16:32 -0400)]
AIRAVATA-3362 implementing remote api support for exp dir functions
Marcus Christie [Tue, 23 Feb 2021 18:25:09 +0000 (13:25 -0500)]
Add data_product_uri parameter option to user_storage functions
Marcus Christie [Thu, 4 Feb 2021 15:56:51 +0000 (10:56 -0500)]
adding CI badge
Marcus Christie [Wed, 3 Feb 2021 17:16:47 +0000 (12:16 -0500)]
fixing typo
Marcus Christie [Tue, 2 Feb 2021 23:00:25 +0000 (18:00 -0500)]
adding linting, import sorting
Marcus Christie [Tue, 2 Feb 2021 16:52:20 +0000 (11:52 -0500)]
get_rel_experiment_dir
Marcus Christie [Fri, 15 Jan 2021 23:09:07 +0000 (18:09 -0500)]
AIRAVATA-3362 Fixes to relative path of dir in experiment dir
Marcus Christie [Fri, 8 Jan 2021 22:01:41 +0000 (17:01 -0500)]
urls module for constructing REST API urls
Marcus Christie [Thu, 7 Jan 2021 00:13:55 +0000 (19:13 -0500)]
AIRAVATA-3362 experiment_dir_exists and fixes to computed paths
Marcus Christie [Fri, 4 Dec 2020 15:14:54 +0000 (10:14 -0500)]
AIRAVATA-3310 SDK support for updating data product content
Marcus Christie [Wed, 18 Nov 2020 15:39:36 +0000 (10:39 -0500)]
AIRAVATA-3346 handle 404 with dir_exists
Marcus Christie [Wed, 18 Nov 2020 15:34:56 +0000 (10:34 -0500)]
AIRAVATA-3346 implement remote api for user_file_exists
Marcus Christie [Tue, 17 Nov 2020 20:17:42 +0000 (15:17 -0500)]
AIRAVATA-3389 Skip broken symlinks in user storage
Marcus Christie [Mon, 2 Nov 2020 19:37:25 +0000 (14:37 -0500)]
AIRAVATA-3346 Restoring user_file_exists
Marcus Christie [Tue, 6 Oct 2020 19:28:19 +0000 (15:28 -0400)]
updating getting started notes
Marcus Christie [Tue, 6 Oct 2020 19:21:31 +0000 (15:21 -0400)]
Move git repo for airavata-python-sdk to requirements.txt
Marcus Christie [Mon, 5 Oct 2020 19:09:03 +0000 (15:09 -0400)]
Fix readthedocs build by removing duplicate entry
The pip 2020 dependency resolver considers two dependencies from the
same VCS url to be two incompatible dependencies.
Marcus Christie [Mon, 5 Oct 2020 18:26:30 +0000 (14:26 -0400)]
AIRAVATA-3362 Add list_experiment_dir to docs
Marcus Christie [Mon, 5 Oct 2020 18:12:27 +0000 (14:12 -0400)]
AIRAVATA-3362 list_experiment_dir function
Marcus Christie [Mon, 5 Oct 2020 14:38:36 +0000 (10:38 -0400)]
Quote file path in replica location URI
Marcus Christie [Sun, 4 Oct 2020 22:26:45 +0000 (18:26 -0400)]
AIRAVATA-3346 Fix handling default value of path_params
Marcus Christie [Wed, 30 Sep 2020 23:06:40 +0000 (19:06 -0400)]
Merge pull request #1 from apache/AIRAVATA-3346-implement-remote-fs-abstraction-of-user-storage
Airavata-3346 implement remote fs abstraction of user storage
Marcus Christie [Wed, 30 Sep 2020 22:49:35 +0000 (18:49 -0400)]
AIRAVATA-3346 Factor out common code
Marcus Christie [Wed, 16 Sep 2020 18:52:20 +0000 (14:52 -0400)]
AIRAVATA-3346: AIRAVATA-3346 Enable remote API for update_file_content
Marcus Christie [Wed, 16 Sep 2020 18:44:07 +0000 (14:44 -0400)]
AIRAVATA-3346: AIRAVATA-3346 removing deprecated user_file_exists
Marcus Christie [Wed, 16 Sep 2020 18:23:07 +0000 (14:23 -0400)]
AIRAVATA-3346: AIRAVATA-3346 Prevent accidentally using local data store API when configured for remote data store API
Marcus Christie [Wed, 16 Sep 2020 16:30:05 +0000 (12:30 -0400)]
AIRAVATA-3346: AIRAVATA-3346: AIRAVATA-3346 Implement remote save_input_file