kemitix/thorp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
thorp/CHANGELOG.org

97 lines
2.3 KiB
Org Mode
Raw Normal View History

[changelog] Added
2019-05-16 16:37:25 +01:00
* Changelog
All notable changes to this project will be documented in this file.
The format is based on [[https://keepachangelog.com/en/1.0.0/][Keep a Changelog]], and this project adheres to
[[https://semver.org/spec/v2.0.0.html][Semantic Versioning]].
Introduce backend abstraction to hide S3 (#76) Add backend abstraction to hide S3
2019-06-22 07:20:59 +01:00
* [0.6.0] - 2019-??-??
** Added
- Abstraction layer encapsulating S3 as Storage (#76)
Restructure sync to use a State with foldLeft around actions (#74) * [changelog] updated * [cli] Program rename parameter * [core] Add AppState * [core] Synchronise rought draft replacement for Sync Uses the AppState * [core] Synchronise as sequential for-comprehensions * [core] Synchronise as nested for-comprehensions * [sbt] thorp(root) depends on cli moduke * [core] Synchronise extract methods * [core] Synchronise rewritten * [core] Synchronise generates actions * [core] Remove AppState * [core] ActionSubmitter remove unused implicit config parameter * [cli] Program rewritten to use Synchronise * [core] Synchronise useValidConfig accepts Logger implicitly * [core] Synchronise reorder methods * [core] Synchronise refactor errorMessages * [core] SyncLogging logRunStart accepts explicit parameters * [core] remove old Sync * [core] Synchronise restore logRunStart * [domain] Terminal add types to public methods and values * [domain] UploadEventLogger force flush to terminal Also make part of the progress message in green. Not flushing, by using println, cause odd behaviour. Works on normal terminal, but not great in an emacs terminal. Oh well. * [core] SyncLogging.logRunFinished remove unused parameters * [cli] Program restore final summary * [storage-aws] remove logging from module * [core] ThorpArchive replaces ActionSubmitter ActionSubmitter implementation becomes UnversionedMirrorArchive * [domain] cleaner upload progress messages * [cli] Program remove unused Logger * [cli] Program rename parameter * [core] SyncSuite use Synchronise * [sbt] Allow storage-aws to share core test classes * [domain] LocalFile stop storing a lambda The lambda breaks the equality test between LocalFile instances. * [core] MD4HashData add missing base64 digest for leafFile * [core] Synchronise drop DoNothing actions * [core] SyncSuite update tests * [sbt] aggregate modules from root module
2019-06-25 08:27:38 +01:00
- Multiple copies of file are only uploaded once (#74)
Introduce backend abstraction to hide S3 (#76) Add backend abstraction to hide S3
2019-06-22 07:20:59 +01:00
Is AWS SDK calculating MD5Hash again for a local file? (#50) * [aws-lib] Uploader provide request with the already calculated md5 hash * [aws-lib] remove unused accepts method * [aws-lib] Uploader refactoring * [domain] Config remove unused threshold and max retries items * [core] Show upload errors in summary * [domain] LocalFile add helper to explicitly compare by hash value Looking to add an optional field to MD5Hash but we want to do our checks here only on the hash value, not whether a digest is available or not. * [core] Sync refactoring * [core] SyncSuite invoke subject inside it method and after declaring expectations * [core] SyncSuite use the localfile hash rather than something arbitrary * [cli] Add `--no-global` and `--no-user` options * [core] LocalFileStream refactoring * [core] SyncSuite: ignore user and global configuration files * [domain] MD5Hash now can optionally store the base64 encoded hash * [core] MD5HashGenerator pass the digest to MD5Hash * [aws-lib] Uploader use the base64 encoded hash * [changelog] updated
2019-06-21 19:20:35 +01:00
* [0.5.0] - 2019-06-21
Add a debug flag and make debug message hidden by default (#60) * [cli] add a debug flag to control logging * [core] show entering a directory as a debug message
2019-06-14 20:00:22 +01:00
** Added
Add support for global and user configuration files (#73) * [core] ConfigurationBuilder reads user and global config files * [changelog] updated * [readme] updated
2019-06-20 17:41:08 +01:00
- Add ~thorp-lib~ module (#66)
- Enable running outside of sbt (#55)
- ~-d~, ~--debug~ flag for log messages (#60)
- Read config from ~.thorp.conf~ in source directory (#71)
- Read config from ~$HOME/.config/thorp.conf~ and ~/etc/thorp.conf~
(#73)
Is AWS SDK calculating MD5Hash again for a local file? (#50) * [aws-lib] Uploader provide request with the already calculated md5 hash * [aws-lib] remove unused accepts method * [aws-lib] Uploader refactoring * [domain] Config remove unused threshold and max retries items * [core] Show upload errors in summary * [domain] LocalFile add helper to explicitly compare by hash value Looking to add an optional field to MD5Hash but we want to do our checks here only on the hash value, not whether a digest is available or not. * [core] Sync refactoring * [core] SyncSuite invoke subject inside it method and after declaring expectations * [core] SyncSuite use the localfile hash rather than something arbitrary * [cli] Add `--no-global` and `--no-user` options * [core] LocalFileStream refactoring * [core] SyncSuite: ignore user and global configuration files * [domain] MD5Hash now can optionally store the base64 encoded hash * [core] MD5HashGenerator pass the digest to MD5Hash * [aws-lib] Uploader use the base64 encoded hash * [changelog] updated
2019-06-21 19:20:35 +01:00
- Add ~--no-global~ and ~--no-user~ options (#50)
- Display any upload errors in summary report (#50)
Add a debug flag and make debug message hidden by default (#60) * [cli] add a debug flag to control logging * [core] show entering a directory as a debug message
2019-06-14 20:00:22 +01:00
Suppress "Transfer" event messages (#64) * [aws-api] remove transfer events * [changelog] updated
2019-06-14 20:18:05 +01:00
** Changed
Add support for global and user configuration files (#73) * [core] ConfigurationBuilder reads user and global config files * [changelog] updated * [readme] updated
2019-06-20 17:41:08 +01:00
- Rename project as 'thorp' (#75)
- Suppress Transfer event messages (#64)
- Better error message when source not found (#51)
- Reduced logging (#59)
Is AWS SDK calculating MD5Hash again for a local file? (#50) * [aws-lib] Uploader provide request with the already calculated md5 hash * [aws-lib] remove unused accepts method * [aws-lib] Uploader refactoring * [domain] Config remove unused threshold and max retries items * [core] Show upload errors in summary * [domain] LocalFile add helper to explicitly compare by hash value Looking to add an optional field to MD5Hash but we want to do our checks here only on the hash value, not whether a digest is available or not. * [core] Sync refactoring * [core] SyncSuite invoke subject inside it method and after declaring expectations * [core] SyncSuite use the localfile hash rather than something arbitrary * [cli] Add `--no-global` and `--no-user` options * [core] LocalFileStream refactoring * [core] SyncSuite: ignore user and global configuration files * [domain] MD5Hash now can optionally store the base64 encoded hash * [core] MD5HashGenerator pass the digest to MD5Hash * [aws-lib] Uploader use the base64 encoded hash * [changelog] updated
2019-06-21 19:20:35 +01:00
- Prevent AWS SDK from recalculating MD5 hash (#50)
Add support for global and user configuration files (#73) * [core] ConfigurationBuilder reads user and global config files * [changelog] updated * [readme] updated
2019-06-20 17:41:08 +01:00
** Fixed
- Error when calculating md5 hash for large files (#56)
Suppress "Transfer" event messages (#64) * [aws-api] remove transfer events * [changelog] updated
2019-06-14 20:18:05 +01:00
[cli] Remove verbosity flag (#63)
2019-06-14 20:21:58 +01:00
** Removed
Add support for global and user configuration files (#73) * [core] ConfigurationBuilder reads user and global config files * [changelog] updated * [readme] updated
2019-06-20 17:41:08 +01:00
- ~-v~ verbosity flag (#63)
** Dependencies
- Upgrade ~aws-java-sdk-s3~ from ~1.11.569~ to ~1.11.570~ (#57)
[cli] Remove verbosity flag (#63)
2019-06-14 20:21:58 +01:00
[changelog] Updated for 0.4.0
2019-06-11 08:01:49 +01:00
* [0.4.0] - 2019-06-11
** Added
- Multi-part uploads
- ~--include~ to select files for synchronisation
- Upload progress bar
** Changed
- ~--filter~~ renamed to ~-exclude~~
** Fixed
- Fetch md5 hashes for all remote objects, not just the first 1000
- Handle when a file goes away between scanning and uploading
** Dependencies
- Removed ~reactive-aws-s3-{core,cats}~ and the AWS SDK v2 that it
depended upon in favour of the AWS SDK v1
- Upgrade ~aws-java-sdk-s3~ from ~1.11.560~ to ~1.11.569~
- Upgrade ~cats-effect~ from ~1.2.0~ to ~1.3.1~
- Upgade ~scalatest~ from ~3.0.7~ to ~3.0.8~
Support multiple filters (#18) * Support multiple filters * Clean up imports * [S3ClientLogging] log the remote key value * Update changelog, readme and long arg name * [SyncSuite] update test
2019-05-23 19:35:48 +01:00
* [0.3.0] - 2019-05-23
Simple Exclusion Filter (#16) * [filter] Parse filter from command line and add to config * [filter] exclude file that match the filter
2019-05-23 09:21:09 +01:00
** Added
- Filter to exclude files
* [0.2.0] - 2019-05-22
[changelog] Added
2019-05-16 16:37:25 +01:00
** Added
- Display count of the number of files uploaded
** Changed
- Improved performance by fetching all MD5 hashes from S3 in single
request at startup
* [0.1.0] - 2019-05-13
** Added
- Initial Release
- Synchronise files with an S3 bucket, using an MD5 hash to
identify when the file has changed and needs to be uploaded
Reference in a new issue Copy permalink