mirrors
/
goop
mirror of https://github.com/nyancrimew/goop.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
56 Commits 2 Branches 0 Tags 184 KiB
Commit Graph

56 Commits

Author SHA1 Message Date
maia tillie arson crimew 318039cb3c start adding support for some more obscure git features 2021-10-26 20:57:33 +02:00
maia tillie arson crimew a6c6710b3c force full concurrency wherever appropriate 2021-10-24 20:11:22 +02:00
maia tillie arson crimew cf3a38881f use jobtracker from the extracted library 2021-10-24 19:28:58 +02:00
maia tillie arson crimew 967f998486 Refactor JobTracker to prepare for library extraction 2021-10-24 18:52:27 +02:00
maia tillie arson crimew 0703f40da3 WIP: add git lfs support 
So far we are able to download objects, what's still left to do is checking out
 2021-10-21 23:58:37 +02:00
maia tillie arson crimew 956d5ba8d8 remove unused constants 2021-10-21 16:36:39 +02:00
maia tillie arson crimew 769869480c factor out some more code into separate functions 2021-10-21 16:30:11 +02:00
maia tillie arson crimew 3399f2ad56 optimize checkout + factor out fetching of ignored files 2021-10-21 16:18:21 +02:00
maia tillie arson crimew ff3f22f076 only create objects if hash matches the index 2021-10-21 15:09:46 +02:00
maia tillie arson crimew 7b9abaa163 make object creation fully native and parallelized 2021-10-21 05:42:58 +02:00
maia tillie arson crimew 3c0ee8ea47 create manual objects using go-git 2021-10-21 05:02:01 +02:00
maia tillie arson crimew af7706e32f update README 2021-10-21 03:15:53 +02:00
maia tillie arson crimew 9cd04c613d parse git config to get remote names for branches 2021-10-21 01:36:09 +02:00
maia tillie arson crimew 9d7d6f58e7 clean up JobTracker and make it more reliable 2021-10-21 00:55:18 +02:00
maia tillie arson crimew 1a084596d5 get number of jobs from JobTracker 2021-10-21 00:39:15 +02:00
maia tillie arson crimew 39fbbe315d discard empty jobs on add 2021-10-21 00:35:54 +02:00
maia tillie arson crimew 5a9c134d27 manually turn missing files into objects 
this results in more proper git repos, and will potentially be useful in the future for even more complete clones

fixes #7
 2021-10-20 22:57:44 +02:00
maia tillie arson crimew c3ac0e575c support proxy environment variables 2021-10-20 22:37:33 +02:00
maia tillie arson crimew 9c9969aa99 update README 2021-10-20 22:22:59 +02:00
maia tillie arson crimew 843dfd1d25 support more auto-index styles 2021-10-20 22:18:36 +02:00
maia tillie arson crimew 5c05777482 fix remaining deadlocks due to oversight + clean up 2021-10-20 22:14:07 +02:00
maia tillie arson crimew 574b161773 make sure idle workers nap more 2021-10-20 21:48:12 +02:00
maia tillie arson crimew 10e97aad66 potentially fix deadlock issues with new queueing system 2021-10-20 21:38:29 +02:00
maia tillie arson crimew 7a8066e0d5 create jobs before creating workers 2021-10-20 21:19:48 +02:00
maia tillie arson crimew f8a9a2695e implement proper dynamic queue 2021-10-20 21:14:09 +02:00
maia tillie arson crimew 2f526378c5 attempt to fetch files listed in .gitignore 2021-10-20 21:07:53 +02:00
maia tillie arson crimew 08d74d8c9b performance and edge case handling improvements 
+ new, better and cuter logging
 2021-10-20 20:57:29 +02:00
Tillie Kottmann ed1f0311a2 Download missing files using index if available 2020-11-24 09:15:27 +01:00
Tillie Kottmann 24d71c8620 Add support for ratelimiting 2020-11-24 09:02:04 +01:00
Tillie Kottmann 9fd3320612 Fetch even more missing blobs using git status 2020-11-21 20:38:14 +01:00
Tillie Kottmann 196d0c448f remove debug output 2020-11-21 19:47:49 +01:00
Tillie Kottmann a2f0e88e53 Create ref file from log files if no ref files were fetched 2020-11-21 19:35:23 +01:00
Tillie Kottmann 5f27228b62 Try to get more ref files if possible 2020-11-21 19:08:14 +01:00
Tillie Kottmann 56ddf5ad00 Attempt to fetch missing files after checkout 2020-11-21 18:52:38 +01:00
Tillie Kottmann bc6e1064e3 magically fix most of the bugs, dont ask me how 2020-11-17 23:22:47 +01:00
Tillie Kottmann 32a59663bf Update README 2020-11-12 20:49:10 +01:00
Tillie Kottmann 3a8eda54fd Improve recursive download worker 2020-11-12 18:04:07 +01:00
Tillie Kottmann 92cd9f6bf5 Ignore errors while parsing index 2020-11-12 16:21:44 +01:00
Tillie Kottmann 3558bd48bc A bunch of local fixed and improvements from the past week 2020-11-12 14:32:12 +01:00
Tillie Kottmann 0b6ec74296 Increase queue size for recursive download worker 2020-11-01 18:40:19 +01:00
Tillie Kottmann 0f7fb8ae6c Add the ability to pass in an entire list of domains 2020-11-01 17:55:19 +01:00
Tillie Kottmann def3cc683a Fix html detection 2020-10-31 13:46:49 +01:00
Tillie Kottmann 1f783ec458 Fix remaining locking problem 2020-10-31 13:38:17 +01:00
Tillie Kottmann d9bde64b5b Use proper paths for refs 2020-10-31 12:45:32 +01:00
Tillie Kottmann 1818bae23b Properly fetch packs 2020-10-31 12:45:09 +01:00
Tillie Kottmann 3794296b97 Remove leftover debugging printf 2020-10-31 12:24:46 +01:00
Tillie Kottmann 6712b68c49 Dedupe objects while fetching 2020-10-31 12:23:53 +01:00
Tillie Kottmann 1b9d278cc9 Do some minor clean up 2020-10-31 12:07:17 +01:00
Tillie Kottmann f12d8ce393 Use proper workers for concurrency 
This hasnt fully solved the locking yet, but is much cleaner already
 2020-10-31 12:02:59 +01:00
Tillie Kottmann 5fdfefa887 tune down concurrency again 2020-10-30 19:39:26 +01:00