Commit Graph

71 Commits

Author SHA1 Message Date
maia arson crimew 3c15d60c83 Revert "feat: checkout the repository worktree with go-git instead of invoking the git command"
revert for now as the actual git command line is way more robust than go git and this new code immediately failed on the first repository i tested it on, gating it behind an option might make sense though for container applications

This reverts commit e59a558dcd.
2024-03-05 21:05:55 +01:00
Himadri Bhattacharjee e59a558dcd feat: checkout the repository worktree with go-git instead of invoking the git command 2024-03-05 20:24:39 +01:00
maia arson crimew a02feedb42 update funding info 2022-12-19 19:40:42 +01:00
maia arson crimew bd382f5c51 skip comments in .gitignore download
fixes #16
2022-12-19 19:39:44 +01:00
maia arson crimew 51f64086f6 fix recursive download 2022-12-19 19:39:24 +01:00
six2dez 2fe9061604 Update README.md
Just updating the installation convention cause `go get -u github.com/deletescape/goop@latest` returns an error :)
2022-06-30 20:40:38 +02:00
maia arson crimew f78c604ff8
Merge pull request #14 from edermi/main
Add check for nil
2022-02-03 16:28:57 +01:00
Michael Eder 459d124449 Add check for nil 2022-02-03 09:25:28 +01:00
maia tillie arson crimew a7eda1d12c oopsie 2022-01-01 06:47:06 +01:00
maia tillie arson crimew 497d6132d5 add funding.yml 2021-10-27 17:11:59 +02:00
maia tillie arson crimew 39cf77e71e start work on new pack file scanner 2021-10-26 22:23:01 +02:00
maia tillie arson crimew 724f33d8f0 grab actual git hooks, not just samples 2021-10-26 21:46:53 +02:00
maia tillie arson crimew d1a3a4079a actually grab commit grab files from remote 2021-10-26 21:39:32 +02:00
maia tillie arson crimew 04002fa17f Grab object hashes from commit graph files 2021-10-26 21:33:20 +02:00
maia tillie arson crimew 6eae4acc17 grab object hashes from more places 2021-10-26 21:08:27 +02:00
maia tillie arson crimew 318039cb3c start adding support for some more obscure git features 2021-10-26 20:57:33 +02:00
maia tillie arson crimew a6c6710b3c force full concurrency wherever appropriate 2021-10-24 20:11:22 +02:00
maia tillie arson crimew cf3a38881f use jobtracker from the extracted library 2021-10-24 19:28:58 +02:00
maia tillie arson crimew 967f998486 Refactor JobTracker to prepare for library extraction 2021-10-24 18:52:27 +02:00
maia tillie arson crimew 0703f40da3 WIP: add git lfs support
So far we are able to download objects, what's still left to do is checking out
2021-10-21 23:58:37 +02:00
maia tillie arson crimew 956d5ba8d8 remove unused constants 2021-10-21 16:36:39 +02:00
maia tillie arson crimew 769869480c factor out some more code into separate functions 2021-10-21 16:30:11 +02:00
maia tillie arson crimew 3399f2ad56 optimize checkout + factor out fetching of ignored files 2021-10-21 16:18:21 +02:00
maia tillie arson crimew ff3f22f076 only create objects if hash matches the index 2021-10-21 15:09:46 +02:00
maia tillie arson crimew 7b9abaa163 make object creation fully native and parallelized 2021-10-21 05:42:58 +02:00
maia tillie arson crimew 3c0ee8ea47 create manual objects using go-git 2021-10-21 05:02:01 +02:00
maia tillie arson crimew af7706e32f update README 2021-10-21 03:15:53 +02:00
maia tillie arson crimew 9cd04c613d parse git config to get remote names for branches 2021-10-21 01:36:09 +02:00
maia tillie arson crimew 9d7d6f58e7 clean up JobTracker and make it more reliable 2021-10-21 00:55:18 +02:00
maia tillie arson crimew 1a084596d5 get number of jobs from JobTracker 2021-10-21 00:39:15 +02:00
maia tillie arson crimew 39fbbe315d discard empty jobs on add 2021-10-21 00:35:54 +02:00
maia tillie arson crimew 5a9c134d27 manually turn missing files into objects
this results in more proper git repos, and will potentially be useful in the future for even more complete clones

fixes #7
2021-10-20 22:57:44 +02:00
maia tillie arson crimew c3ac0e575c support proxy environment variables 2021-10-20 22:37:33 +02:00
maia tillie arson crimew 9c9969aa99 update README 2021-10-20 22:22:59 +02:00
maia tillie arson crimew 843dfd1d25 support more auto-index styles 2021-10-20 22:18:36 +02:00
maia tillie arson crimew 5c05777482 fix remaining deadlocks due to oversight + clean up 2021-10-20 22:14:07 +02:00
maia tillie arson crimew 574b161773 make sure idle workers nap more 2021-10-20 21:48:12 +02:00
maia tillie arson crimew 10e97aad66 potentially fix deadlock issues with new queueing system 2021-10-20 21:38:29 +02:00
maia tillie arson crimew 7a8066e0d5 create jobs before creating workers 2021-10-20 21:19:48 +02:00
maia tillie arson crimew f8a9a2695e implement proper dynamic queue 2021-10-20 21:14:09 +02:00
maia tillie arson crimew 2f526378c5 attempt to fetch files listed in .gitignore 2021-10-20 21:07:53 +02:00
maia tillie arson crimew 08d74d8c9b performance and edge case handling improvements
+ new, better and cuter logging
2021-10-20 20:57:29 +02:00
Tillie Kottmann ed1f0311a2 Download missing files using index if available 2020-11-24 09:15:27 +01:00
Tillie Kottmann 24d71c8620 Add support for ratelimiting 2020-11-24 09:02:04 +01:00
Tillie Kottmann 9fd3320612 Fetch even more missing blobs using git status 2020-11-21 20:38:14 +01:00
Tillie Kottmann 196d0c448f remove debug output 2020-11-21 19:47:49 +01:00
Tillie Kottmann a2f0e88e53 Create ref file from log files if no ref files were fetched 2020-11-21 19:35:23 +01:00
Tillie Kottmann 5f27228b62 Try to get more ref files if possible 2020-11-21 19:08:14 +01:00
Tillie Kottmann 56ddf5ad00 Attempt to fetch missing files after checkout 2020-11-21 18:52:38 +01:00
Tillie Kottmann bc6e1064e3 magically fix most of the bugs, dont ask me how 2020-11-17 23:22:47 +01:00