71 Commits

All Branches

Search

Author	SHA1	Message	Date
Tillie Kottmann	32a59663bf	Update README	2020-11-12 20:49:10 +01:00
Tillie Kottmann	3a8eda54fd	Improve recursive download worker	2020-11-12 18:04:07 +01:00
Tillie Kottmann	92cd9f6bf5	Ignore errors while parsing index	2020-11-12 16:21:44 +01:00
Tillie Kottmann	3558bd48bc	A bunch of local fixed and improvements from the past week	2020-11-12 14:32:12 +01:00
Tillie Kottmann	0b6ec74296	Increase queue size for recursive download worker	2020-11-01 18:40:19 +01:00
Tillie Kottmann	0f7fb8ae6c	Add the ability to pass in an entire list of domains	2020-11-01 17:55:19 +01:00
Tillie Kottmann	def3cc683a	Fix html detection	2020-10-31 13:46:49 +01:00
Tillie Kottmann	1f783ec458	Fix remaining locking problem	2020-10-31 13:38:17 +01:00
Tillie Kottmann	d9bde64b5b	Use proper paths for refs	2020-10-31 12:45:32 +01:00
Tillie Kottmann	1818bae23b	Properly fetch packs	2020-10-31 12:45:09 +01:00
Tillie Kottmann	3794296b97	Remove leftover debugging printf	2020-10-31 12:24:46 +01:00
Tillie Kottmann	6712b68c49	Dedupe objects while fetching	2020-10-31 12:23:53 +01:00
Tillie Kottmann	1b9d278cc9	Do some minor clean up	2020-10-31 12:07:17 +01:00
Tillie Kottmann	f12d8ce393	Use proper workers for concurrency ... This hasnt fully solved the locking yet, but is much cleaner already	2020-10-31 12:02:59 +01:00
Tillie Kottmann	5fdfefa887	tune down concurrency again	2020-10-30 19:39:26 +01:00
Tillie Kottmann	5f332115ff	Fix concurrency limiting?	2020-10-30 19:26:22 +01:00
Tillie Kottmann	bcd80689e2	Concurrency limiter seems to be broken so lets just add back a hack	2020-10-30 18:54:22 +01:00
Tillie Kottmann	3b0420b400	Add readme and license	2020-10-30 18:48:44 +01:00
Tillie Kottmann	5cb2134157	Limit concurrency	2020-10-30 18:42:48 +01:00
Tillie Kottmann	79dd76993b	Add support for fetching repositories via refs	2020-10-30 17:42:28 +01:00
Tillie Kottmann	d51f37de09	Basic implementation to support sites with AutoIndex on	2020-10-30 11:47:23 +01:00