aboutsummaryrefslogtreecommitdiffstats
path: root/grokmirror
AgeCommit message (Expand)AuthorFilesLines
2021-12-22pi-piper: fix crasher on "d" messagesHEADmasterKonstantin Ryabitsev1-2/+4
2021-08-27Don't force url to contain hostnameKonstantin Ryabitsev1-6/+9
2021-08-18Fix crash on trying to remove repository we never fsck'dKonstantin Ryabitsev1-1/+4
2021-08-12Set default boost to 1 when boosts are usedKonstantin Ryabitsev1-1/+3
2021-08-10Add --toplevel and --pi-toplevel to pi-indexerKonstantin Ryabitsev1-33/+65
2021-08-06Fix pull_threads logic errorKonstantin Ryabitsev1-1/+1
2021-07-30Init all new inboxdirs before indexing themKonstantin Ryabitsev1-2/+6
2021-07-30Rework how we pass extra flags to public-inboxKonstantin Ryabitsev1-23/+15
2021-07-29Add ability to pass native public-inbox flagsKonstantin Ryabitsev1-1/+24
2021-07-28Fix missed post_work_hook invocationKonstantin Ryabitsev1-0/+2
2021-07-27Document pi-indexer and set version to 2.1.0-devKonstantin Ryabitsev1-1/+1
2021-07-23More work to support public-inbox processingKonstantin Ryabitsev2-108/+161
2021-07-23Better logic for auto-detecting pull_threadsKonstantin Ryabitsev1-1/+3
2021-07-21Add support for boost and listid prioritiesKonstantin Ryabitsev1-15/+33
2021-07-19Support reindexing and setting descriptionKonstantin Ryabitsev1-1/+29
2021-07-19Up version to 2.0.10-devKonstantin Ryabitsev1-1/+1
2021-07-19Initial grok-pi-indexer implementationKonstantin Ryabitsev2-4/+236
2021-07-19Always ignore blank lines in returned outputKonstantin Ryabitsev1-0/+4
2021-07-13Prepare for the 2.0.9 releasev2.0.9Konstantin Ryabitsev1-1/+1
2021-07-12Handle incorrect unicode in descriptionKonstantin Ryabitsev1-3/+3
2021-06-28Add support for post_clone_complete_hookKonstantin Ryabitsev1-0/+38
2021-06-28Remove some duplicate codeKonstantin Ryabitsev2-106/+28
2021-03-11Prepare for 2.0.8 releasev2.0.8Konstantin Ryabitsev1-1/+1
2021-03-11Don't reqire that [fsck] section is in configKonstantin Ryabitsev1-3/+4
2021-03-11Fix manifest/pull symlink handlingKonstantin Ryabitsev3-10/+41
2021-01-19Prepare for 2.0.7 releasev2.0.7Konstantin Ryabitsev1-1/+1
2021-01-19Fix crasher introduced two commits agoKonstantin Ryabitsev1-2/+4
2021-01-19Tweak manifest objstore outputKonstantin Ryabitsev1-1/+1
2021-01-19Don't hold manifest lock during obstrepo fsckKonstantin Ryabitsev1-4/+12
2021-01-18If plumbing operations fail, try porcelainKonstantin Ryabitsev1-1/+4
2021-01-18Use plumbing when fetching objstore during fsckKonstantin Ryabitsev1-1/+4
2021-01-18Lock objstore repo before fetching objectsKonstantin Ryabitsev1-4/+10
2021-01-18Fix help line for manifest --cfgfileKonstantin Ryabitsev1-1/+1
2021-01-18Don't objstore in dumb_pullKonstantin Ryabitsev1-8/+2
2021-01-18Don't crash on repos without objstoreKonstantin Ryabitsev1-2/+1
2021-01-18Increment version to 2.0.7-devKonstantin Ryabitsev1-1/+1
2021-01-18Use plumbing for objstore when configuredKonstantin Ryabitsev1-1/+7
2021-01-18Don't force a pull after fix_paramsKonstantin Ryabitsev1-6/+6
2021-01-07Update objstore repos after dumb-pullv2.0.6Konstantin Ryabitsev2-11/+15
2021-01-04Use fsck.extra_repack_flags for quick repacksKonstantin Ryabitsev1-0/+3
2020-11-25Prepare for 2.0.5v2.0.5Konstantin Ryabitsev1-1/+1
2020-11-12Prioritize baseline repos when finding obstreposKonstantin Ryabitsev2-4/+19
2020-11-12Wake up more frequently on idleKonstantin Ryabitsev1-2/+6
2020-11-12Properly handle multiple baseline entriesKonstantin Ryabitsev2-20/+21
2020-11-06Release 2.0.4v2.0.4Konstantin Ryabitsev1-1/+1
2020-11-06Clean up some of the preload UI stringsKonstantin Ryabitsev1-4/+4
2020-11-06Rehome bundle preload cleanupKonstantin Ryabitsev1-17/+16
2020-11-06Increase sleep times on wait no-opsKonstantin Ryabitsev1-3/+4
2020-11-05Don't leave .bundle files aroundKonstantin Ryabitsev1-0/+5
2020-11-05Add core.objstore_uses_plumbing settingKonstantin Ryabitsev2-19/+104
2020-11-04Prepare to release 2.0.3v2.0.3Konstantin Ryabitsev1-1/+1
2020-11-04Add initial support for objstore preload bundlesKonstantin Ryabitsev3-16/+98
2020-11-03Up the version to 2.0.3-devKonstantin Ryabitsev1-1/+1
2020-11-03Refuse to purge ffonly reposKonstantin Ryabitsev1-0/+7
2020-10-07Fix version to 2.0.2v2.0.2Konstantin Ryabitsev1-1/+1
2020-10-07Remember to return True on successful piper initKonstantin Ryabitsev1-0/+1
2020-10-07Fix setup.py and add example duplicate filterKonstantin Ryabitsev1-0/+0
2020-10-07Add some more features to piperKonstantin Ryabitsev3-5/+224
2020-10-06Add pi-piper script for public-inbox mirrorsKonstantin Ryabitsev2-23/+29
2020-09-30Add support to ignore refs for grok-manifestKonstantin Ryabitsev2-14/+30
2020-09-30Fix extra_repack_flagsKonstantin Ryabitsev2-6/+6
2020-09-30Prepare for 2.0.1 releasev2.0.1Konstantin Ryabitsev1-1/+1
2020-09-30Use faster dir searching algorithmKonstantin Ryabitsev2-31/+36
2020-09-30Some cosmetic changes to interactive fsck runsKonstantin Ryabitsev1-12/+25
2020-09-29Don't set up a non-existent altrepoKonstantin Ryabitsev1-1/+2
2020-09-29Don't bomb the logs with all the errorsKonstantin Ryabitsev1-13/+20
2020-09-28Allow forcing obstrepo repackKonstantin Ryabitsev1-1/+10
2020-09-28Add merge strategy based on shared blob sizeKonstantin Ryabitsev2-60/+154
2020-09-27Add trial obstrepo_merge_strategy featureKonstantin Ryabitsev2-4/+20
2020-09-26Up the version to 2.0.1-devKonstantin Ryabitsev1-1/+1
2020-09-26Fix potential repo corruption on migrationKonstantin Ryabitsev1-8/+16
2020-09-25Merge repos where roots are a full subsetKonstantin Ryabitsev1-1/+1
2020-09-21Change the version to 2.0.0Konstantin Ryabitsev1-3/+3
2020-09-19Force conn-only checks on repos using objstoreKonstantin Ryabitsev1-0/+6
2020-09-19Deal with potential odd values in count-objectsKonstantin Ryabitsev1-1/+6
2020-09-19Report space savings after repack runsKonstantin Ryabitsev1-2/+33
2020-09-18Finalize the UPGRADING documentKonstantin Ryabitsev1-2/+2
2020-09-04Force fetch on fingerprint discrepanciesKonstantin Ryabitsev1-0/+4
2020-09-04Use argparse instead of deprecated optparseKonstantin Ryabitsev5-159/+153
2020-09-04Add grok-bundle commandKonstantin Ryabitsev1-0/+167
2020-09-04Support --nomtime with manifest_commandKonstantin Ryabitsev1-0/+2
2020-09-02Exit subprocess instead of returningKonstantin Ryabitsev1-2/+2
2020-09-02Fix ignore_errors processingKonstantin Ryabitsev1-7/+7
2020-08-31Do a repack instead of fsck if repo fp changedKonstantin Ryabitsev1-1/+13
2020-08-29Move pull worker spawning up in the cycleKonstantin Ryabitsev1-34/+37
2020-08-29Remove redundant check for q_todoKonstantin Ryabitsev1-1/+1
2020-08-29Optimize main loop a bit to run less hotKonstantin Ryabitsev1-39/+50
2020-08-28Expire reflogs if we find a logs directoryKonstantin Ryabitsev1-0/+6
2020-08-28Roll back --user and --group functionalityKonstantin Ryabitsev4-38/+0
2020-08-28Always add a "reference" entryKonstantin Ryabitsev2-4/+7
2020-08-27Lock the repo before pruning garbageKonstantin Ryabitsev1-1/+6
2020-08-27Run git prune if we find garbage filesKonstantin Ryabitsev1-25/+40
2020-08-27Don't force commitgraph to falseKonstantin Ryabitsev1-3/+0
2020-08-27Tweaks and fixes to grok-fsck runsKonstantin Ryabitsev3-23/+22
2020-08-27Simplify and fix logic for manifest runsKonstantin Ryabitsev1-7/+6
2020-08-26Make remote name configurableKonstantin Ryabitsev1-22/+22
2020-08-26Save manifest before grabbing new oneKonstantin Ryabitsev1-0/+2
2020-08-26Use the new q_mani queue with listenerKonstantin Ryabitsev1-7/+4
2020-08-26Move manifest download into a subprocessKonstantin Ryabitsev1-64/+72
2020-08-26If git remote was successful, don't log stderrKonstantin Ryabitsev1-1/+3
2020-08-26Setgid before we setuidKonstantin Ryabitsev1-10/+10
2020-08-26Perform fatal exit on exit code 1 onlyKonstantin Ryabitsev1-2/+6
2020-08-26Perform setuid/setgid in grokmirror itselfKonstantin Ryabitsev4-1/+39
2020-08-26Don't terminate workers in handlerKonstantin Ryabitsev1-13/+13
2020-08-26Make sure a repo has an "origin" remoteKonstantin Ryabitsev1-0/+7
2020-08-25Make sure to update originKonstantin Ryabitsev1-1/+1
2020-08-25Add pull.nopurge settingKonstantin Ryabitsev1-1/+9
2020-08-24Allow use of manifest_commandKonstantin Ryabitsev2-82/+114
2020-08-24Log to critical on a broken repoKonstantin Ryabitsev1-1/+1
2020-08-24Catch problems with alternates early onKonstantin Ryabitsev1-1/+10
2020-08-24Use ${toplevel}/objstore as default nameKonstantin Ryabitsev3-3/+3
2020-08-24Fix log string for grok-fsck runsKonstantin Ryabitsev1-1/+1
2020-08-21Avoid leaking fds when running daemonizedKonstantin Ryabitsev1-18/+19
2020-08-18Set up forked repos with objstore properlyKonstantin Ryabitsev1-0/+15
2020-08-18Save the HEAD file with newlineKonstantin Ryabitsev1-2/+2
2020-08-17Fix logic for islandcore settingKonstantin Ryabitsev1-1/+3
2020-08-17Use alternate's obj_info for repack levelKonstantin Ryabitsev1-0/+7
2020-08-17Reinstate --purge option for grok-pullKonstantin Ryabitsev1-3/+10
2020-08-13Don't fail on failure to lockKonstantin Ryabitsev1-2/+4
2020-08-12Send a critical error report from grok-fsckKonstantin Ryabitsev1-0/+28
2020-08-12Remove entries from manifest that aren't on diskKonstantin Ryabitsev1-4/+20
2020-08-11Fix projectslist_symlinks settingKonstantin Ryabitsev1-1/+1
2020-08-05Add a few more options to the config fileKonstantin Ryabitsev4-18/+58
2020-07-30Switch logging to WatchedFileHandlerKonstantin Ryabitsev5-123/+59
2020-07-29Make -o mean "continous" to make runonce defaultKonstantin Ryabitsev1-3/+3
2020-07-29Don't pause the spa on -o runsKonstantin Ryabitsev1-11/+15
2020-07-29Add some read timeouts to manifest downloadsKonstantin Ryabitsev1-1/+2
2020-07-24Implement baselines and islandcoresKonstantin Ryabitsev2-6/+44
2020-07-18Only merge exactly matching obstreposKonstantin Ryabitsev2-11/+12
2020-07-17Tweak how we match siblings to avoid snowballingKonstantin Ryabitsev5-28/+60
2020-07-16A few more UI tweaks for grok-fsckKonstantin Ryabitsev1-8/+9
2020-07-16Pause the spa when load is over cpu countKonstantin Ryabitsev1-0/+12
2020-07-16Don't do unnecessary repacks after each objstoreKonstantin Ryabitsev1-1/+4
2020-07-16Another small UI tweakKonstantin Ryabitsev1-2/+5
2020-07-16Don't repack unless we're doing objstoreKonstantin Ryabitsev1-1/+1
2020-07-16UI tweaks for console outputKonstantin Ryabitsev2-30/+35
2020-07-16Tweak spa optionsKonstantin Ryabitsev1-14/+13
2020-07-16Tweak when we repack and notKonstantin Ryabitsev1-3/+4
2020-07-15Consider objects in packs as wellKonstantin Ryabitsev1-1/+1
2020-07-15Move objstore and repack ops into single threadKonstantin Ryabitsev2-50/+122
2020-07-15Tweak manifest output for UI consistencyKonstantin Ryabitsev2-4/+4
2020-07-15Document refresh and socket optionsKonstantin Ryabitsev1-2/+5
2020-07-15Fix copypaste problemKonstantin Ryabitsev1-1/+1
2020-07-15Don't requeue repos waiting for init as pullKonstantin Ryabitsev1-3/+8
2020-07-14Move todo operations into the main threadKonstantin Ryabitsev4-211/+303
2020-07-13Fixes for a crasher in todo_workerKonstantin Ryabitsev3-23/+33
2020-07-13Rewrite threaded processing againKonstantin Ryabitsev4-866/+878
2020-07-07Add support for retriesKonstantin Ryabitsev4-94/+145
2020-07-03Objstore repo handling improvementsKonstantin Ryabitsev4-38/+74
2020-06-30A bunch of fixes from testingKonstantin Ryabitsev4-39/+123
2020-06-26Remove empty siblings from considerationKonstantin Ryabitsev1-1/+7
2020-06-26Update HEAD when manifest entry changesKonstantin Ryabitsev2-16/+30
2020-06-26Improve redundant objstore merging routineKonstantin Ryabitsev1-40/+58
2020-06-25Fix logic error for ref repacksKonstantin Ryabitsev1-1/+1
2020-06-25Tweak initial obstore migration routinesKonstantin Ryabitsev1-11/+12
2020-06-25The obstdir may not be there yetKonstantin Ryabitsev1-0/+2
2020-06-25Large commit with grokmirror-2.x featuresKonstantin Ryabitsev5-1255/+1646
2019-10-29Force --no-progress on fsck runsstable-1.2.yKonstantin Ryabitsev1-1/+1
2019-10-23Prepare for 1.2.2 with commitgraph supportKonstantin Ryabitsev3-7/+39
2019-03-11Prepare for 1.2.1v1.2.1Konstantin Ryabitsev2-11/+33
2019-02-14Call this 1.2.0 for consistency and update manv1.2.0Konstantin Ryabitsev1-1/+1
2019-02-14Prepare for 1.2 releaseKonstantin Ryabitsev2-3/+3
2019-01-14Properly deal with grandchildren repos and -kKonstantin Ryabitsev1-3/+3
2019-01-07Make preciousObjects configurableKonstantin Ryabitsev2-42/+69
2019-01-04Try to deal better with preciousObjectsKonstantin Ryabitsev1-31/+36
2019-01-03Set preciousObjects for mother reposKonstantin Ryabitsev1-5/+31
2019-01-02Add support for auto-recloning on certain errorsKonstantin Ryabitsev2-7/+64
2018-08-22Add --no-reflogs to fsckKonstantin Ryabitsev1-1/+1
2018-08-17Don't crash if we can't count objects in a repoKonstantin Ryabitsev1-2/+6
2018-08-15Warn when we find grandchild reposKonstantin Ryabitsev1-1/+13
2018-08-15Tweak loose object count calculationsKonstantin Ryabitsev1-4/+8
2018-08-14Rework repacking logic to make it more cleverKonstantin Ryabitsev4-219/+230
2018-08-10Start switching repack logic to be like gc.autoKonstantin Ryabitsev2-13/+39
2018-07-25Quickfix and 1.1.1 for a stupid bug with grok-fsckv1.1.1Konstantin Ryabitsev2-1/+4
2018-04-24Call this version 1.1.0Konstantin Ryabitsev1-1/+1
2018-04-24Give some feedback in early fsck stagesKonstantin Ryabitsev2-1/+11
2018-04-24Don't leave progress bars in the terminalKonstantin Ryabitsev3-10/+29
2018-04-23Add simple progress barsKonstantin Ryabitsev3-15/+86
2018-04-23Switch to using decode() universallyKonstantin Ryabitsev2-12/+9
2018-04-23Do lock the repos during fsck/repackKonstantin Ryabitsev5-18/+26
2018-04-19Use some optimization for alternates trackingKonstantin Ryabitsev1-22/+23
2018-04-19Don't trigger full repack when --repack-all-quickKonstantin Ryabitsev1-1/+2
2018-04-19Be more paranoid pruning/purging reposKonstantin Ryabitsev3-22/+27
2018-04-19Clean up logic in fsck.pyKonstantin Ryabitsev1-85/+85
2018-04-19Also look in stdout for git fsck errorsKonstantin Ryabitsev1-8/+16
2018-04-19Avoid unnecessary interpolation in critical messages.Elliott Sales de Andrade5-29/+30
2018-04-19Avoid unnecessary interpolation in warning messages.Elliott Sales de Andrade4-20/+21
2018-04-19Avoid unnecessary interpolation in info messages.Elliott Sales de Andrade5-71/+69
2018-04-18Avoid unnecessary interpolation in debug messages.Elliott Sales de Andrade5-104/+106
2018-04-18Prepare for 1.0.2 releaseKonstantin Ryabitsev4-75/+112
2018-04-03Decode results from subprocess calls.Elliott Sales de Andrade3-12/+17
2018-04-03Set explicit encoding for JSON I/O.Elliott Sales de Andrade3-25/+23
2018-04-03Be more explicit about text/bytes file I/O.Elliott Sales de Andrade2-43/+38
2018-04-03Import Queue from new location.Elliott Sales de Andrade1-3/+6
2018-04-03Import ConfigParser from new location.Elliott Sales de Andrade2-2/+5
2018-04-03Import urllib2 things from new locations.Elliott Sales de Andrade1-11/+17
2018-04-03Use new-style exception handling.Elliott Sales de Andrade1-3/+3
2018-04-03Remove unused imports.Elliott Sales de Andrade3-12/+2
2017-02-10Prep for release 1.0.1v1.0.1Konstantin Ryabitsev1-1/+1
2017-02-10A couple of bugfixes for minor issuesKonstantin Ryabitsev2-11/+23