| 5 Jun 2020 |
 Bubu | having the job logs visible in gitlab-ci feels like a huge win | 18:19:40 |
| Bubu | it's also a stupedlyt simple way to parallelize things | 18:20:02 |
 _hc | the buildserver ansible stuff can easily be repurpsed, it already supports buster for the base VM | 18:19:43 |
| Bubu | which currently doesn't work too well on the gcc runnner yet :? | 18:20:18 |
| Bubu | * which currently doesn't work too well on the gcc runnner yet :/ | 18:20:21 |
| _hc | I guess if you assume it downloads the whole source repo each time, then that parallelization method is fine | 18:21:02 |
| _hc | seems like a lot of bandwidth for something that runs daily | 18:21:14 |
| _hc | I was thinking that we should have a checkupdates mode that operates directly on the git remote without cloning it | 18:21:46 |
 cdesai | mirrors can help with bandwidth, just need to clone once | 18:21:59 |
| _hc | how do you mirror gitlab.com and github.com? | 18:22:25 |
| cdesai | only need the repos we care about | 18:23:06 |
| _hc | here's the basis of my git remote idea:
$ git ls-remote https://gitlab.com/fdroid/fdroidclient.git |grep -Eo 'tags/.*'
tags/0.44
tags/0.45
tags/0.46
tags/0.47-test
[snip]
| 18:23:37 |
| _hc | so it would be a git tags check | 18:23:54 |
| Bubu | you rrely ever pay for bandwidth anywhere these days | 18:24:15 |
| Bubu | *rarely | 18:24:18 |
| Bubu | I think my personal server had free 1000TB bandwidth before they removed that limit alltogether | 18:24:45 |
| Bubu | we'll be fine moving a few 100 GB per day | 18:25:18 |
| _hc | ok | 18:25:28 |
| _hc | seems like it would also be a source of slowness | 18:25:37 |
| _hc | for checkupdates | 18:26:01 |
| Bubu | it could be, but I didn't notice that being the case as long as it's not running behind a shitty home internet connection | 18:26:27 |
| _hc | osuosl's connection isn't super fast, seems as fast as my home for downloads | 18:27:09 |
| _hc | like not more than 10MB/s | 18:27:14 |
| Bubu | I noticed it being slow to a lot of stuff but I cloned things with 100 Mb/s from gitlab/github | 18:27:58 |
| _hc | I'll bet GCP has very fast connections to gitlab.com and github.com | 18:27:45 |
| Bubu | but package install were 800 kb/s for some reason | 18:28:18 |
| cdesai | gitlab is on gcp | 18:28:11 |
| _hc | GCP? | 18:28:14 |
| _hc | right that's what I mean | 18:28:21 |
| _hc | spinner disks? | 18:28:36 |
