Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.672391225s FAIL (2025-08-07 19:39:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.672418885s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...............................X.......] duration: 968.795644ms FAIL (2025-08-07 19:39:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 968.843334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.474845784s FAIL (2025-08-07 19:39:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.474943719s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...............................X......] duration: 850.177903ms FAIL (2025-08-07 19:38:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 850.203664ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.873248869s FAIL (2025-08-07 19:38:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.873296614s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.968843029s FAIL (2025-08-07 19:38:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.968872522s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X...............................X.....] duration: 871.366942ms FAIL (2025-08-07 19:38:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 871.395869ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration: 838.548658ms FAIL (2025-08-07 19:37:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 838.580373ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.488990897s FAIL (2025-08-07 19:37:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.489023485s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X...............................X...] duration: 947.115279ms FAIL (2025-08-07 19:37:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 947.15751ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration: 990.818325ms FAIL (2025-08-07 19:36:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 990.862662ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.805657602s FAIL (2025-08-07 19:36:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.805686545s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.........................X...............................X.] duration: 1.009257659s FAIL (2025-08-07 19:36:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 1.009292394s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.........................X...............................X] duration: 752.885608ms FAIL (2025-08-07 19:36:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:51.886330069 (9h48m13.630386936s) [upload=10194]: Done uploading segments... Aug 7 19:27:51.886355427 (9h48m13.630412277s) [upload=10194]: Upload finished. err: <nil> Aug 7 19:28:38.399269563 (9h49m0.143326423s) [upload=10206]: Starting upload Aug 7 19:28:38.399318611 (9h49m0.14337548s) [upload=10206]: Done starting upload Aug 7 19:28:38.399390131 (9h49m0.143446977s) [upload=10206]: Uploading segments... Aug 7 19:28:38.399544707 (9h49m0.143601567s) [upload=10206]: Got next segment. Inline: true Aug 7 19:28:38.399551721 (9h49m0.143608572s) [upload=10206]: Waiting for error group managing segments... Aug 7 19:28:38.399601417 (9h49m0.143658268s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:28:38.399606942 (9h49m0.143663807s) [upload=10206]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:28:38.399621338 (9h49m0.143678198s) [upload=10206]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:28:38.601332380 (9h49m0.34538924s) [upload=10206]: Done uploading segments... Aug 7 19:28:38.601351144 (9h49m0.345407994s) [upload=10206]: Upload finished. err: <nil> Aug 7 19:29:07.505602628 (9h49m29.249659478s) [upload=10214]: Starting upload Aug 7 19:29:07.505672515 (9h49m29.249729399s) [upload=10214]: Done starting upload Aug 7 19:29:07.505782587 (9h49m29.24983944s) [upload=10214]: Uploading segments... Aug 7 19:29:07.505859908 (9h49m29.249916777s) [upload=10214]: Got next segment. Inline: true Aug 7 19:29:07.505866672 (9h49m29.249923532s) [upload=10214]: Waiting for error group managing segments... Aug 7 19:29:07.505951046 (9h49m29.250007897s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:29:07.505956898 (9h49m29.250013757s) [upload=10214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:29:07.505960751 (9h49m29.250017612s) [upload=10214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:29:07.876865588 (9h49m29.620922438s) [upload=10214]: Done uploading segments... Aug 7 19:29:07.876892676 (9h49m29.620949542s) [upload=10214]: Upload finished. err: <nil> Aug 7 19:30:13.476600345 (9h50m35.220657195s) [upload=10230]: Starting upload Aug 7 19:30:13.476669724 (9h50m35.220726584s) [upload=10230]: Done starting upload Aug 7 19:30:13.476751736 (9h50m35.220808586s) [upload=10230]: Uploading segments... Aug 7 19:30:13.476825711 (9h50m35.220882578s) [upload=10230]: Got next segment. Inline: true Aug 7 19:30:13.476831589 (9h50m35.22088845s) [upload=10230]: Waiting for error group managing segments... Aug 7 19:30:13.476890319 (9h50m35.220947179s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:13.476896199 (9h50m35.22095305s) [upload=10230]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:13.476899546 (9h50m35.220956406s) [upload=10230]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:13.734745615 (9h50m35.478802486s) [upload=10230]: Done uploading segments... Aug 7 19:30:13.734775287 (9h50m35.478832135s) [upload=10230]: Upload finished. err: <nil> Aug 7 19:30:30.813489199 (9h50m52.557546045s) [upload=10237]: Starting upload Aug 7 19:30:30.813534016 (9h50m52.557590886s) [upload=10237]: Done starting upload Aug 7 19:30:30.813607968 (9h50m52.557664814s) [upload=10237]: Uploading segments... Aug 7 19:30:30.813655381 (9h50m52.55771225s) [upload=10237]: Got next segment. Inline: true Aug 7 19:30:30.813660024 (9h50m52.557716884s) [upload=10237]: Waiting for error group managing segments... Aug 7 19:30:30.813710048 (9h50m52.557766894s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:30:30.813715097 (9h50m52.557771944s) [upload=10237]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:30:30.813717763 (9h50m52.557774622s) [upload=10237]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:31.013602582 (9h50m52.757659432s) [upload=10237]: Done uploading segments... Aug 7 19:30:31.013623399 (9h50m52.757680249s) [upload=10237]: Upload finished. err: <nil> Aug 7 19:31:35.290180636 (9h51m57.034237499s) [upload=10251]: Starting upload Aug 7 19:31:35.290273662 (9h51m57.03433053s) [upload=10251]: Done starting upload Aug 7 19:31:35.290403553 (9h51m57.034460413s) [upload=10251]: Uploading segments... Aug 7 19:31:35.290476768 (9h51m57.034533637s) [upload=10251]: Got next segment. Inline: true Aug 7 19:31:35.290483212 (9h51m57.034540072s) [upload=10251]: Waiting for error group managing segments... Aug 7 19:31:35.290543729 (9h51m57.034600589s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:31:35.290549659 (9h51m57.034606519s) [upload=10251]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:31:35.290553243 (9h51m57.034610103s) [upload=10251]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:31:35.595876527 (9h51m57.339933378s) [upload=10251]: Done uploading segments... Aug 7 19:31:35.595895618 (9h51m57.339952479s) [upload=10251]: Upload finished. err: <nil> Aug 7 19:32:33.478000323 (9h52m55.222057175s) [upload=10271]: Starting upload Aug 7 19:32:33.478092160 (9h52m55.222149012s) [upload=10271]: Done starting upload Aug 7 19:32:33.478193653 (9h52m55.222250506s) [upload=10271]: Uploading segments... Aug 7 19:32:33.478269537 (9h52m55.222326403s) [upload=10271]: Got next segment. Inline: true Aug 7 19:32:33.478274531 (9h52m55.222331392s) [upload=10271]: Waiting for error group managing segments... Aug 7 19:32:33.478329588 (9h52m55.222386449s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:32:33.478335277 (9h52m55.222392137s) [upload=10271]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:32:33.478338786 (9h52m55.222395646s) [upload=10271]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:32:33.626780194 (9h52m55.370837045s) [upload=10271]: Done uploading segments... Aug 7 19:32:33.626804100 (9h52m55.370860946s) [upload=10271]: Upload finished. err: <nil> Aug 7 19:33:43.736667672 (9h54m5.480724543s) [upload=10292]: Starting upload Aug 7 19:33:43.736746026 (9h54m5.480802887s) [upload=10292]: Done starting upload Aug 7 19:33:43.736832119 (9h54m5.480888983s) [upload=10292]: Uploading segments... Aug 7 19:33:43.736879076 (9h54m5.480935949s) [upload=10292]: Got next segment. Inline: true Aug 7 19:33:43.736885420 (9h54m5.48094229s) [upload=10292]: Waiting for error group managing segments... Aug 7 19:33:43.736939021 (9h54m5.480995889s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:33:43.736945002 (9h54m5.481001864s) [upload=10292]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:33:43.736949130 (9h54m5.481005994s) [upload=10292]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:33:43.901404462 (9h54m5.64546131s) [upload=10292]: Done uploading segments... Aug 7 19:33:43.901422947 (9h54m5.645479794s) [upload=10292]: Upload finished. err: <nil> Aug 7 19:34:21.123350278 (9h54m42.867407128s) [upload=10302]: Starting upload Aug 7 19:34:21.123516131 (9h54m42.867573029s) [upload=10302]: Done starting upload Aug 7 19:34:21.123613280 (9h54m42.867670126s) [upload=10302]: Uploading segments... Aug 7 19:34:21.123668042 (9h54m42.867724939s) [upload=10302]: Got next segment. Inline: true Aug 7 19:34:21.123681558 (9h54m42.867738405s) [upload=10302]: Waiting for error group managing segments... Aug 7 19:34:21.123736416 (9h54m42.867793281s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:34:21.123742611 (9h54m42.867799479s) [upload=10302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:34:21.123746615 (9h54m42.867803478s) [upload=10302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:34:21.346020769 (9h54m43.09007763s) [upload=10302]: Done uploading segments... Aug 7 19:34:21.346044615 (9h54m43.090101467s) [upload=10302]: Upload finished. err: <nil> Aug 7 19:35:00.569544733 (9h55m22.313601594s) [upload=10314]: Starting upload Aug 7 19:35:00.569610092 (9h55m22.313666952s) [upload=10314]: Done starting upload Aug 7 19:35:00.569695260 (9h55m22.31375211s) [upload=10314]: Uploading segments... Aug 7 19:35:00.569748567 (9h55m22.313805428s) [upload=10314]: Got next segment. Inline: true Aug 7 19:35:00.569753749 (9h55m22.313810609s) [upload=10314]: Waiting for error group managing segments... Aug 7 19:35:00.569794565 (9h55m22.313851414s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:35:00.569799770 (9h55m22.31385663s) [upload=10314]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:35:00.569804989 (9h55m22.313861852s) [upload=10314]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:35:00.728644630 (9h55m22.47270148s) [upload=10314]: Done uploading segments... Aug 7 19:35:00.728668920 (9h55m22.472725783s) [upload=10314]: Upload finished. err: <nil> Aug 7 19:36:13.180421355 (9h56m34.924478518s) [upload=10334]: Starting upload Aug 7 19:36:13.180486141 (9h56m34.924543002s) [upload=10334]: Done starting upload Aug 7 19:36:13.180568938 (9h56m34.924625788s) [upload=10334]: Uploading segments... Aug 7 19:36:13.180621031 (9h56m34.924677891s) [upload=10334]: Got next segment. Inline: true Aug 7 19:36:13.180628251 (9h56m34.924685111s) [upload=10334]: Waiting for error group managing segments... Aug 7 19:36:13.180671204 (9h56m34.924728054s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:36:13.180676625 (9h56m34.924733485s) [upload=10334]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:36:13.180691318 (9h56m34.924748179s) [upload=10334]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:36:13.359995639 (9h56m35.104052505s) [upload=10334]: Done uploading segments... Aug 7 19:36:13.360018639 (9h56m35.104075493s) [upload=10334]: Upload finished. err: <nil> Duration:* 753.004263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.512440717s FAIL (2025-08-07 19:36:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.512476292s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.599094472s FAIL (2025-08-07 19:35:07 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.599129958s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X.........................X...............................] duration: 875.066927ms FAIL (2025-08-07 19:35:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 875.108428ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X.........................X..............................] duration: 974.752039ms FAIL (2025-08-07 19:34:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 974.78263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.592969494s FAIL (2025-08-07 19:33:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.593001352s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...X.........................X.............................] duration: 854.490595ms FAIL (2025-08-07 19:33:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 854.517519ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.621730264s FAIL (2025-08-07 19:32:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.621766442s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X...X.........................X............................] duration: 845.03564ms FAIL (2025-08-07 19:32:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 845.06856ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.678211294s FAIL (2025-08-07 19:32:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.678262549s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.735605384s FAIL (2025-08-07 19:31:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.735644914s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X...X.........................X...........................] duration: 1.01201999s FAIL (2025-08-07 19:31:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.01204191s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.806102965s FAIL (2025-08-07 19:31:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.806157992s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X...X.........................X..........................] duration: 951.681241ms FAIL (2025-08-07 19:30:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 951.717703ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2.76356667s FAIL (2025-08-07 19:30:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 5024f8c947ad23c517bc06eb7e74d9d7e4887aecd9a9586142d0f68720c217e2 != before 9dd31f1c5cadf985879aaf3f73da14f5986c9ca551a578b8a296c3749d8f725b ======LOGS====== }, upload=10235]: Begin upload segment... Aug 7 19:30:23.017548237 (9h50m44.761605108s) [seg_pos={0 0}, upload=10235]: Done begin upload segment. Aug 7 19:30:23.017587714 (9h50m44.761644585s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.017618912 (9h50m44.76167578s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018144437 (9h50m44.762201286s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018176158 (9h50m44.76223303s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.018609280 (9h50m44.76266615s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019642854 (9h50m44.763699725s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.019988972 (9h50m44.764045842s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020058680 (9h50m44.764115549s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020472823 (9h50m44.764529693s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.020895804 (9h50m44.76495267s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021271997 (9h50m44.76532886s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.021695782 (9h50m44.765752642s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022108370 (9h50m44.766165231s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022534504 (9h50m44.766591371s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.022614219 (9h50m44.766671089s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023045941 (9h50m44.767102813s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023495114 (9h50m44.767551982s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.023920894 (9h50m44.767977765s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Uploading piece... Aug 7 19:30:23.592771644 (9h50m45.336828497s) [upload=10235]: Next returned nil segment Aug 7 19:30:23.592789906 (9h50m45.336846766s) [upload=10235]: Waiting for error group managing segments... Aug 7 19:30:23.750979421 (9h50m45.495036282s) [noise=true , address=104.36.82.60:4366 , piece_id=YZJ547TZS62SI2QZGGXCVDI637HWDRUQ2VTMHKN73NVVM5JHG65A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.772377432 (9h50m45.516434313s) [noise=true , address=79.127.219.51:4190 , piece_id=R4ITXVFS42XKAIGO7U654LIXKO5CQA47XPKWXD4EIJBL2IVCDKTA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.776338386 (9h50m45.520395247s) [noise=true , address=45.91.116.11:4145 , piece_id=ANDV32PWTH5MBNAMPWF2POKNZQK2O63EDCSESSVU422SYPNMEWUA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.777940403 (9h50m45.521997273s) [noise=true , address=104.36.82.45:4923 , piece_id=6D27WOHVC3RJUNMHC25XK3D5IH2YMDWFAZJ7UMJ3O5L2MVVION4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781418715 (9h50m45.525475576s) [noise=true , address=104.36.82.50:4033 , piece_id=6KRWV2VWQYB2DFFADOH4ITU33TP6OAPPCX6VH4H4RHNYSJFG7MXQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.781471417 (9h50m45.525528285s) [noise=true , address=104.36.82.38:4721 , piece_id=U7UU46AMDJVIRJQL5A67GIYUXRELVIPMNWAIUK5PHHJTUV4XEHLA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.789180781 (9h50m45.533237631s) [noise=true , address=104.36.82.61:4377 , piece_id=YT6BA4NAUNAWMJMWHRVXYX725ZFHYTWFRRYIFCXIPQTCQLX6SE7A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.804859353 (9h50m45.548916218s) [noise=true , address=104.36.82.35:4608 , piece_id=7BZV35IKYU2RFURVQTIBBCUX4QPR25JQJL4EHSPZ4CWDILHJQBBA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.810887411 (9h50m45.554944272s) [noise=true , address=104.36.82.15:4278 , piece_id=ELJCZ4V35G6NWYC7AZGTD7GB7ZPCUOUFZY7C4K3ZUWP3QCZG7QKA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.824507566 (9h50m45.568564432s) [noise=true , address=104.36.82.10:4092 , piece_id=RYUPEZFOCBW2V32WM26QOOX6U7CIXD4X4UHWAV6VQY22NWU4BAAQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848192335 (9h50m45.592249195s) [noise=true , address=104.36.82.55:4212 , piece_id=7KVUNSWXECKHLEOZUVYESQPBIPCM725YID7GWKEUBPRLCNC6VLSA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.848357121 (9h50m45.592413994s) [noise=true , address=104.36.82.16:4319 , piece_id=MU4SPXO7A3N5LG3NMY2KOYB7HK626CYT2O2CPJU7UMWEPRANAKGQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.887112193 (9h50m45.631169044s) [noise=true , address=104.36.82.12:4158 , piece_id=UTIO5QAT4XLPVKUL4JWIY3BDBUKIPTCY3OA6ROCANVZCSS35ED4A, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945418240 (9h50m45.689475106s) [noise=true , address=77.90.31.10:4531 , piece_id=BSTJ2SRRTYZC4WISGQMFE6FNNNSLDN7D2AYUBKSR5W7NRS5BMRLQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: <nil> Aug 7 19:30:23.945480431 (9h50m45.689537292s) [seg_pos={0 0}, upload=10235]: Segment reached optimal threshold of 14 pieces. Aug 7 19:30:23.945822765 (9h50m45.689879616s) [noise=true , address=104.36.82.23:4473 , piece_id=N3YRIDL2UK7WNN7DDYSYU7SHO2FADFLDLVDU62C2LP66MBBLG7AA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 19:30:23.945984980 (9h50m45.69004184s) [noise=true , address=64.49.13.169:4715 , piece_id=TVE2ZEEEJ6CVRXYI5OE2LIHDNC47VD2L6HXNJBPXCSATIXXJY4BA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zHWknNPWJ79pDmU1vfv8TCqWKU9sxrP4upTRBNsPnc8LcLgzK): protocol: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:50352->64.49.13.169:4715: use of closed network connection Aug 7 19:30:23.946223043 (9h50m45.690279903s) [noise=true , address=64.49.13.139:4469 , piece_id=JDDUADWUPTZELQ6W2WLEHGDOR6NLWCQBZC5N2SKMKVEG3GYFDUHQ, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bFAUM5PA2gqHYVo7gQhKb5RHoVFxKFf44xoZhXhMuT7jYJi7b): protocol: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->64.49.13.139:4469: use of closed network connection Aug 7 19:30:23.946304399 (9h50m45.69036126s) [noise=true , address=64.49.13.139:4478 , piece_id=P4Q7ZGA5JHTJI3C7LLDJ2AF2BH2U5JX2EJYCC5H7IEZJLUNJ56MA, seg_pos={0 0}, upload=10235]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51064->64.49.13.139:4478: use of closed network connection Aug 7 19:30:23.946336648 (9h50m45.690393496s) [seg_pos={0 0}, upload=10235]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:30:23.946419337 (9h50m45.690476186s) [upload=10235]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:30:23.946424093 (9h50m45.690480943s) [upload=10235]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:30:24.109585684 (9h50m45.853642555s) [upload=10235]: Done uploading segments... Aug 7 19:30:24.109612266 (9h50m45.853669127s) [upload=10235]: Upload finished. err: <nil> Duration: 2.763597811s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X...X.........................X.........................] duration: 961.544361ms FAIL (2025-08-07 19:30:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 961.576551ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X...X.........................X........................] duration: 1.104426903s FAIL (2025-08-07 19:29:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.104491163s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X...X.........................X.......................] duration: 925.547199ms FAIL (2025-08-07 19:28:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 925.572561ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X...X.........................X......................] duration: 866.005833ms FAIL (2025-08-07 19:27:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 866.068838ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X...X.........................X.....................] duration: 847.523466ms FAIL (2025-08-07 19:27:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 847.561008ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........X...X.........................X....................] duration: 855.708185ms FAIL (2025-08-07 19:26:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 855.734449ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........X...X.........................X...................] duration: 897.616279ms FAIL (2025-08-07 19:25:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 897.647712ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X...X.........................X..................] duration: 1.064061702s FAIL (2025-08-07 19:25:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.064087816s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X...X.........................X.................] duration: 976.284998ms FAIL (2025-08-07 19:23:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 976.313033ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X...X.........................X................] duration: 878.00745ms FAIL (2025-08-07 19:23:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 878.036057ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X...X.........................X...............] duration: 849.078977ms FAIL (2025-08-07 19:22:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 849.109551ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X...X.........................X..............] duration: 1.005416826s FAIL (2025-08-07 19:21:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.005454431s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X...X.........................X.............] duration: 995.287798ms FAIL (2025-08-07 19:20:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 995.320542ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X...X.........................X............] duration: 1.087262068s FAIL (2025-08-07 19:19:39 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.087291838s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X...X.........................X...........] duration: 1.070482018s FAIL (2025-08-07 19:19:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.070509835s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X...X.........................X..........] duration: 911.157754ms FAIL (2025-08-07 19:18:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 911.193388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X...X.........................X.........] duration: 829.275373ms FAIL (2025-08-07 19:17:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 829.301058ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...X.........................X........] duration: 1.042399529s FAIL (2025-08-07 19:16:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 1.042423004s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X...X.........................X.......] duration: 882.931058ms FAIL (2025-08-07 19:16:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 882.9574ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X...X.........................X......] duration: 875.482083ms FAIL (2025-08-07 19:15:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 875.512567ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X...X.........................X.....] duration: 860.472305ms FAIL (2025-08-07 19:15:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 860.503887ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X...X.........................X....] duration: 994.725993ms FAIL (2025-08-07 19:14:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== estItem_SegmentMakeInline Aug 7 19:03:54.866877046 (9h24m16.610933897s) [upload=9775]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:03:55.124871472 (9h24m16.868928324s) [upload=9775]: Done uploading segments... Aug 7 19:03:55.124890904 (9h24m16.868947754s) [upload=9775]: Upload finished. err: <nil> Aug 7 19:04:22.368367065 (9h24m44.112423911s) [upload=9783]: Starting upload Aug 7 19:04:22.368467920 (9h24m44.112524782s) [upload=9783]: Done starting upload Aug 7 19:04:22.368542080 (9h24m44.112598927s) [upload=9783]: Uploading segments... Aug 7 19:04:22.368581308 (9h24m44.112638174s) [upload=9783]: Got next segment. Inline: true Aug 7 19:04:22.368585666 (9h24m44.112642526s) [upload=9783]: Waiting for error group managing segments... Aug 7 19:04:22.368640937 (9h24m44.112697783s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:04:22.368646758 (9h24m44.112703605s) [upload=9783]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:04:22.368649423 (9h24m44.112706283s) [upload=9783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:04:22.523589161 (9h24m44.26764601s) [upload=9783]: Done uploading segments... Aug 7 19:04:22.523676761 (9h24m44.267733612s) [upload=9783]: Upload finished. err: <nil> Aug 7 19:05:17.619568038 (9h25m39.363624898s) [upload=9800]: Starting upload Aug 7 19:05:17.619745743 (9h25m39.363802611s) [upload=9800]: Done starting upload Aug 7 19:05:17.619869361 (9h25m39.363926211s) [upload=9800]: Uploading segments... Aug 7 19:05:17.619924192 (9h25m39.363981059s) [upload=9800]: Got next segment. Inline: true Aug 7 19:05:17.619930169 (9h25m39.363987028s) [upload=9800]: Waiting for error group managing segments... Aug 7 19:05:17.619975137 (9h25m39.364032s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:05:17.619980654 (9h25m39.364037515s) [upload=9800]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:05:17.619995426 (9h25m39.364052287s) [upload=9800]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:05:17.779572263 (9h25m39.523629116s) [upload=9800]: Done uploading segments... Aug 7 19:05:17.779591536 (9h25m39.523648384s) [upload=9800]: Upload finished. err: <nil> Aug 7 19:06:15.198208132 (9h26m36.942264978s) [upload=9819]: Starting upload Aug 7 19:06:15.198269413 (9h26m36.942326272s) [upload=9819]: Done starting upload Aug 7 19:06:15.198346490 (9h26m36.942403336s) [upload=9819]: Uploading segments... Aug 7 19:06:15.198403435 (9h26m36.942460296s) [upload=9819]: Got next segment. Inline: true Aug 7 19:06:15.198408451 (9h26m36.942465311s) [upload=9819]: Waiting for error group managing segments... Aug 7 19:06:15.198452992 (9h26m36.942509852s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:15.198457918 (9h26m36.942514765s) [upload=9819]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:15.198460882 (9h26m36.942517741s) [upload=9819]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:15.581561529 (9h26m37.325618379s) [upload=9819]: Done uploading segments... Aug 7 19:06:15.581577379 (9h26m37.32563423s) [upload=9819]: Upload finished. err: <nil> Aug 7 19:06:38.105240543 (9h26m59.849297405s) [upload=9823]: Starting upload Aug 7 19:06:38.105321835 (9h26m59.849378696s) [upload=9823]: Done starting upload Aug 7 19:06:38.105455592 (9h26m59.849512452s) [upload=9823]: Uploading segments... Aug 7 19:06:38.105505131 (9h26m59.849561998s) [upload=9823]: Got next segment. Inline: true Aug 7 19:06:38.105522842 (9h26m59.849579703s) [upload=9823]: Waiting for error group managing segments... Aug 7 19:06:38.105574635 (9h26m59.849631499s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:06:38.105583027 (9h26m59.849639888s) [upload=9823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:06:38.105586137 (9h26m59.849642998s) [upload=9823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:06:38.260615172 (9h27m0.004672023s) [upload=9823]: Done uploading segments... Aug 7 19:06:38.260633551 (9h27m0.004690401s) [upload=9823]: Upload finished. err: <nil> Aug 7 19:07:34.212478353 (9h27m55.956535213s) [upload=9838]: Starting upload Aug 7 19:07:34.212549195 (9h27m55.956606045s) [upload=9838]: Done starting upload Aug 7 19:07:34.212636602 (9h27m55.956693449s) [upload=9838]: Uploading segments... Aug 7 19:07:34.212708257 (9h27m55.956765125s) [upload=9838]: Got next segment. Inline: true Aug 7 19:07:34.212714181 (9h27m55.956771027s) [upload=9838]: Waiting for error group managing segments... Aug 7 19:07:34.212768635 (9h27m55.956825481s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:07:34.212773862 (9h27m55.956830708s) [upload=9838]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:07:34.212777415 (9h27m55.956834267s) [upload=9838]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:07:34.594752280 (9h27m56.338809128s) [upload=9838]: Done uploading segments... Aug 7 19:07:34.594772728 (9h27m56.338829574s) [upload=9838]: Upload finished. err: <nil> Aug 7 19:08:12.316876923 (9h28m34.060933773s) [upload=9849]: Starting upload Aug 7 19:08:12.316923469 (9h28m34.060980352s) [upload=9849]: Done starting upload Aug 7 19:08:12.317062632 (9h28m34.061119493s) [upload=9849]: Uploading segments... Aug 7 19:08:12.317145418 (9h28m34.061202287s) [upload=9849]: Got next segment. Inline: true Aug 7 19:08:12.317151800 (9h28m34.061208669s) [upload=9849]: Waiting for error group managing segments... Aug 7 19:08:12.317222097 (9h28m34.061278947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:08:12.317228095 (9h28m34.061284947s) [upload=9849]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:08:12.317231495 (9h28m34.061288346s) [upload=9849]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:08:12.552296539 (9h28m34.296353405s) [upload=9849]: Done uploading segments... Aug 7 19:08:12.552318094 (9h28m34.296374962s) [upload=9849]: Upload finished. err: <nil> Aug 7 19:09:00.288462186 (9h29m22.032519047s) [upload=9862]: Starting upload Aug 7 19:09:00.288546170 (9h29m22.032603023s) [upload=9862]: Done starting upload Aug 7 19:09:00.288694527 (9h29m22.032751379s) [upload=9862]: Uploading segments... Aug 7 19:09:00.288764157 (9h29m22.032821026s) [upload=9862]: Got next segment. Inline: true Aug 7 19:09:00.288770396 (9h29m22.032827246s) [upload=9862]: Waiting for error group managing segments... Aug 7 19:09:00.288829073 (9h29m22.032885933s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:09:00.288834577 (9h29m22.032891427s) [upload=9862]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:09:00.288838481 (9h29m22.032895334s) [upload=9862]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:09:00.605235753 (9h29m22.349292624s) [upload=9862]: Done uploading segments... Aug 7 19:09:00.605260438 (9h29m22.349317299s) [upload=9862]: Upload finished. err: <nil> Aug 7 19:10:03.355717078 (9h30m25.09977395s) [upload=9881]: Starting upload Aug 7 19:10:03.355782200 (9h30m25.099839072s) [upload=9881]: Done starting upload Aug 7 19:10:03.355863865 (9h30m25.099920713s) [upload=9881]: Uploading segments... Aug 7 19:10:03.355927692 (9h30m25.099984566s) [upload=9881]: Got next segment. Inline: true Aug 7 19:10:03.355935087 (9h30m25.099991959s) [upload=9881]: Waiting for error group managing segments... Aug 7 19:10:03.355993433 (9h30m25.100050298s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:03.356000409 (9h30m25.100057284s) [upload=9881]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:03.356004763 (9h30m25.100061631s) [upload=9881]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:03.511491703 (9h30m25.255548588s) [upload=9881]: Done uploading segments... Aug 7 19:10:03.511515336 (9h30m25.255572185s) [upload=9881]: Upload finished. err: <nil> Aug 7 19:10:45.542891580 (9h31m7.286948459s) [upload=9891]: Starting upload Aug 7 19:10:45.543022259 (9h31m7.287079105s) [upload=9891]: Done starting upload Aug 7 19:10:45.543159168 (9h31m7.287216023s) [upload=9891]: Uploading segments... Aug 7 19:10:45.543223892 (9h31m7.287280761s) [upload=9891]: Got next segment. Inline: true Aug 7 19:10:45.543230252 (9h31m7.287287112s) [upload=9891]: Waiting for error group managing segments... Aug 7 19:10:45.543273513 (9h31m7.287330373s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:10:45.543278403 (9h31m7.287335263s) [upload=9891]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:10:45.543281040 (9h31m7.287337901s) [upload=9891]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:10:45.690506496 (9h31m7.434563365s) [upload=9891]: Done uploading segments... Aug 7 19:10:45.690531382 (9h31m7.434588246s) [upload=9891]: Upload finished. err: <nil> Aug 7 19:11:30.302656393 (9h31m52.046713254s) [upload=9905]: Starting upload Aug 7 19:11:30.302732650 (9h31m52.046789514s) [upload=9905]: Done starting upload Aug 7 19:11:30.302821610 (9h31m52.046878459s) [upload=9905]: Uploading segments... Aug 7 19:11:30.302875752 (9h31m52.046932612s) [upload=9905]: Got next segment. Inline: true Aug 7 19:11:30.302881300 (9h31m52.04693815s) [upload=9905]: Waiting for error group managing segments... Aug 7 19:11:30.302927713 (9h31m52.046984563s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 19:11:30.302932995 (9h31m52.046989854s) [upload=9905]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 19:11:30.302936635 (9h31m52.046993494s) [upload=9905]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:11:31.288042132 (9h31m53.032098982s) [upload=9905]: Done uploading segments... Aug 7 19:11:31.288060929 (9h31m53.032117779s) [upload=9905]: Upload finished. err: <nil> Duration:* 994.790714ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)