Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.023825537s FAIL (2025-08-12 05:17:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.02394225s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X..X...............X...] duration: 2.362456503s FAIL (2025-08-12 05:17:47 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.362487594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.03523088s FAIL (2025-08-12 05:17:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.035256552s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 911.726916ms FAIL (2025-08-12 05:17:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 911.761483ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.221304318s FAIL (2025-08-12 05:16:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.221348733s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X..X...............X..] duration: 2.433211164s FAIL (2025-08-12 05:16:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.433243523s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.107898117s FAIL (2025-08-12 05:16:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.107930877s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X........X..................................................] duration: 830.857911ms FAIL (2025-08-12 05:15:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 830.902558ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.008873506s FAIL (2025-08-12 05:15:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.008897772s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X........X.................................................] duration: 846.654506ms FAIL (2025-08-12 05:15:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 846.68729ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X..X...............X.] duration: 2.544975283s FAIL (2025-08-12 05:15:32 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 2.545005714s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X..X...............X] duration: 1.952648466s FAIL (2025-08-12 05:15:16 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 12 05:15:14.765201145 (83h49m36.724298394s) [upload=87377]: Starting upload Aug 12 05:15:14.765261008 (83h49m36.724358245s) [upload=87377]: Done starting upload Aug 12 05:15:14.765556777 (83h49m36.724654016s) [upload=87377]: Uploading segments... Aug 12 05:15:14.765609758 (83h49m36.724707004s) [upload=87377]: Got next segment. Inline: false Aug 12 05:15:14.765642470 (83h49m36.724739716s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:15:14.765647629 (83h49m36.724744874s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:15:15.008461169 (83h49m36.967558416s) [seg_pos={0 0}, upload=87377]: Begin upload segment... Aug 12 05:15:15.008523008 (83h49m36.967620246s) [seg_pos={0 0}, upload=87377]: Done begin upload segment. Aug 12 05:15:15.008551721 (83h49m36.967648968s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009081351 (83h49m36.968178601s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009478080 (83h49m36.968575329s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.009866294 (83h49m36.968963541s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010031676 (83h49m36.969128911s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010408549 (83h49m36.969505805s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010438898 (83h49m36.969536151s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.010826710 (83h49m36.969923968s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011379600 (83h49m36.970476861s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.011769478 (83h49m36.970866735s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012166179 (83h49m36.971263435s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012566398 (83h49m36.971663647s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.012990952 (83h49m36.972088208s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013398917 (83h49m36.972496164s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.013882184 (83h49m36.972979444s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.014469659 (83h49m36.973566915s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.015115578 (83h49m36.974212839s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.016195928 (83h49m36.975293185s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Uploading piece... Aug 12 05:15:15.594466799 (83h49m37.553564039s) [upload=87377]: Next returned nil segment Aug 12 05:15:15.594498135 (83h49m37.553595385s) [upload=87377]: Waiting for error group managing segments... Aug 12 05:15:15.758510182 (83h49m37.717607439s) [noise=true , address=104.36.82.43:4866 , piece_id=XBFHFY6ZQWM4JJOMGGSNXIRR6T6HQI5U6TKEE2S72QDIV5BXR7QA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.759996371 (83h49m37.719093603s) [noise=true , address=104.36.82.47:4517 , piece_id=2MLIFUOKFY2U6TXQ4AQNJSMGMIGIH5DDPE7NSLQSVOHVSQ5MX5TQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.761754613 (83h49m37.720851844s) [noise=true , address=104.36.82.23:4466 , piece_id=GUESULVXPFVJ2SFSZAXNXYV5G5H2DRIIGZLY7NHK4PZMRFFDEGGA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762083107 (83h49m37.721180358s) [noise=true , address=104.36.82.3:4791 , piece_id=CEAU4CXJEFXTADDZ4H7FYUFTGPY42WYWYV5ULVCAQVOGPLZ3OUSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.762618509 (83h49m37.721715744s) [noise=true , address=104.36.82.5:4850 , piece_id=AF6HRJQFS6W6CX3XNZGQHQPBCLEGYFWIMQIVDXQIMFUG4QKKTVSQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.764112211 (83h49m37.723209457s) [noise=true , address=104.36.82.17:4354 , piece_id=K25REE5UUPY4HKQ2MYPW4FRDLPEW3SMSUC2BCRLPJ2AWDDFBYQ2A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.768470522 (83h49m37.727567762s) [noise=true , address=104.36.82.34:4554 , piece_id=AK5WV6AXSZN7N6FGE4TQXEV3S3S4TM3Z4KZU3SYQYBMQXOAXPKBA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.769095025 (83h49m37.728192258s) [noise=true , address=104.36.82.37:4666 , piece_id=EW2GPULKR4IN5XBS7HRHDJB6D7FHEUZ4GCZUAFFMY2W2DAFNIE3Q, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.778074128 (83h49m37.737171378s) [noise=true , address=104.36.82.2:4757 , piece_id=RRI4P7CCDNZWODMYSO3FSLUCH7QLIWIPUEKKED2YK6S4BFBU6QLA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.779941807 (83h49m37.739039044s) [noise=true , address=104.36.82.46:4499 , piece_id=5KW7CWDT2L6KM4P6L4DRLQPXFMUK7QT7N4CQK7SMY6STLVRGC7TA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.857956843 (83h49m37.817054077s) [noise=true , address=104.36.82.58:4272 , piece_id=WZQXVXCSFNDFDZI3RG44TASENWFZEV4BWUQ2C5WPERYTHYRJECJQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.877887462 (83h49m37.836984698s) [noise=true , address=104.36.82.44:4878 , piece_id=YU3S4X2ZF737AQUJGZCZ3AUXX4434U2VKCQ2LZHVYVC6Y3JGSJQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:15.953371490 (83h49m37.912468721s) [noise=true , address=79.127.220.97:4395 , piece_id=OYGXUBUOAN54IUZRAUAEL2FCDV53QRZJD4OVGNVYXI5VA4SCFJGQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083365888 (83h49m38.042463134s) [noise=true , address=79.127.201.215:4358 , piece_id=6HZPEC6HWHLU3JLYX5OLYHQLMLCLD4DXDW4QWFGGAVVXLK6PI36A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: <nil> Aug 12 05:15:16.083432859 (83h49m38.042530106s) [seg_pos={0 0}, upload=87377]: Segment reached optimal threshold of 14 pieces. Aug 12 05:15:16.083653356 (83h49m38.042750595s) [noise=true , address=64.49.13.169:4716 , piece_id=TCFM2WPHN3Q4LFE3SKZPLD3ELRUX2DEZXIPE5S6XAS23FISIPMKQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w21xeA7emhjphgYw2Qyz3uuHgPezuivmVD9KmrKmNZk3TnaGN): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083759345 (83h49m38.042856599s) [noise=true , address=64.49.13.26:4946 , piece_id=47UHTHXMZBTYUZ7YFERYSCTPPGESL2RB33SLOH6CVCIXRCJPJIFA, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hdE48UnygY1dCRASR39FkumY2V8f5Xb68Pd1WJ4AMLUnnGAfT): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083884347 (83h49m38.042981595s) [noise=true , address=64.49.13.26:4951 , piece_id=XH2UFL66DQJLNAJLC6AQMAYFVXARSPMUCRHG4KE24ZUFMY3MBIQQ, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083976156 (83h49m38.04307341s) [noise=true , address=64.49.13.137:4500 , piece_id=USPLYKAN5YW5XUU57G7PELKFA4RWEHIXBLJLDUUM55EOOYLXKQ5A, seg_pos={0 0}, upload=87377]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9): protocol: expected piece hash; context canceled; EOF Aug 12 05:15:16.083995722 (83h49m38.04309297s) [seg_pos={0 0}, upload=87377]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:15:16.084123218 (83h49m38.043220468s) [upload=87377]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:15:16.084130332 (83h49m38.04322758s) [upload=87377]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:15:16.238830716 (83h49m38.197927962s) [upload=87377]: Done uploading segments... Aug 12 05:15:16.238863563 (83h49m38.197960802s) [upload=87377]: Upload finished. err: <nil> Duration: 1.952852401s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.11822009s FAIL (2025-08-12 05:15:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.118248564s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.062692239s FAIL (2025-08-12 05:14:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.062717361s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X........X................................................] duration: 1.030875953s FAIL (2025-08-12 05:14:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.030913666s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..X...............] duration: 2.361713613s FAIL (2025-08-12 05:14:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.361744884s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.114911757s FAIL (2025-08-12 05:14:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.11494726s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X........X...............................................] duration: 828.457006ms FAIL (2025-08-12 05:13:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 828.506952ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..X..............] duration: 2.463692816s FAIL (2025-08-12 05:13:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.463797465s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X........X..............................................] duration: 871.669718ms FAIL (2025-08-12 05:13:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 871.701371ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.103742665s FAIL (2025-08-12 05:13:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.103764328s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X........X.............................................] duration: 866.85814ms FAIL (2025-08-12 05:12:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 866.888208ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..X.............] duration: 2.398604571s FAIL (2025-08-12 05:12:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.39863404s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..X............] duration: 2.428553333s FAIL (2025-08-12 05:12:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.428592839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.118946122s FAIL (2025-08-12 05:12:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.119030954s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001279792s FAIL (2025-08-12 05:12:25 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001302867s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X........X............................................] duration: 841.439022ms FAIL (2025-08-12 05:11:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 841.474976ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X..X...........] duration: 2.362094495s FAIL (2025-08-12 05:11:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.362127049s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X..X..........] duration: 2.313191476s FAIL (2025-08-12 05:10:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.313230299s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X........X...........................................] duration: 825.230445ms FAIL (2025-08-12 05:10:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 825.274362ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X..X.........] duration: 2.243333181s FAIL (2025-08-12 05:09:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.243368732s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X........X..........................................] duration: 861.235109ms FAIL (2025-08-12 05:09:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.27676ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X..X........] duration: 2.38973285s FAIL (2025-08-12 05:09:08 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.389794539s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X........X.........................................] duration: 971.033125ms FAIL (2025-08-12 05:08:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 971.076076ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X........X........................................] duration: 925.337747ms FAIL (2025-08-12 05:08:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 925.374729ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X..X.......] duration: 2.542246826s FAIL (2025-08-12 05:08:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.542318941s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X........X.......................................] duration: 1.065286904s FAIL (2025-08-12 05:07:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.06539321s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X..X......] duration: 2.448089373s FAIL (2025-08-12 05:07:04 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.448209621s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X........X......................................] duration: 922.469979ms FAIL (2025-08-12 05:06:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 922.500563ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X..X.....] duration: 2.612120102s FAIL (2025-08-12 05:06:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.612147718s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration: 864.204476ms FAIL (2025-08-12 05:06:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 864.239648ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X..X....] duration: 2.354231476s FAIL (2025-08-12 05:05:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.354261059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X........X....................................] duration: 871.146562ms FAIL (2025-08-12 05:05:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 871.194554ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X..X...] duration: 2.477465938s FAIL (2025-08-12 05:05:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.477502885s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X..X..] duration: 2.395274004s FAIL (2025-08-12 05:04:47 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.395334906s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X........X...................................] duration: 915.484612ms FAIL (2025-08-12 05:04:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 915.511084ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration: 2.340457996s FAIL (2025-08-12 05:04:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.340555627s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X........X..................................] duration: 1.252447108s FAIL (2025-08-12 05:03:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.252482171s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X........X.................................] duration: 846.858993ms FAIL (2025-08-12 05:03:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 04:39:23.903585024 (83h13m45.86268229s) [upload=86746]: Starting upload Aug 12 04:39:23.903673754 (83h13m45.862771017s) [upload=86746]: Done starting upload Aug 12 04:39:23.903776137 (83h13m45.862873368s) [upload=86746]: Uploading segments... Aug 12 04:39:23.903848491 (83h13m45.862945745s) [upload=86746]: Got next segment. Inline: true Aug 12 04:39:23.903855091 (83h13m45.862952337s) [upload=86746]: Waiting for error group managing segments... Aug 12 04:39:23.903932386 (83h13m45.863029638s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 04:39:23.903938996 (83h13m45.863036245s) [upload=86746]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 12 04:39:23.903955874 (83h13m45.86305312s) [upload=86746]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 04:39:23.991902958 (83h13m45.951000232s) [upload=86746]: Done uploading segments... Aug 12 04:39:23.991923469 (83h13m45.951020715s) [upload=86746]: Upload finished. err: metaclient: Too Many Requests Duration:* 846.933673ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 2.271177415s FAIL (2025-08-12 05:03:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b73f785877f0fab5e83663a77a085ec9eb72f9dd46c2a0f5ef0c5b752ca77563 != before a73bf79e6445f28a4ac25fbbf8501d51e111897e075feb14bf6d65b2d5929d91 ======LOGS====== Aug 12 05:03:07.676243453 (83h37m29.635340701s) [upload=87160]: Starting upload Aug 12 05:03:07.676343089 (83h37m29.635440339s) [upload=87160]: Done starting upload Aug 12 05:03:07.676586387 (83h37m29.635683621s) [upload=87160]: Uploading segments... Aug 12 05:03:07.676863765 (83h37m29.635960997s) [upload=87160]: Got next segment. Inline: false Aug 12 05:03:07.676935218 (83h37m29.636032465s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 12 05:03:07.676940840 (83h37m29.636038086s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 12 05:03:07.876733275 (83h37m29.835830557s) [seg_pos={0 0}, upload=87160]: Begin upload segment... Aug 12 05:03:07.876814088 (83h37m29.835911338s) [seg_pos={0 0}, upload=87160]: Done begin upload segment. Aug 12 05:03:07.876861505 (83h37m29.83595876s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877044547 (83h37m29.836141802s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.877518813 (83h37m29.836616066s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878114269 (83h37m29.837211548s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878369312 (83h37m29.837466557s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878636969 (83h37m29.837734223s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.878756756 (83h37m29.837854006s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879458998 (83h37m29.838556237s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879507437 (83h37m29.838604692s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.879887795 (83h37m29.838985048s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880007558 (83h37m29.839104807s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880262049 (83h37m29.839359319s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.880447183 (83h37m29.839544429s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881596310 (83h37m29.840693564s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.881821878 (83h37m29.840919132s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882306192 (83h37m29.841403443s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.882413162 (83h37m29.841510417s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:07.883605776 (83h37m29.842703028s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Uploading piece... Aug 12 05:03:08.430687701 (83h37m30.389784958s) [upload=87160]: Next returned nil segment Aug 12 05:03:08.430712016 (83h37m30.389809271s) [upload=87160]: Waiting for error group managing segments... Aug 12 05:03:08.608835900 (83h37m30.567933151s) [noise=true , address=104.36.82.47:4527 , piece_id=RY57GF2R7A7ZGXSOUUCAKPKYTYBFYC4LACDSFCEC645NUY4FHOZQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.610643192 (83h37m30.569740432s) [noise=true , address=104.36.82.8:4979 , piece_id=GLVLEPTPKLPJGGSMEIPEUJO6KAFSV2GTR53TBCYTMHWADOP6UPSA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.612212310 (83h37m30.571309567s) [noise=true , address=104.36.82.45:4912 , piece_id=M3TR66XGWSKACIPDQMRAQUNUEOPAY5KENMF6AFTLMH2BB2EUVIYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.617592528 (83h37m30.576689761s) [noise=true , address=104.36.82.16:4317 , piece_id=A7YOBVNQAE7MZLUEZ6UNWMYYIKU4KXRRU7U54ZAGYNIUWVZOHQ5A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619600713 (83h37m30.578697952s) [noise=true , address=104.36.82.5:4849 , piece_id=FUQ5VXZ7GKQNCBLMMNKFL4N6E4KJYPJCS5A7NXD3MLTZKE52COYQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.619761639 (83h37m30.578858889s) [noise=true , address=104.36.82.34:4579 , piece_id=RYDVSET4GSVUZUD3BF2IGUBMBEPHGTB6KYIRDZ3BEKUDVXQH7DIQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.620753273 (83h37m30.579850511s) [noise=true , address=104.36.82.59:4333 , piece_id=U5LRQUTUSOWP4MFOBOWIMF3GB5DJ3DH35WQ42AT2PUL6HWKYJXYA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.626147588 (83h37m30.585244841s) [noise=true , address=104.36.82.17:4329 , piece_id=ZJOMWH2MIFYLJQ4QXEGRVA5YWIKODIRLIEYTSL52QVPPVNL54FKA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.627140863 (83h37m30.586238094s) [noise=true , address=104.36.82.21:4477 , piece_id=TNHNEZAE6UE6PF3QJNPB6XV3TKNHHYXT2F5UULVPQOOWOOQAVUJA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.634176184 (83h37m30.593273442s) [noise=true , address=104.36.82.62:4442 , piece_id=MRQ6JVEAVPY3VY245KBEBI4UCJGVR5MZX7RUIXWRMBETZBXNTI3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.635586036 (83h37m30.594683284s) [noise=true , address=104.36.82.4:4836 , piece_id=BFRYZJEABDMTANETPPG6GBLC4OOMVS7F7OX63CEE7O3ICHD5DTGA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636470653 (83h37m30.595567906s) [noise=true , address=104.36.82.37:4671 , piece_id=WLI2IZLLTXZX7I6KQLJSJKVHV7DLVNZOBOYSWKJVQ33DNLP7AV3A, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.636740588 (83h37m30.595837835s) [noise=true , address=104.36.82.43:4854 , piece_id=ICQQ36P54RS2OSC3RXUTFFP727DH35Z4RNESROZ7E4KSOLZAVVFA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639541503 (83h37m30.598638763s) [noise=true , address=104.36.82.58:4287 , piece_id=5UUWTMCUEUZX4ILNLY2FTFR5V3EGAST6UDTIXMT4E2TEVYWEI6FA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: <nil> Aug 12 05:03:08.639588686 (83h37m30.598685932s) [seg_pos={0 0}, upload=87160]: Segment reached optimal threshold of 14 pieces. Aug 12 05:03:08.639844150 (83h37m30.598941405s) [noise=true , address=104.36.82.5:4855 , piece_id=EZAU3L3JOIZUAUV2BDMICZPBWCR3I6HVLBDV2ID2MHL7IZXNUF4Q, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KDNuE7YY8smhDjotushQvY3y9NtLxigbJELHD4Edxy8Qi4BWh): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640091890 (83h37m30.59918914s) [noise=true , address=104.36.82.36:4619 , piece_id=QDLNOFQH3HOEOYIPCODPR2CYJSZPAPT37ZJM3EFDOCVCDHYKBRCA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1zuLJznAUFHkanuomswSd7JN6CkqPXso8Ak8e5E57eaEqvjodU): protocol: expected piece hash; context canceled; EOF Aug 12 05:03:08.640389504 (83h37m30.59948676s) [noise=true , address=193.149.164.143:4693 , piece_id=GTJLQTIQEZD7DJE4SIXEFMVFSULGGQBBSJZCJ6RG6VVZ7RPJEQHA, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LHoCE9CnM32tbMNqAB7HpmArSVLTycv9o6kSSFNUJsoDeERkQ): protocol: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43764->193.149.164.143:4693: use of closed network connection Aug 12 05:03:08.640595061 (83h37m30.599692308s) [noise=true , address=64.49.13.26:4945 , piece_id=EIBZCC4S7V4I7FJ6B76O7ZEQGYHWL54EZOOMYDI3RALEW33GXYDQ, seg_pos={0 0}, upload=87160]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aPQ1AM7icmWJDhLQtS8pu3FCnun1peLjUdKZ7uBpAQ9yYrsYx): protocol: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33420->64.49.13.26:4945: use of closed network connection Aug 12 05:03:08.640617291 (83h37m30.599714543s) [seg_pos={0 0}, upload=87160]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 12 05:03:08.640762532 (83h37m30.599859787s) [upload=87160]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 12 05:03:08.640768646 (83h37m30.599865901s) [upload=87160]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 12 05:03:08.796145034 (83h37m30.755242307s) [upload=87160]: Done uploading segments... Aug 12 05:03:08.796170214 (83h37m30.755267466s) [upload=87160]: Upload finished. err: <nil> Duration: 2.271213114s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)