Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X..............X............................] duration: 2.639554713s FAIL (2025-08-11 19:07:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.639588298s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X.......X...X...............................] duration: 861.806684ms FAIL (2025-08-11 19:07:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 861.90147ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X.......X...X..............................] duration: 896.412184ms FAIL (2025-08-11 19:06:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 896.443845ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X..............X...........................] duration: 2.414839561s FAIL (2025-08-11 19:06:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.414932392s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X.......X...X.............................] duration: 851.542838ms FAIL (2025-08-11 19:05:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 851.575927ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X..............X..........................] duration: 2.806316427s FAIL (2025-08-11 19:05:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.806351682s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X.......X...X............................] duration: 1.000062872s FAIL (2025-08-11 19:05:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.000171018s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X..............X.........................] duration: 2.321982691s FAIL (2025-08-11 19:04:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.32201812s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X.......X...X...........................] duration: 874.367417ms FAIL (2025-08-11 19:03:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 874.403053ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X..............X........................] duration: 2.46942695s FAIL (2025-08-11 19:03:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.469465492s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X.......X...X..........................] duration: 909.444253ms FAIL (2025-08-11 19:03:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 909.479674ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..............X.......................] duration: 2.942545664s FAIL (2025-08-11 19:02:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.942574049s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X..............X......................] duration: 2.457123509s FAIL (2025-08-11 19:02:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.457224316s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X.......X...X.........................] duration: 894.683817ms FAIL (2025-08-11 19:02:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 894.717968ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..............X.....................] duration: 2.386312632s FAIL (2025-08-11 19:01:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.386406013s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................X.......X...X........................] duration: 937.27885ms FAIL (2025-08-11 19:01:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 937.331881ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................X.......X...X.......................] duration: 859.893961ms FAIL (2025-08-11 19:01:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 859.958703ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X..............X....................] duration: 2.441466725s FAIL (2025-08-11 19:00:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.441550248s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................X.......X...X......................] duration: 847.23927ms FAIL (2025-08-11 19:00:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 847.506359ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..............X...................] duration: 2.455498965s FAIL (2025-08-11 19:00:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.455603105s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..............X..................] duration: 2.526274396s FAIL (2025-08-11 18:59:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.526311726s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.......X...X.....................] duration: 899.675904ms FAIL (2025-08-11 18:59:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 899.710805ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.......X...X....................] duration: 845.6709ms FAIL (2025-08-11 18:59:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 845.7501ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..............X.................] duration: 2.397086509s FAIL (2025-08-11 18:58:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.397116813s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X..............X................] duration: 2.81650144s FAIL (2025-08-11 18:58:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.816550203s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................X.......X...X...................] duration: 909.842714ms FAIL (2025-08-11 18:58:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 909.883069ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.......X...X..................] duration: 1.131487951s FAIL (2025-08-11 18:57:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.131535429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..............X...............] duration: 2.975663307s FAIL (2025-08-11 18:57:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.975691192s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.......X...X.................] duration: 947.835829ms FAIL (2025-08-11 18:56:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 947.887296ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..............X..............] duration: 2.621050949s FAIL (2025-08-11 18:56:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.621083982s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.......X...X................] duration: 969.441906ms FAIL (2025-08-11 18:55:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 969.524709ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..............X.............] duration: 2.615477331s FAIL (2025-08-11 18:55:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.615509905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.......X...X...............] duration: 868.543274ms FAIL (2025-08-11 18:54:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 868.574674ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [X...............................X..............X............] duration: 2.835710741s FAIL (2025-08-11 18:54:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.835744322s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.......X...X..............] duration: 934.984397ms FAIL (2025-08-11 18:54:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 935.073433ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.......X...X.............] duration: 1.350487436s FAIL (2025-08-11 18:53:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.350519572s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X...............................X..............X...........] duration: 2.626071534s FAIL (2025-08-11 18:53:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.626114547s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.......X...X............] duration: 1.201591417s FAIL (2025-08-11 18:53:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.20163978s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..X...............................X..............X..........] duration: 2.933347248s FAIL (2025-08-11 18:52:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.933381794s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.......X...X...........] duration: 969.88326ms FAIL (2025-08-11 18:52:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 969.90953ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...X...............................X..............X.........] duration: 2.460412547s FAIL (2025-08-11 18:51:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.46044155s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.......X...X..........] duration: 1.175855302s FAIL (2025-08-11 18:51:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.175964335s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....X...............................X..............X........] duration: 2.695195506s FAIL (2025-08-11 18:51:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.695263198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.......X...X.........] duration: 1.222871762s FAIL (2025-08-11 18:50:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.222906593s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....X...............................X..............X.......] duration: 2.771853154s FAIL (2025-08-11 18:49:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.77188793s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.......X...X........] duration: 1.01077715s FAIL (2025-08-11 18:49:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.010815828s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......X...............................X..............X......] duration: 2.45217029s FAIL (2025-08-11 18:48:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.452204372s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......X...............................X..............X.....] duration: 2.390288363s FAIL (2025-08-11 18:47:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.390354121s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.......X...X.......] duration: 948.804315ms FAIL (2025-08-11 18:47:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 18:42:35.340708534 (73h16m57.299805779s) [upload=76388]: Starting upload Aug 11 18:42:35.340800940 (73h16m57.299898185s) [upload=76388]: Done starting upload Aug 11 18:42:35.340882389 (73h16m57.299979625s) [upload=76388]: Uploading segments... Aug 11 18:42:35.340937182 (73h16m57.300034434s) [upload=76388]: Got next segment. Inline: true Aug 11 18:42:35.340942485 (73h16m57.300039733s) [upload=76388]: Waiting for error group managing segments... Aug 11 18:42:35.340992831 (73h16m57.300090106s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:42:35.340999893 (73h16m57.300097139s) [upload=76388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 18:42:35.341003659 (73h16m57.300100908s) [upload=76388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:42:35.463565937 (73h16m57.422663195s) [upload=76388]: Done uploading segments... Aug 11 18:42:35.463593149 (73h16m57.422690404s) [upload=76388]: Upload finished. err: metaclient: Too Many Requests Duration:* 948.833729ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........X...............................X..............X....] duration: 2.762461285s FAIL (2025-08-11 18:47:41 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 05ae364f1757c5192f4e7284a422665de0877bd77418f684b106a2930ec378f3 != before af3b002b8e58e25a20fa6268ebf19145031a78e6166d72c938dd8aa59f1be3b8 ======LOGS====== Aug 11 18:44:23.458630246 (73h18m45.417727498s) [upload=76418]: Starting upload Aug 11 18:44:23.458692703 (73h18m45.417789957s) [upload=76418]: Done starting upload Aug 11 18:44:23.458843657 (73h18m45.417940905s) [upload=76418]: Uploading segments... Aug 11 18:44:23.459013098 (73h18m45.418110346s) [upload=76418]: Got next segment. Inline: false Aug 11 18:44:23.459066253 (73h18m45.418163504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 18:44:23.459076308 (73h18m45.418173555s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 18:44:23.669865765 (73h18m45.628963014s) [seg_pos={0 0}, upload=76418]: Begin upload segment... Aug 11 18:44:23.669981710 (73h18m45.62907908s) [seg_pos={0 0}, upload=76418]: Done begin upload segment. Aug 11 18:44:23.670047110 (73h18m45.629144364s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670075599 (73h18m45.629172851s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670545749 (73h18m45.629642987s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.670559479 (73h18m45.629656732s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671007370 (73h18m45.630104625s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671084855 (73h18m45.630182112s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671452396 (73h18m45.630549645s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671576337 (73h18m45.630673594s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.671881051 (73h18m45.630978305s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672328338 (73h18m45.631425595s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672544058 (73h18m45.631641312s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672822848 (73h18m45.631920104s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.672862288 (73h18m45.631959535s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673373368 (73h18m45.632470627s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.673897286 (73h18m45.632994524s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674412486 (73h18m45.633509739s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.674778792 (73h18m45.633876028s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:23.675272318 (73h18m45.634369568s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Uploading piece... Aug 11 18:44:24.247965659 (73h18m46.207062919s) [upload=76418]: Next returned nil segment Aug 11 18:44:24.247991446 (73h18m46.207088705s) [upload=76418]: Waiting for error group managing segments... Aug 11 18:44:24.415712766 (73h18m46.374810016s) [noise=true , address=104.36.82.43:4841 , piece_id=7ABI4WHUDFHOTOAN6WE7JEH5CF2LRUWWQBKGJ44QP2GMGX3IV3SA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.423515213 (73h18m46.38261246s) [noise=true , address=104.36.82.8:4982 , piece_id=MBVFA7SKX4EVO7IV355A7XPJSV3JFFY5GLKDWXQYNQOYSFK6EECA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.432671413 (73h18m46.39176865s) [noise=true , address=104.36.82.36:4640 , piece_id=RAM2D4254VTM6PPU6Q6N2I3GN7ZGNUWUWAFKWJO7D7I5GHEHM5JA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.437616403 (73h18m46.396713651s) [noise=true , address=104.36.82.38:4703 , piece_id=KL2WNV3TOE6XRGVH5DXHMDJXVHFOMZXESBPIQ2MGR2LBNHJWARCQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.440963153 (73h18m46.400060393s) [noise=true , address=104.36.82.18:4390 , piece_id=RRIX7JIZHOLXFFKKI5R6X6BFPIEAMUA3PHYQZLYAZM2ZDWQLH6UQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.444770105 (73h18m46.403867358s) [noise=true , address=104.36.82.46:4484 , piece_id=V2ADRIMH7EP5UJSSY3YBHFLRNE2SI3SMZVNSWL5TNZK3TXZ53AQA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448074676 (73h18m46.407171912s) [noise=true , address=104.36.82.59:4301 , piece_id=WIY5C4GXUA4B2U26IRH3RYQJGE5PHWIWRUMVJWJ6YIJF5QQVEO7A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.448894420 (73h18m46.40799166s) [noise=true , address=104.36.82.62:4444 , piece_id=BKOPKNHPNWM5LBSUH3FO6VJLET5EQVRUEYK3D6N6ZLZJUPCZ6HNQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.449077235 (73h18m46.408174474s) [noise=true , address=104.36.82.19:4417 , piece_id=ZLA2IZVHSKJTBGEXBEGYRFQFPLU22ETX4CWKQCWCM3KKQXGMMEGQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.458811831 (73h18m46.417909087s) [noise=true , address=104.36.82.23:4447 , piece_id=545IHJKEF7NRW6EBXJIDPNDKR7Z5KWNMAY4XBTTP22LX5OIIKPPA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.471782430 (73h18m46.43087968s) [noise=true , address=104.36.82.15:4272 , piece_id=WDTEKJHTATHCDQU4UXZSHIEX636AKJZRVBCHTS2XZZATARBZFDIQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.478987777 (73h18m46.438085027s) [noise=true , address=104.36.82.56:4256 , piece_id=U3I3ZT7CPPSJ2CHGQMW7BBM2MGRMPKRDBNNKKMTVWPY6ZQ3MJDJA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.659491261 (73h18m46.618588515s) [noise=true , address=79.127.201.215:4356 , piece_id=LHGVFGKDYYVY4MYZMICKWEWWPTKYZ5BUVOIMKI4XNGWKV26RKFFQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665900034 (73h18m46.624997298s) [noise=true , address=104.36.82.37:4658 , piece_id=BJ322QL2MQZL6M2C677Q36SJH5PE2BTTBRF76ZJRXKMUYPEIJEJQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: <nil> Aug 11 18:44:24.665974498 (73h18m46.625071747s) [seg_pos={0 0}, upload=76418]: Segment reached optimal threshold of 14 pieces. Aug 11 18:44:24.666279169 (73h18m46.625376424s) [noise=true , address=79.127.201.215:4346 , piece_id=HSZFDUQFACRIHOZWCXCHQMTLLIIJRMMHVWUGZ64WTB76AJXD6IOA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666307148 (73h18m46.625404407s) [noise=true , address=79.127.201.214:4298 , piece_id=BYPYUS7ZWSONDCQCM7T2AMCWTKAYJ6ZHMIFCHKQ7RXVQEWKAB3GQ, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666443627 (73h18m46.625540866s) [noise=true , address=64.49.13.139:4478 , piece_id=4BUJJWME3UQQO7ZBDWRIT7F4CIIHUANUUJ35XWC73A3KHZJBXV6A, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kmGWoxQSmnEF7KAt2JqGDcmwTYnu82wpaCQUFaBAYUshTY98J): protocol: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39444->64.49.13.139:4478: use of closed network connection Aug 11 18:44:24.666461338 (73h18m46.625558581s) [noise=true , address=64.49.13.26:4954 , piece_id=5IGJIQ6UXRG7L556GLZ53E5XNTZR34LTOWID3TOHFXIFUSWI44CA, seg_pos={0 0}, upload=76418]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uBxL7Gg8kYxEpqfa8jkyG7CJKtx8zYD5vcWveLB7cRrb2UpAo): protocol: expected piece hash; context canceled; EOF Aug 11 18:44:24.666480153 (73h18m46.625577405s) [seg_pos={0 0}, upload=76418]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 18:44:24.666586238 (73h18m46.625683474s) [upload=76418]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 18:44:24.666592266 (73h18m46.625689504s) [upload=76418]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 18:44:25.080076190 (73h18m47.039173462s) [upload=76418]: Done uploading segments... Aug 11 18:44:25.080120819 (73h18m47.039218057s) [upload=76418]: Upload finished. err: <nil> Duration: 2.762516898s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)