Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........X...............................X.........X......] duration: 941.631621ms FAIL (2025-08-07 16:52:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 941.658395ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.....X...X..............X...........X.....................] duration: 2.572902854s FAIL (2025-08-07 16:51:28 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.57294271s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............X...............................X.........X.....] duration: 912.998604ms FAIL (2025-08-07 16:51:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 913.0382ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.....X...X..............X...........X....................] duration: 2.535607093s FAIL (2025-08-07 16:50:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.535635621s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............X...............................X.........X....] duration: 917.938203ms FAIL (2025-08-07 16:50:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 917.975509ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.....X...X..............X...........X...................] duration: 2.539506568s FAIL (2025-08-07 16:49:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.539553416s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............X...............................X.........X...] duration: 1.238473619s FAIL (2025-08-07 16:49:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.238502092s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............X...............................X.........X..] duration: 865.727106ms FAIL (2025-08-07 16:49:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 865.752462ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.....X...X..............X...........X..................] duration: 2.538109207s FAIL (2025-08-07 16:48:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.538148532s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................X...............................X.........X.] duration: 1.298084615s FAIL (2025-08-07 16:48:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 1.298115378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.....X...X..............X...........X.................] duration: 3.021638414s FAIL (2025-08-07 16:48:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 3.021669797s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X...............................X.........X] duration: 967.101947ms FAIL (2025-08-07 16:47:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== jectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Aug 7 16:40:09.986981453 (7h0m31.731038303s) [upload=7287]: Starting upload Aug 7 16:40:09.987042593 (7h0m31.731099453s) [upload=7287]: Done starting upload Aug 7 16:40:09.987128146 (7h0m31.731185s) [upload=7287]: Uploading segments... Aug 7 16:40:09.987179983 (7h0m31.731236852s) [upload=7287]: Got next segment. Inline: true Aug 7 16:40:09.987185508 (7h0m31.731242368s) [upload=7287]: Waiting for error group managing segments... Aug 7 16:40:09.987241643 (7h0m31.731298506s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:40:09.987246936 (7h0m31.731303798s) [upload=7287]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:40:09.987250691 (7h0m31.731307552s) [upload=7287]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:40:10.276863749 (7h0m32.020920604s) [upload=7287]: Done uploading segments... Aug 7 16:40:10.276906272 (7h0m32.020963132s) [upload=7287]: Upload finished. err: <nil> Aug 7 16:41:05.823476036 (7h1m27.567532923s) [upload=7302]: Starting upload Aug 7 16:41:05.823630450 (7h1m27.567687301s) [upload=7302]: Done starting upload Aug 7 16:41:05.823715021 (7h1m27.567771883s) [upload=7302]: Uploading segments... Aug 7 16:41:05.823773008 (7h1m27.567829881s) [upload=7302]: Got next segment. Inline: true Aug 7 16:41:05.823779524 (7h1m27.567836391s) [upload=7302]: Waiting for error group managing segments... Aug 7 16:41:05.823830572 (7h1m27.567887438s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:05.823837003 (7h1m27.567893892s) [upload=7302]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:05.823841419 (7h1m27.567898286s) [upload=7302]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:06.000547675 (7h1m27.74460456s) [upload=7302]: Done uploading segments... Aug 7 16:41:06.000567170 (7h1m27.744624035s) [upload=7302]: Upload finished. err: <nil> Aug 7 16:41:54.826811756 (7h2m16.570868616s) [upload=7317]: Starting upload Aug 7 16:41:54.826875023 (7h2m16.570931884s) [upload=7317]: Done starting upload Aug 7 16:41:54.826940990 (7h2m16.57099784s) [upload=7317]: Uploading segments... Aug 7 16:41:54.826987758 (7h2m16.571044627s) [upload=7317]: Got next segment. Inline: true Aug 7 16:41:54.826992856 (7h2m16.571049716s) [upload=7317]: Waiting for error group managing segments... Aug 7 16:41:54.827040777 (7h2m16.571097628s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:41:54.827046615 (7h2m16.571103467s) [upload=7317]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:41:54.827050258 (7h2m16.571107119s) [upload=7317]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:41:55.007041475 (7h2m16.751098331s) [upload=7317]: Done uploading segments... Aug 7 16:41:55.007078732 (7h2m16.751135592s) [upload=7317]: Upload finished. err: <nil> Aug 7 16:42:33.114660638 (7h2m54.858717489s) [upload=7329]: Starting upload Aug 7 16:42:33.114723316 (7h2m54.858780184s) [upload=7329]: Done starting upload Aug 7 16:42:33.114808584 (7h2m54.858865446s) [upload=7329]: Uploading segments... Aug 7 16:42:33.114954183 (7h2m54.859011094s) [upload=7329]: Got next segment. Inline: true Aug 7 16:42:33.114964419 (7h2m54.859021291s) [upload=7329]: Waiting for error group managing segments... Aug 7 16:42:33.115056907 (7h2m54.859113765s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:33.115098651 (7h2m54.859155521s) [upload=7329]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:33.115104153 (7h2m54.859161408s) [upload=7329]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:33.282377476 (7h2m55.026434324s) [upload=7329]: Done uploading segments... Aug 7 16:42:33.282396856 (7h2m55.026453703s) [upload=7329]: Upload finished. err: <nil> Aug 7 16:42:58.569718137 (7h3m20.313774992s) [upload=7335]: Starting upload Aug 7 16:42:58.569806948 (7h3m20.313863817s) [upload=7335]: Done starting upload Aug 7 16:42:58.569899144 (7h3m20.313955994s) [upload=7335]: Uploading segments... Aug 7 16:42:58.569997510 (7h3m20.314054379s) [upload=7335]: Got next segment. Inline: true Aug 7 16:42:58.570003383 (7h3m20.314060245s) [upload=7335]: Waiting for error group managing segments... Aug 7 16:42:58.570067911 (7h3m20.314124771s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:42:58.570073919 (7h3m20.31413077s) [upload=7335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:42:58.570077668 (7h3m20.314134529s) [upload=7335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:42:58.784522505 (7h3m20.52857937s) [upload=7335]: Done uploading segments... Aug 7 16:42:58.784547202 (7h3m20.52860405s) [upload=7335]: Upload finished. err: <nil> Aug 7 16:44:05.100049252 (7h4m26.844106107s) [upload=7358]: Starting upload Aug 7 16:44:05.100115557 (7h4m26.844172417s) [upload=7358]: Done starting upload Aug 7 16:44:05.100190729 (7h4m26.844247579s) [upload=7358]: Uploading segments... Aug 7 16:44:05.100242315 (7h4m26.844299175s) [upload=7358]: Got next segment. Inline: true Aug 7 16:44:05.100248189 (7h4m26.844305039s) [upload=7358]: Waiting for error group managing segments... Aug 7 16:44:05.100292303 (7h4m26.844349154s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:44:05.100297338 (7h4m26.844354189s) [upload=7358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:44:05.100300781 (7h4m26.844357631s) [upload=7358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:44:05.485080285 (7h4m27.229137132s) [upload=7358]: Done uploading segments... Aug 7 16:44:05.485098188 (7h4m27.229155035s) [upload=7358]: Upload finished. err: <nil> Aug 7 16:45:07.908007025 (7h5m29.652063892s) [upload=7376]: Starting upload Aug 7 16:45:07.908084751 (7h5m29.652141669s) [upload=7376]: Done starting upload Aug 7 16:45:07.908177277 (7h5m29.652234144s) [upload=7376]: Uploading segments... Aug 7 16:45:07.908220581 (7h5m29.65227747s) [upload=7376]: Got next segment. Inline: true Aug 7 16:45:07.908226586 (7h5m29.652283466s) [upload=7376]: Waiting for error group managing segments... Aug 7 16:45:07.908272662 (7h5m29.65232953s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:07.908278589 (7h5m29.652335449s) [upload=7376]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:07.908282342 (7h5m29.652339203s) [upload=7376]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:08.086795592 (7h5m29.830852454s) [upload=7376]: Done uploading segments... Aug 7 16:45:08.086820029 (7h5m29.830876891s) [upload=7376]: Upload finished. err: <nil> Aug 7 16:45:56.657344924 (7h6m18.401401774s) [upload=7388]: Starting upload Aug 7 16:45:56.657413547 (7h6m18.401470409s) [upload=7388]: Done starting upload Aug 7 16:45:56.657529101 (7h6m18.401585972s) [upload=7388]: Uploading segments... Aug 7 16:45:56.657689431 (7h6m18.401746301s) [upload=7388]: Got next segment. Inline: true Aug 7 16:45:56.657698560 (7h6m18.401755426s) [upload=7388]: Waiting for error group managing segments... Aug 7 16:45:56.657782795 (7h6m18.401839663s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:45:56.657790686 (7h6m18.40184755s) [upload=7388]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:45:56.657810610 (7h6m18.401867473s) [upload=7388]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:45:56.942473952 (7h6m18.686530813s) [upload=7388]: Done uploading segments... Aug 7 16:45:56.942493412 (7h6m18.686550262s) [upload=7388]: Upload finished. err: <nil> Aug 7 16:46:37.709997957 (7h6m59.454054818s) [upload=7402]: Starting upload Aug 7 16:46:37.710049533 (7h6m59.454106397s) [upload=7402]: Done starting upload Aug 7 16:46:37.710120054 (7h6m59.4541769s) [upload=7402]: Uploading segments... Aug 7 16:46:37.710156794 (7h6m59.454213663s) [upload=7402]: Got next segment. Inline: true Aug 7 16:46:37.710161860 (7h6m59.45421872s) [upload=7402]: Waiting for error group managing segments... Aug 7 16:46:37.710203638 (7h6m59.454260498s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:46:37.710207833 (7h6m59.454264679s) [upload=7402]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:46:37.710210376 (7h6m59.454267222s) [upload=7402]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:46:37.932888295 (7h6m59.676945162s) [upload=7402]: Done uploading segments... Aug 7 16:46:37.932913081 (7h6m59.676969949s) [upload=7402]: Upload finished. err: <nil> Aug 7 16:47:35.514568462 (7h7m57.258625312s) [upload=7416]: Starting upload Aug 7 16:47:35.514612719 (7h7m57.258669585s) [upload=7416]: Done starting upload Aug 7 16:47:35.514710533 (7h7m57.258767393s) [upload=7416]: Uploading segments... Aug 7 16:47:35.514748717 (7h7m57.258805586s) [upload=7416]: Got next segment. Inline: true Aug 7 16:47:35.514753842 (7h7m57.258810702s) [upload=7416]: Waiting for error group managing segments... Aug 7 16:47:35.514795680 (7h7m57.258852544s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:47:35.514800652 (7h7m57.258857514s) [upload=7416]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:47:35.514804386 (7h7m57.258861248s) [upload=7416]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:47:35.828569134 (7h7m57.572625984s) [upload=7416]: Done uploading segments... Aug 7 16:47:35.828588428 (7h7m57.572645288s) [upload=7416]: Upload finished. err: <nil> Duration: 967.131095ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.....X...X..............X...........X................] duration: 2.574186816s FAIL (2025-08-07 16:47:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.574220626s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X...............................X.........] duration: 994.651803ms FAIL (2025-08-07 16:46:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 994.681278ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.....X...X..............X...........X...............] duration: 2.502162309s FAIL (2025-08-07 16:46:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.502183253s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.....X...X..............X...........X..............] duration: 3.058315492s FAIL (2025-08-07 16:46:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 3.058365986s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X...............................X........] duration: 991.978753ms FAIL (2025-08-07 16:45:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 992.007326ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X...............................X.......] duration: 893.031626ms FAIL (2025-08-07 16:45:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 893.063888ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.....X...X..............X...........X.............] duration: 2.502344213s FAIL (2025-08-07 16:44:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.502371173s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X...............................X......] duration: 1.084808333s FAIL (2025-08-07 16:44:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 1.084834082s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.....X...X..............X...........X............] duration: 2.560150476s FAIL (2025-08-07 16:43:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.560182242s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X...............................X.....] duration: 1.025143025s FAIL (2025-08-07 16:42:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 1.025173035s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration: 867.172994ms FAIL (2025-08-07 16:42:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 867.202285ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X.....X...X..............X...........X...........] duration: 2.442919074s FAIL (2025-08-07 16:42:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.443013151s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X...............................X...] duration: 1.019166902s FAIL (2025-08-07 16:41:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 1.01920172s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X.....X...X..............X...........X..........] duration: 2.666901565s FAIL (2025-08-07 16:41:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.66692887s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration: 921.32155ms FAIL (2025-08-07 16:41:06 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 921.37738ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X.....X...X..............X...........X.........] duration: 2.438154976s FAIL (2025-08-07 16:40:42 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.43818513s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...............................X.] duration: 1.061535189s FAIL (2025-08-07 16:40:10 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 1.061640696s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X...............................X] duration: 703.057756ms FAIL (2025-08-07 16:39:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== h item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:33:58.573138926 (6h54m20.317195776s) [upload=7179]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:58.752295845 (6h54m20.496352696s) [upload=7179]: Done uploading segments... Aug 7 16:33:58.752314230 (6h54m20.49637108s) [upload=7179]: Upload finished. err: <nil> Aug 7 16:34:16.691888514 (6h54m38.435945387s) [upload=7185]: Starting upload Aug 7 16:34:16.691982952 (6h54m38.436039815s) [upload=7185]: Done starting upload Aug 7 16:34:16.692064336 (6h54m38.436121198s) [upload=7185]: Uploading segments... Aug 7 16:34:16.692147096 (6h54m38.436203961s) [upload=7185]: Got next segment. Inline: true Aug 7 16:34:16.692152820 (6h54m38.436209681s) [upload=7185]: Waiting for error group managing segments... Aug 7 16:34:16.692219434 (6h54m38.4362763s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:16.692225590 (6h54m38.436282454s) [upload=7185]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:16.692229436 (6h54m38.436286297s) [upload=7185]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:16.848451021 (6h54m38.592507894s) [upload=7185]: Done uploading segments... Aug 7 16:34:16.848474046 (6h54m38.592530899s) [upload=7185]: Upload finished. err: <nil> Aug 7 16:34:57.804681214 (6h55m19.548738074s) [upload=7196]: Starting upload Aug 7 16:34:57.804735872 (6h55m19.548792732s) [upload=7196]: Done starting upload Aug 7 16:34:57.804808120 (6h55m19.548864969s) [upload=7196]: Uploading segments... Aug 7 16:34:57.804911022 (6h55m19.548967893s) [upload=7196]: Got next segment. Inline: true Aug 7 16:34:57.804918656 (6h55m19.548975519s) [upload=7196]: Waiting for error group managing segments... Aug 7 16:34:57.804976707 (6h55m19.549033558s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:34:57.804984661 (6h55m19.549041525s) [upload=7196]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:34:57.804988548 (6h55m19.549045398s) [upload=7196]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:34:58.170551709 (6h55m19.91460857s) [upload=7196]: Done uploading segments... Aug 7 16:34:58.170571406 (6h55m19.914628256s) [upload=7196]: Upload finished. err: <nil> Aug 7 16:35:59.487753733 (6h56m21.231810585s) [upload=7214]: Starting upload Aug 7 16:35:59.487817616 (6h56m21.231874487s) [upload=7214]: Done starting upload Aug 7 16:35:59.487906402 (6h56m21.231963263s) [upload=7214]: Uploading segments... Aug 7 16:35:59.487979810 (6h56m21.232036681s) [upload=7214]: Got next segment. Inline: true Aug 7 16:35:59.487986372 (6h56m21.232043237s) [upload=7214]: Waiting for error group managing segments... Aug 7 16:35:59.488067782 (6h56m21.23212465s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:35:59.488074756 (6h56m21.232131634s) [upload=7214]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:35:59.488079113 (6h56m21.232135982s) [upload=7214]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:36:00.044600281 (6h56m21.788657131s) [upload=7214]: Done uploading segments... Aug 7 16:36:00.044632425 (6h56m21.788689283s) [upload=7214]: Upload finished. err: <nil> Aug 7 16:37:05.089592204 (6h57m26.833649051s) [upload=7233]: Starting upload Aug 7 16:37:05.089658944 (6h57m26.833715794s) [upload=7233]: Done starting upload Aug 7 16:37:05.089724153 (6h57m26.833781002s) [upload=7233]: Uploading segments... Aug 7 16:37:05.089771925 (6h57m26.833828794s) [upload=7233]: Got next segment. Inline: true Aug 7 16:37:05.089777911 (6h57m26.833834772s) [upload=7233]: Waiting for error group managing segments... Aug 7 16:37:05.089832844 (6h57m26.833889694s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:05.089838690 (6h57m26.833895551s) [upload=7233]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:05.089844829 (6h57m26.833901689s) [upload=7233]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:05.533120354 (6h57m27.277177208s) [upload=7233]: Done uploading segments... Aug 7 16:37:05.533140732 (6h57m27.277197583s) [upload=7233]: Upload finished. err: <nil> Aug 7 16:37:29.991116804 (6h57m51.735173675s) [upload=7239]: Starting upload Aug 7 16:37:29.991193244 (6h57m51.735250108s) [upload=7239]: Done starting upload Aug 7 16:37:29.991278313 (6h57m51.735335176s) [upload=7239]: Uploading segments... Aug 7 16:37:29.991383384 (6h57m51.735440254s) [upload=7239]: Got next segment. Inline: true Aug 7 16:37:29.991392256 (6h57m51.735449117s) [upload=7239]: Waiting for error group managing segments... Aug 7 16:37:29.991461943 (6h57m51.73551907s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:29.991469541 (6h57m51.735526402s) [upload=7239]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:29.991474095 (6h57m51.735530956s) [upload=7239]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:30.294869774 (6h57m52.038926641s) [upload=7239]: Done uploading segments... Aug 7 16:37:30.294893234 (6h57m52.038950099s) [upload=7239]: Upload finished. err: <nil> Aug 7 16:37:45.079633240 (6h58m6.82369009s) [upload=7244]: Starting upload Aug 7 16:37:45.079731707 (6h58m6.823788557s) [upload=7244]: Done starting upload Aug 7 16:37:45.079827086 (6h58m6.823883937s) [upload=7244]: Uploading segments... Aug 7 16:37:45.079953945 (6h58m6.824010812s) [upload=7244]: Got next segment. Inline: true Aug 7 16:37:45.079973433 (6h58m6.824030296s) [upload=7244]: Waiting for error group managing segments... Aug 7 16:37:45.080049758 (6h58m6.824106622s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:37:45.080056626 (6h58m6.824113476s) [upload=7244]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:37:45.080060676 (6h58m6.824117538s) [upload=7244]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:37:45.479006519 (6h58m7.22306337s) [upload=7244]: Done uploading segments... Aug 7 16:37:45.479026085 (6h58m7.223082936s) [upload=7244]: Upload finished. err: <nil> Aug 7 16:38:04.504427219 (6h58m26.248484081s) [upload=7248]: Starting upload Aug 7 16:38:04.504525963 (6h58m26.248582827s) [upload=7248]: Done starting upload Aug 7 16:38:04.504667350 (6h58m26.248724211s) [upload=7248]: Uploading segments... Aug 7 16:38:04.504790452 (6h58m26.248847298s) [upload=7248]: Got next segment. Inline: true Aug 7 16:38:04.504798542 (6h58m26.248855407s) [upload=7248]: Waiting for error group managing segments... Aug 7 16:38:04.504883618 (6h58m26.248940492s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:04.504907416 (6h58m26.248964282s) [upload=7248]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:04.504912481 (6h58m26.248969351s) [upload=7248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:04.788218215 (6h58m26.532275094s) [upload=7248]: Done uploading segments... Aug 7 16:38:04.788269795 (6h58m26.532326641s) [upload=7248]: Upload finished. err: <nil> Aug 7 16:38:57.311226437 (6h59m19.055283284s) [upload=7263]: Starting upload Aug 7 16:38:57.311273890 (6h59m19.055330759s) [upload=7263]: Done starting upload Aug 7 16:38:57.311341835 (6h59m19.055398682s) [upload=7263]: Uploading segments... Aug 7 16:38:57.311390038 (6h59m19.055446907s) [upload=7263]: Got next segment. Inline: true Aug 7 16:38:57.311394598 (6h59m19.055451444s) [upload=7263]: Waiting for error group managing segments... Aug 7 16:38:57.311443600 (6h59m19.055500462s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:38:57.311448376 (6h59m19.055505236s) [upload=7263]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:38:57.311451071 (6h59m19.05550793s) [upload=7263]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:38:57.452639523 (6h59m19.196696371s) [upload=7263]: Done uploading segments... Aug 7 16:38:57.452658921 (6h59m19.196715767s) [upload=7263]: Upload finished. err: <nil> Aug 7 16:39:14.845829367 (6h59m36.589886231s) [upload=7269]: Starting upload Aug 7 16:39:14.845941228 (6h59m36.589998089s) [upload=7269]: Done starting upload Aug 7 16:39:14.846038617 (6h59m36.59009547s) [upload=7269]: Uploading segments... Aug 7 16:39:14.846127548 (6h59m36.590184418s) [upload=7269]: Got next segment. Inline: true Aug 7 16:39:14.846135714 (6h59m36.590192579s) [upload=7269]: Waiting for error group managing segments... Aug 7 16:39:14.846234591 (6h59m36.590291452s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:14.846241618 (6h59m36.590298479s) [upload=7269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:14.846245348 (6h59m36.590302208s) [upload=7269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:15.002046079 (6h59m36.746102951s) [upload=7269]: Done uploading segments... Aug 7 16:39:15.002074300 (6h59m36.746131164s) [upload=7269]: Upload finished. err: <nil> Aug 7 16:39:41.153801476 (7h0m2.897858327s) [upload=7280]: Starting upload Aug 7 16:39:41.153866625 (7h0m2.897923488s) [upload=7280]: Done starting upload Aug 7 16:39:41.153960245 (7h0m2.898017095s) [upload=7280]: Uploading segments... Aug 7 16:39:41.154014945 (7h0m2.898071808s) [upload=7280]: Got next segment. Inline: true Aug 7 16:39:41.154020007 (7h0m2.898076871s) [upload=7280]: Waiting for error group managing segments... Aug 7 16:39:41.154065785 (7h0m2.898122635s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:39:41.154071036 (7h0m2.898127899s) [upload=7280]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:39:41.154074378 (7h0m2.898131238s) [upload=7280]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:39:41.364840735 (7h0m3.108897595s) [upload=7280]: Done uploading segments... Aug 7 16:39:41.364860482 (7h0m3.108917331s) [upload=7280]: Upload finished. err: <nil> Duration: 703.08581ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X.....X...X..............X...........X........] duration: 2.587866357s FAIL (2025-08-07 16:39:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.587892645s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 1.003029139s FAIL (2025-08-07 16:39:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.003062789s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 844.059307ms FAIL (2025-08-07 16:38:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 844.095229ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X.....X...X..............X...........X.......] duration: 2.507425592s FAIL (2025-08-07 16:38:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.507458493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 983.930332ms FAIL (2025-08-07 16:38:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 983.978191ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [................X.....X...X..............X...........X......] duration: 2.434292757s FAIL (2025-08-07 16:37:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.43432512s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 1.09359706s FAIL (2025-08-07 16:37:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.093634448s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 1.087646168s FAIL (2025-08-07 16:37:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.087675603s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.................X.....X...X..............X...........X.....] duration: 2.92950567s FAIL (2025-08-07 16:37:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.929580076s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.332052818s FAIL (2025-08-07 16:37:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.332078514s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..................X.....X...X..............X...........X....] duration: 2.559490045s FAIL (2025-08-07 16:36:16 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.559520433s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.572148002s FAIL (2025-08-07 16:36:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.57217674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...................X.....X...X..............X...........X...] duration: 2.471735316s FAIL (2025-08-07 16:35:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.47176745s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [....................X.....X...X..............X...........X..] duration: 2.650562155s FAIL (2025-08-07 16:35:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.650597826s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 1.35312718s FAIL (2025-08-07 16:34:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.353156695s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....................X.....X...X..............X...........X.] duration: 2.34645263s FAIL (2025-08-07 16:34:17 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.346483291s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 859.713392ms FAIL (2025-08-07 16:34:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 859.741912ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 902.617727ms FAIL (2025-08-07 16:33:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 902.65324ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [......................X.....X...X..............X...........X] duration: 2.624895034s FAIL (2025-08-07 16:33:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 6f9ab57f90a25d95d2e88087f772a361a105686fc3ae8185581338cdb77b0540 != before f0e7eb064acb39ae7e48d017ab2c00549ca31b3b2927e41b88cbef8ab06c1782 ======LOGS====== 33:31.475976549 (6h53m53.22003341s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:33:31.475982830 (6h53m53.22003969s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:33:31.672323925 (6h53m53.416380788s) [seg_pos={0 0}, upload=7172]: Begin upload segment... Aug 7 16:33:31.672373465 (6h53m53.416430311s) [seg_pos={0 0}, upload=7172]: Done begin upload segment. Aug 7 16:33:31.672396688 (6h53m53.41645355s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672417117 (6h53m53.416473987s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672717541 (6h53m53.416774401s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672953898 (6h53m53.417010761s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.672968647 (6h53m53.41702552s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673209128 (6h53m53.417265994s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673432369 (6h53m53.417489241s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673461748 (6h53m53.417518608s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673698748 (6h53m53.417755612s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.673958146 (6h53m53.418015006s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674188175 (6h53m53.418245038s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674499927 (6h53m53.418556792s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674589263 (6h53m53.418646119s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674756229 (6h53m53.418813092s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.674981215 (6h53m53.419038074s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675177995 (6h53m53.419234845s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675222633 (6h53m53.419279493s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:31.675896001 (6h53m53.419952863s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Uploading piece... Aug 7 16:33:32.257772356 (6h53m54.001829221s) [upload=7172]: Next returned nil segment Aug 7 16:33:32.257795078 (6h53m54.001851944s) [upload=7172]: Waiting for error group managing segments... Aug 7 16:33:32.420354668 (6h53m54.164411518s) [noise=true , address=104.36.82.44:4878 , piece_id=CBODOGW2TYWNOSEPQVULUWN4ZZY6GFQ5DZTDDZCT2AXLSF5ANPWQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.422839458 (6h53m54.16689631s) [noise=true , address=104.36.82.61:4393 , piece_id=OVA3E5S6LILWF3IT5UQRVBVLPXEAPTU5DMPUEPMPXRMC6JA2DKJQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.428122763 (6h53m54.172179609s) [noise=true , address=104.36.82.39:4729 , piece_id=4XN2EQ6QK6FSPBGVKGLDQW6LRK7B7B7EGL2BGZ5AK6FW2ZVG3YPQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.430895752 (6h53m54.1749526s) [noise=true , address=104.36.82.45:4913 , piece_id=NSEWEY4B26TYLJS75GTB26GH52RXEZ5IM7D7MJPJLZZLHWRG75LA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.438156140 (6h53m54.182212986s) [noise=true , address=104.36.82.22:4527 , piece_id=THMI2W4KJZ4JIIDCS2MH6EG35GVPDK563XVI6II75QDJZNL7TMDQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.447260759 (6h53m54.191317613s) [noise=true , address=104.36.82.58:4268 , piece_id=W5UVDQ3JXGKLUOHDYUZ7KXIJC6ZCWASYOXEWZVREAJI3465B6JHQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.451183273 (6h53m54.195240134s) [noise=true , address=104.36.82.18:4382 , piece_id=YHF7GDA3ZWAYHJ7LGX7ID254ICBOYP2PXN3ILPVUCYMY5ZWM5LJA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.452232525 (6h53m54.196289378s) [noise=true , address=104.36.82.17:4349 , piece_id=3X2OWWLAVOO62PNYV26CWEXY3MIF37KV263P64D4XMOR5YKEKN3Q, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.456778781 (6h53m54.200835627s) [noise=true , address=104.36.82.37:4658 , piece_id=ZWCQPIIXOKJEYPF6IPP5P3S4JKME67JWPI4W7FMCTIV2SZHR3IGA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.457727677 (6h53m54.201784541s) [noise=true , address=104.36.82.62:4410 , piece_id=5T6M6KFT7WKZH4NRXHO2G7JXTHKDJONYD7TKLPEAD4HWP6KZLDRQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.461749372 (6h53m54.205806224s) [noise=true , address=104.36.82.60:4371 , piece_id=P6KKM7NJ2VFQYMW6QXK3ZSWRR73LQM4MGZ5UQKEOBH3HH6PT4UAQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.468252294 (6h53m54.212309145s) [noise=true , address=77.90.31.13:4634 , piece_id=2ZN4MQABFBIO2T44ZM4PKA75GO37EUU3O7BHUEELGAOPFP5K4PYQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.474593906 (6h53m54.218650752s) [noise=true , address=104.36.82.4:4805 , piece_id=TTYVFYQU6R6PJAVCXORZNXFSKELAYZMS2VZ7APIAX3M4MBSSHVFA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533108696 (6h53m54.277165543s) [noise=true , address=104.36.82.55:4207 , piece_id=MSQKS4X3D77OHV5D4LAXA4C4YHCQF7HTIWW4GY4SLV7JT2RQQPGQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: <nil> Aug 7 16:33:32.533134016 (6h53m54.277190875s) [seg_pos={0 0}, upload=7172]: Segment reached optimal threshold of 14 pieces. Aug 7 16:33:32.533250619 (6h53m54.277307466s) [noise=true , address=104.36.82.11:4141 , piece_id=GF7SIPSCEBSXFXUJEQY4MQ3KSGMPKMK4HU7E4PSCCIHHDZA7LAZQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129zfpWSguxcUH9723ivdoL39WgpjiTxA189mYbzsGAGVjFcXLL): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533384688 (6h53m54.277441547s) [noise=true , address=104.36.82.13:4214 , piece_id=7DXPV5X5RNP56YZ2TJTSB6WKDLGFXW3E7XB4HC72OX7EG57ZBWXQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJ8uqwxf6x4hX52AjAdCbMKi1BKGGbMvrQbiazJdLpn6j69ay): protocol: expected piece hash; context canceled; EOF Aug 7 16:33:32.533468000 (6h53m54.27752486s) [noise=true , address=64.49.13.169:4714 , piece_id=ASQAS3TCIPHYM6I3P3EIIG3BBTHGHT5VI5GT4AXCUTQF2IUJK2GQ, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DsmdSnS2m7eL7TKCoyegaYK46jVo96qXPMxQWSaSCdZ7NbdKm): protocol: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59430->64.49.13.169:4714: use of closed network connection Aug 7 16:33:32.533497241 (6h53m54.277554088s) [noise=true , address=79.127.205.234:4595 , piece_id=3JKK33GEQ4YQPZBEBKKJU3MUH66XC76EW26FRQFQZUKUOMTYVMEA, seg_pos={0 0}, upload=7172]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qA14e1g7Ym4Yf2P6TUjAtqf5mAxR4iWw1FQEwkgWnGfpfmC9a): protocol: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->79.127.205.234:4595: use of closed network connection Aug 7 16:33:32.533515650 (6h53m54.277572511s) [seg_pos={0 0}, upload=7172]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:33:32.533580808 (6h53m54.277637673s) [upload=7172]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:33:32.533585036 (6h53m54.277641882s) [upload=7172]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:33:32.692892730 (6h53m54.436949578s) [upload=7172]: Done uploading segments... Aug 7 16:33:32.692924692 (6h53m54.436981539s) [upload=7172]: Upload finished. err: <nil> Duration: 2.624921741s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 842.038659ms FAIL (2025-08-07 16:32:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== stItem_SegmentMakeInline Aug 7 16:09:40.616753955 (6h30m2.360810806s) [upload=6752]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:09:40.775802990 (6h30m2.519859842s) [upload=6752]: Done uploading segments... Aug 7 16:09:40.775838389 (6h30m2.519895239s) [upload=6752]: Upload finished. err: <nil> Aug 7 16:10:42.231759607 (6h31m3.975816478s) [upload=6768]: Starting upload Aug 7 16:10:42.231884006 (6h31m3.975940878s) [upload=6768]: Done starting upload Aug 7 16:10:42.231979135 (6h31m3.976035981s) [upload=6768]: Uploading segments... Aug 7 16:10:42.232044220 (6h31m3.976101083s) [upload=6768]: Got next segment. Inline: true Aug 7 16:10:42.232049723 (6h31m3.976106569s) [upload=6768]: Waiting for error group managing segments... Aug 7 16:10:42.232090947 (6h31m3.976147794s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:10:42.232096269 (6h31m3.97615313s) [upload=6768]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:10:42.232108835 (6h31m3.976165696s) [upload=6768]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:10:42.442278505 (6h31m4.186335359s) [upload=6768]: Done uploading segments... Aug 7 16:10:42.442306284 (6h31m4.186363135s) [upload=6768]: Upload finished. err: <nil> Aug 7 16:11:31.667749137 (6h31m53.41180599s) [upload=6781]: Starting upload Aug 7 16:11:31.667832000 (6h31m53.411888869s) [upload=6781]: Done starting upload Aug 7 16:11:31.667942448 (6h31m53.4119993s) [upload=6781]: Uploading segments... Aug 7 16:11:31.668009192 (6h31m53.412066062s) [upload=6781]: Got next segment. Inline: true Aug 7 16:11:31.668015293 (6h31m53.412072154s) [upload=6781]: Waiting for error group managing segments... Aug 7 16:11:31.668064508 (6h31m53.412121367s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:11:31.668070003 (6h31m53.412126863s) [upload=6781]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:11:31.668073848 (6h31m53.412130708s) [upload=6781]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:11:31.844732843 (6h31m53.588789704s) [upload=6781]: Done uploading segments... Aug 7 16:11:31.844789290 (6h31m53.58884614s) [upload=6781]: Upload finished. err: <nil> Aug 7 16:12:12.650293330 (6h32m34.394350192s) [upload=6793]: Starting upload Aug 7 16:12:12.650355805 (6h32m34.394412674s) [upload=6793]: Done starting upload Aug 7 16:12:12.650500813 (6h32m34.39455766s) [upload=6793]: Uploading segments... Aug 7 16:12:12.650630867 (6h32m34.394687737s) [upload=6793]: Got next segment. Inline: true Aug 7 16:12:12.650640003 (6h32m34.39469687s) [upload=6793]: Waiting for error group managing segments... Aug 7 16:12:12.650713892 (6h32m34.394770756s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:12.650719677 (6h32m34.394776537s) [upload=6793]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:12.650725124 (6h32m34.394781984s) [upload=6793]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:12.807983137 (6h32m34.552040015s) [upload=6793]: Done uploading segments... Aug 7 16:12:12.808026051 (6h32m34.552082919s) [upload=6793]: Upload finished. err: <nil> Aug 7 16:12:30.834349250 (6h32m52.578406112s) [upload=6799]: Starting upload Aug 7 16:12:30.834410554 (6h32m52.578467416s) [upload=6799]: Done starting upload Aug 7 16:12:30.834487363 (6h32m52.578544226s) [upload=6799]: Uploading segments... Aug 7 16:12:30.834541191 (6h32m52.578598062s) [upload=6799]: Got next segment. Inline: true Aug 7 16:12:30.834547253 (6h32m52.578604115s) [upload=6799]: Waiting for error group managing segments... Aug 7 16:12:30.834597304 (6h32m52.578654164s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:12:30.834603379 (6h32m52.578660242s) [upload=6799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:12:30.834607593 (6h32m52.578664455s) [upload=6799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:12:30.992269717 (6h32m52.736326587s) [upload=6799]: Done uploading segments... Aug 7 16:12:30.992291433 (6h32m52.736348298s) [upload=6799]: Upload finished. err: <nil> Aug 7 16:13:44.023251504 (6h34m5.767308377s) [upload=6821]: Starting upload Aug 7 16:13:44.023366744 (6h34m5.767423591s) [upload=6821]: Done starting upload Aug 7 16:13:44.023608906 (6h34m5.767665763s) [upload=6821]: Uploading segments... Aug 7 16:13:44.023709410 (6h34m5.767766283s) [upload=6821]: Got next segment. Inline: true Aug 7 16:13:44.023719636 (6h34m5.767776501s) [upload=6821]: Waiting for error group managing segments... Aug 7 16:13:44.023773027 (6h34m5.767829887s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:13:44.023779863 (6h34m5.767836723s) [upload=6821]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:13:44.023783737 (6h34m5.767840586s) [upload=6821]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:13:44.190324158 (6h34m5.934381018s) [upload=6821]: Done uploading segments... Aug 7 16:13:44.190372081 (6h34m5.934428942s) [upload=6821]: Upload finished. err: <nil> Aug 7 16:14:53.942530987 (6h35m15.68658786s) [upload=6844]: Starting upload Aug 7 16:14:53.942673924 (6h35m15.686730785s) [upload=6844]: Done starting upload Aug 7 16:14:53.942756501 (6h35m15.686813366s) [upload=6844]: Uploading segments... Aug 7 16:14:53.942859287 (6h35m15.686916158s) [upload=6844]: Got next segment. Inline: true Aug 7 16:14:53.942866822 (6h35m15.686923693s) [upload=6844]: Waiting for error group managing segments... Aug 7 16:14:53.942937447 (6h35m15.686994317s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:14:53.942944846 (6h35m15.687001717s) [upload=6844]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:14:53.942947964 (6h35m15.687004834s) [upload=6844]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:54.089614227 (6h35m15.833671089s) [upload=6844]: Done uploading segments... Aug 7 16:14:54.089638187 (6h35m15.833695047s) [upload=6844]: Upload finished. err: <nil> Aug 7 16:15:47.816160603 (6h36m9.560217463s) [upload=6863]: Starting upload Aug 7 16:15:47.816219200 (6h36m9.560276065s) [upload=6863]: Done starting upload Aug 7 16:15:47.816297832 (6h36m9.560354678s) [upload=6863]: Uploading segments... Aug 7 16:15:47.816351442 (6h36m9.560408304s) [upload=6863]: Got next segment. Inline: true Aug 7 16:15:47.816357229 (6h36m9.560414088s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:15:47.816395509 (6h36m9.560452355s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:47.816402183 (6h36m9.560459042s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:47.816404894 (6h36m9.560461753s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:47.966035904 (6h36m9.710092775s) [upload=6863]: Done uploading segments... Aug 7 16:15:47.966061058 (6h36m9.710117917s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:25.266680963 (6h36m47.010737813s) [upload=6876]: Starting upload Aug 7 16:16:25.266738213 (6h36m47.010795076s) [upload=6876]: Done starting upload Aug 7 16:16:25.266810033 (6h36m47.010866884s) [upload=6876]: Uploading segments... Aug 7 16:16:25.266847650 (6h36m47.010904519s) [upload=6876]: Got next segment. Inline: true Aug 7 16:16:25.266852936 (6h36m47.010909787s) [upload=6876]: Waiting for error group managing segments... Aug 7 16:16:25.266894565 (6h36m47.010951415s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:25.266899775 (6h36m47.010956625s) [upload=6876]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:25.266903077 (6h36m47.010959927s) [upload=6876]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:25.586136069 (6h36m47.330192919s) [upload=6876]: Done uploading segments... Aug 7 16:16:25.586153615 (6h36m47.330210466s) [upload=6876]: Upload finished. err: <nil> Aug 7 16:17:04.757419053 (6h37m26.501475913s) [upload=6888]: Starting upload Aug 7 16:17:04.757525024 (6h37m26.501581888s) [upload=6888]: Done starting upload Aug 7 16:17:04.757628272 (6h37m26.501685132s) [upload=6888]: Uploading segments... Aug 7 16:17:04.757679794 (6h37m26.501736659s) [upload=6888]: Got next segment. Inline: true Aug 7 16:17:04.757684880 (6h37m26.50174174s) [upload=6888]: Waiting for error group managing segments... Aug 7 16:17:04.757726993 (6h37m26.501783856s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:04.757731484 (6h37m26.501788344s) [upload=6888]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:04.757734132 (6h37m26.501790992s) [upload=6888]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:04.968053417 (6h37m26.712110287s) [upload=6888]: Done uploading segments... Aug 7 16:17:04.968077827 (6h37m26.712134695s) [upload=6888]: Upload finished. err: <nil> Aug 7 16:17:59.760309655 (6h38m21.504366521s) [upload=6904]: Starting upload Aug 7 16:17:59.760463865 (6h38m21.504520712s) [upload=6904]: Done starting upload Aug 7 16:17:59.760588298 (6h38m21.504645149s) [upload=6904]: Uploading segments... Aug 7 16:17:59.760691251 (6h38m21.504748146s) [upload=6904]: Got next segment. Inline: true Aug 7 16:17:59.760700598 (6h38m21.504757713s) [upload=6904]: Waiting for error group managing segments... Aug 7 16:17:59.760761495 (6h38m21.504818358s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.760768357 (6h38m21.504825219s) [upload=6904]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.760771931 (6h38m21.504828792s) [upload=6904]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.850749254 (6h38m21.594806104s) [upload=6904]: Done uploading segments... Aug 7 16:17:59.850781992 (6h38m21.594838852s) [upload=6904]: Upload finished. err: metaclient: Too Many Requests Duration:* 842.071682ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)