Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.002127706s
FAIL (2025-08-11 20:49:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.002155331s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
887.159588ms
FAIL (2025-08-11 20:48:57 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 887.244999ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X................X.............X...............] duration:
2.477552914s
FAIL (2025-08-11 20:48:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.477649363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.199400218s
FAIL (2025-08-11 20:48:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.199455156s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X................X.............X..............] duration:
2.750171834s
FAIL (2025-08-11 20:48:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.750205356s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X................X.............X.............] duration:
2.749574767s
FAIL (2025-08-11 20:47:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.749623731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
1.109840439s
FAIL (2025-08-11 20:47:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.109874586s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
882.897527ms
FAIL (2025-08-11 20:46:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 882.933878ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X................X.............X............] duration:
2.53427739s
FAIL (2025-08-11 20:46:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.534302404s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
968.201035ms
FAIL (2025-08-11 20:45:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 968.310086ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X................X.............X...........] duration:
3.112073079s
FAIL (2025-08-11 20:45:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 3.112112134s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X................X.............X..........] duration:
2.649562086s
FAIL (2025-08-11 20:45:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.649596109s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.047300408s
FAIL (2025-08-11 20:44:41 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.047332893s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X................X.............X.........] duration:
2.611118753s
FAIL (2025-08-11 20:43:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.611144563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
880.352588ms
FAIL (2025-08-11 20:43:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 880.385956ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X................X.............X........] duration:
2.785683219s
FAIL (2025-08-11 20:43:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.785712582s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
856.865861ms
FAIL (2025-08-11 20:43:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 856.902233ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
845.242521ms
FAIL (2025-08-11 20:42:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 845.270658ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X................X.............X.......] duration:
2.68861644s
FAIL (2025-08-11 20:42:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.688671025s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.126530577s
FAIL (2025-08-11 20:42:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.126559512s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
966.173063ms
FAIL (2025-08-11 20:41:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 966.280829ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X................X.............X......] duration:
2.560026084s
FAIL (2025-08-11 20:41:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.560062225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X................X.............X.....] duration:
2.481630553s
FAIL (2025-08-11 20:40:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.481656537s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
907.879027ms
FAIL (2025-08-11 20:40:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 908.232998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
939.87878ms
FAIL (2025-08-11 20:39:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 939.933429ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X................X.............X....] duration:
2.84222795s
FAIL (2025-08-11 20:39:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.842259703s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X................X.............X...] duration:
2.46848645s
FAIL (2025-08-11 20:39:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.46852874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
918.855139ms
FAIL (2025-08-11 20:38:43 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 918.90798ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.046294504s
FAIL (2025-08-11 20:38:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.046347833s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X................X.............X..] duration:
2.571109965s
FAIL (2025-08-11 20:38:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.571140744s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
941.956782ms
FAIL (2025-08-11 20:37:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 941.987682ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X................X.............X.] duration:
3.068505236s
FAIL (2025-08-11 20:37:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 3.068549917s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X................X.............X] duration:
2.626711228s
FAIL (2025-08-11 20:36:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after cbb1ea6667aac44944ce83b09e0e0523e6f0921665c35eaf784b060ceae27220 != before 77a48586732be9bbf7904077557eeca7ffc6725cf5fd54bfa21bae6bdef9b571
======LOGS======
Aug 11 20:36:33.884801240 (75h10m55.843898496s) [upload=78372]: Starting upload
Aug 11 20:36:33.884900269 (75h10m55.843997501s) [upload=78372]: Done starting upload
Aug 11 20:36:33.885056300 (75h10m55.844153534s) [upload=78372]: Uploading segments...
Aug 11 20:36:33.885480534 (75h10m55.84457779s) [upload=78372]: Got next segment. Inline: false
Aug 11 20:36:33.885533740 (75h10m55.844630994s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 11 20:36:33.885550507 (75h10m55.844647753s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 11 20:36:34.116834799 (75h10m56.075932075s) [seg_pos={0 0}, upload=78372]: Begin upload segment...
Aug 11 20:36:34.116950178 (75h10m56.076047434s) [seg_pos={0 0}, upload=78372]: Done begin upload segment.
Aug 11 20:36:34.116978102 (75h10m56.07607537s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.116991941 (75h10m56.076089194s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117545522 (75h10m56.076642781s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.117558490 (75h10m56.076655748s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118105348 (75h10m56.077202626s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118134719 (75h10m56.077231964s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118563046 (75h10m56.077660305s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.118628901 (75h10m56.077726159s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119014918 (75h10m56.078112184s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119023782 (75h10m56.078121027s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.119384522 (75h10m56.078481768s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.120252857 (75h10m56.079350099s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122222012 (75h10m56.081319268s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.122689075 (75h10m56.081786327s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123100417 (75h10m56.082197675s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.123504485 (75h10m56.08260174s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124021664 (75h10m56.083118919s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.124436014 (75h10m56.083533271s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Uploading piece...
Aug 11 20:36:34.675435005 (75h10m56.634532264s) [upload=78372]: Next returned nil segment
Aug 11 20:36:34.675460532 (75h10m56.634557792s) [upload=78372]: Waiting for error group managing segments...
Aug 11 20:36:34.854367683 (75h10m56.813464915s) [noise=true , address=104.36.82.18:4394 , piece_id=OZWOQAKL22BRQBJ7CYQXC4WU4H27O6U7C67DYOYS7KWEMNYG2BBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.856216061 (75h10m56.815313307s) [noise=true , address=104.36.82.34:4560 , piece_id=5YZECG4UD4XPC6U6VYA7XYRNSCMAUXVS577FBLNCLODYNJGWRGOQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.862635899 (75h10m56.821733141s) [noise=true , address=104.36.82.58:4291 , piece_id=GAZSL56BIT6CTL5SFERHCL4XPAVPQKFEJRGQIXCL4SI3OQ7WP33A, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.864892602 (75h10m56.82398984s) [noise=true , address=104.36.82.22:4542 , piece_id=MPRIEO24XWDXQIV6XNHV2ESVOKC6KJMZL75ZZZYKGGOL645KBF4Q, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866167244 (75h10m56.825264483s) [noise=true , address=104.36.82.62:4434 , piece_id=BW6OQHHQBMWDRE6J6DNRRGP7RZQJIBY6J64FLDMBBKR3OO6ZXAGQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.866508048 (75h10m56.825605287s) [noise=true , address=77.90.31.17:4782 , piece_id=6LUIHCLE3ORL4FYCPUML2C6JZ3ODMQFJXJHIKGIFS4Q6KBG3QQUQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.869036497 (75h10m56.828133728s) [noise=true , address=104.36.82.12:4154 , piece_id=6EPJF5FMMYAWN5PTGGHFJR6U7VKRNI3DUS2QCJMQSYKAFV3HHCEA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.881319827 (75h10m56.840417061s) [noise=true , address=104.36.82.62:4422 , piece_id=KJSJQEOABC6HFMDCTX3TJRBW45YQBX3DLKKTG66SYFPT4JAK5WDA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.884151988 (75h10m56.843249225s) [noise=true , address=104.36.82.39:4757 , piece_id=FNWSV26LSVZR3ZJI46CXVNCK3YQ6BZP3L36UOXYQFZRT5LLI7VFA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.898640071 (75h10m56.857737306s) [noise=true , address=104.36.82.8:4992 , piece_id=DGNDOQOUQWPPGEJMCNODRVV5YAPRPKCRY3CW6XG5CWKOSZDZT6WQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.913294160 (75h10m56.872391406s) [noise=true , address=104.36.82.47:4533 , piece_id=D2L7ZZPLKUIZG7KABDIYM3W7V5P7NVL6Y755FTAFKGAO6XX4P2DQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.914244412 (75h10m56.873341657s) [noise=true , address=104.36.82.16:4306 , piece_id=HA5IP5IVSWR2MG4ZVTBPP72A5W46NQCTUV4YH4WX27UPD5MQSPBQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:34.948679816 (75h10m56.907777085s) [noise=true , address=104.36.82.54:4175 , piece_id=JATVZPTYQFEU2T5JPEY4AMMF5V32FFCGVYK4FPGSTXA5QVWFCBIA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017103899 (75h10m56.976201133s) [noise=true , address=104.36.82.23:4460 , piece_id=RU44VYCUJKFKEGRBCIJL43IS353AER4SJYERVVW6CVHA7IHQODWQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: <nil>
Aug 11 20:36:35.017130218 (75h10m56.976227453s) [seg_pos={0 0}, upload=78372]: Segment reached optimal threshold of 14 pieces.
Aug 11 20:36:35.017339322 (75h10m56.976436569s) [noise=true , address=104.36.82.42:4828 , piece_id=Y64OMTXDEQYQUYXXBXC4IWULKNNFFBE3OCHVNFZM5GEUFQ4BIMMA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cX7FtKC8KMopnX9zvkT6fYdnutK84cFjLW6xMwpXuGsqpiN8k): protocol: expected piece hash; context canceled; EOF
Aug 11 20:36:35.017444187 (75h10m56.976541423s) [noise=true , address=64.49.13.155:4915 , piece_id=FOQA63I6AXGNSJNVHRADLAYPZWQJZAN5QPJQ2XXJRNQ447PPMVDQ, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40550->64.49.13.155:4915: use of closed network connection
Aug 11 20:36:35.017521401 (75h10m56.976618648s) [noise=true , address=64.49.13.170:4724 , piece_id=H6CQELCKTGUMBEBOLG6XFSHDHFGEHELUDQYJZKAPD3AQUYAM3QJA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14PcTyh7AVMhBoXsMPEh9GaTkuJGB8NoDp8jMkQFANKxdAuhtL): protocol: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36132->64.49.13.170:4724: use of closed network connection
Aug 11 20:36:35.017600164 (75h10m56.97669741s) [noise=true , address=66.23.193.175:4563 , piece_id=4PVGUVRFR5ZUKCBVXLM4O5NET6HKALSMORLQ3O6DIZPWONSYVISA, seg_pos={0 0}, upload=78372]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PXSB6KpVLxLRKXjPkcdHSwNscP28RyZshGQs8tUK4kNohkU7M): protocol: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40018->66.23.193.175:4563: use of closed network connection
Aug 11 20:36:35.017665460 (75h10m56.976762709s) [seg_pos={0 0}, upload=78372]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 11 20:36:35.017783413 (75h10m56.976880658s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 11 20:36:35.017789412 (75h10m56.976886657s) [upload=78372]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 11 20:36:35.294196806 (75h10m57.253294042s) [upload=78372]: Done uploading segments...
Aug 11 20:36:35.294239739 (75h10m57.253336991s) [upload=78372]: Upload finished. err: <nil>
Duration: 2.626762378s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
993.224751ms
FAIL (2025-08-11 20:36:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 993.265659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................X................X.............] duration:
3.043034725s
FAIL (2025-08-11 20:35:44 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.043121623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.064291199s
FAIL (2025-08-11 20:35:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.064350286s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................X................X............] duration:
2.57119989s
FAIL (2025-08-11 20:34:33 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.571233954s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.428406701s
FAIL (2025-08-11 20:34:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.428466655s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................X................X...........] duration:
12.09456709s
FAIL (2025-08-11 20:33:36 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 12.094641171s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
931.072295ms
FAIL (2025-08-11 20:32:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 931.107622ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................X................X..........] duration:
2.47574231s
FAIL (2025-08-11 20:32:51 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.475770319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................X................X.........] duration:
2.776183672s
FAIL (2025-08-11 20:32:07 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.776221622s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
910.112426ms
FAIL (2025-08-11 20:31:58 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 910.139892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................................X................X........] duration:
3.073927476s
FAIL (2025-08-11 20:31:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 3.073956174s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
892.529289ms
FAIL (2025-08-11 20:30:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 892.558301ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.005779128s
FAIL (2025-08-11 20:30:26 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 1.00581113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................................X................X.......] duration:
2.638994197s
FAIL (2025-08-11 20:30:19 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.639055398s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................................X................X......] duration:
2.563609744s
FAIL (2025-08-11 20:29:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.56364068s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X..............................................X............] duration:
963.896407ms
FAIL (2025-08-11 20:29:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 20:21:16.544720460 (74h55m38.503817705s) [upload=78106]: Starting upload Aug 11 20:21:16.544794067 (74h55m38.503891312s) [upload=78106]: Done starting upload Aug 11 20:21:16.544880915 (74h55m38.503978154s) [upload=78106]: Uploading segments... Aug 11 20:21:16.544929190 (74h55m38.504026444s) [upload=78106]: Got next segment. Inline: true Aug 11 20:21:16.544935446 (74h55m38.504032691s) [upload=78106]: Waiting for error group managing segments... Aug 11 20:21:16.544995047 (74h55m38.504092292s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:21:16.545000213 (74h55m38.504097458s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 11 20:21:16.545007144 (74h55m38.504104389s) [upload=78106]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 11 20:21:16.691040987 (74h55m38.650138236s) [upload=78106]: Done uploading segments... Aug 11 20:21:16.691083478 (74h55m38.650180717s) [upload=78106]: Upload finished. err: <nil>
Duration: 963.924129ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration:
2.540773159s
FAIL (2025-08-11 20:29:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 11 20:25:56.965305317 (75h0m18.924402573s) [upload=78187]: Starting upload Aug 11 20:25:56.965417768 (75h0m18.924515025s) [upload=78187]: Done starting upload Aug 11 20:25:56.965609492 (75h0m18.924706746s) [upload=78187]: Uploading segments... Aug 11 20:25:56.965905467 (75h0m18.9250027s) [upload=78187]: Got next segment. Inline: false Aug 11 20:25:56.965992694 (75h0m18.925089941s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 11 20:25:56.965998536 (75h0m18.925095782s) [upload=78187]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 11 20:25:57.052888804 (75h0m19.011986059s) [upload=78187]: Next segment err: metaclient: Too Many Requests Aug 11 20:25:57.052917853 (75h0m19.012015108s) [upload=78187]: Done uploading segments... Aug 11 20:25:57.052935821 (75h0m19.012033052s) [upload=78187]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.5408051s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|