Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
845.986956ms
FAIL (2025-08-08 04:09:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 846.024554ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
812.375301ms
FAIL (2025-08-08 04:08:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 812.41147ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.................X.X.................................] duration:
2.486733118s
FAIL (2025-08-08 04:08:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.48676259s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.................X.X................................] duration:
2.865061486s
FAIL (2025-08-08 04:08:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.86509311s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.................X.X...............................] duration:
2.628020894s
FAIL (2025-08-08 04:07:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.62805857s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
857.78633ms
FAIL (2025-08-08 04:07:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 857.875166ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
860.116797ms
FAIL (2025-08-08 04:07:10 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 860.148236ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................X.X..............................] duration:
2.709868556s
FAIL (2025-08-08 04:06:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.70990151s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
1.189328848s
FAIL (2025-08-08 04:06:03 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.189389284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.................X.X.............................] duration:
2.432928209s
FAIL (2025-08-08 04:05:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.432957057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
851.488274ms
FAIL (2025-08-08 04:05:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 851.531044ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
838.292358ms
FAIL (2025-08-08 04:04:56 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 838.325315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X.................X.X............................] duration:
2.65282374s
FAIL (2025-08-08 04:04:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.652854812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.232014101s
FAIL (2025-08-08 04:04:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.23204544s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
828.03237ms
FAIL (2025-08-08 04:04:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 828.065032ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
840.109705ms
FAIL (2025-08-08 04:03:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 840.13746ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X.................X.X...........................] duration:
2.396236528s
FAIL (2025-08-08 04:03:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.396266658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
1.198618053s
FAIL (2025-08-08 04:02:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.19872704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
1.192034212s
FAIL (2025-08-08 04:02:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.192059956s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X.................X.X..........................] duration:
2.377005458s
FAIL (2025-08-08 04:02:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.377036138s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
859.958272ms
FAIL (2025-08-08 04:02:13 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 860.000988ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X.................X.X.........................] duration:
2.566423812s
FAIL (2025-08-08 04:01:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.566459747s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
849.829776ms
FAIL (2025-08-08 04:01:20 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 849.864939ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
859.371649ms
FAIL (2025-08-08 04:01:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 859.412375ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X.................X.X........................] duration:
2.672224707s
FAIL (2025-08-08 04:00:58 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.672256269s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
869.93486ms
FAIL (2025-08-08 04:00:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 869.969124ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
1.065378383s
FAIL (2025-08-08 04:00:04 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.065422939s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X.................X.X.......................] duration:
2.493891228s
FAIL (2025-08-08 03:59:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.494036606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X.................X.X......................] duration:
2.378593533s
FAIL (2025-08-08 03:59:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.378618543s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
821.804119ms
FAIL (2025-08-08 03:59:09 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 821.836667ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
1.153535187s
FAIL (2025-08-08 03:58:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.153747936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..................X.................X.X.....................] duration:
2.856486498s
FAIL (2025-08-08 03:58:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.856528348s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...................X.................X.X....................] duration:
2.540644986s
FAIL (2025-08-08 03:57:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.540681503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
851.911381ms
FAIL (2025-08-08 03:57:40 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 851.943754ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....................X.................X.X...................] duration:
2.391609221s
FAIL (2025-08-08 03:57:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.39163842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.................X.X..................] duration:
2.323451591s
FAIL (2025-08-08 03:56:45 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.323480668s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
815.316256ms
FAIL (2025-08-08 03:56:39 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 815.346626ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
814.537022ms
FAIL (2025-08-08 03:56:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 814.574434ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......................X.................X.X.................] duration:
2.324180767s
FAIL (2025-08-08 03:55:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.32419919s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
854.511345ms
FAIL (2025-08-08 03:55:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 854.551386ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.................X.X................] duration:
2.357003661s
FAIL (2025-08-08 03:55:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.357071205s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
823.367332ms
FAIL (2025-08-08 03:54:53 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 823.394806ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........................X.................X.X...............] duration:
2.413696091s
FAIL (2025-08-08 03:54:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.413748826s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.048327837s
FAIL (2025-08-08 03:53:47 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.048370823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.................X.X..............] duration:
2.536937732s
FAIL (2025-08-08 03:53:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.536969901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
856.45739ms
FAIL (2025-08-08 03:52:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 856.494088ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.................X.X.............] duration:
2.34983075s
FAIL (2025-08-08 03:52:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.349863236s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........................X.................X.X............] duration:
2.394364571s
FAIL (2025-08-08 03:51:46 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.394389906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
831.413882ms
FAIL (2025-08-08 03:51:46 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 831.443404ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............................X.................X.X...........] duration:
2.275530502s
FAIL (2025-08-08 03:51:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f
======LOGS======
18h4m42.644341515s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment...
Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment.
Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece...
Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment
Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments...
Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil>
Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF
Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection
Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection
Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled
Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments...
Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil>
Duration: 2.275656283s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|