Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.363635655s
FAIL (2025-08-08 03:31:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment...
Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment.
Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment
Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments...
Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection
Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection
Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments...
Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil>
Duration: 2.363676887s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X............X...................................X..] duration:
953.366011ms
FAIL (2025-08-08 03:31:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 953.396691ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X............X...................................X.] duration:
1.284729495s
FAIL (2025-08-08 03:31:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 1.284766514s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.897988204s
FAIL (2025-08-08 03:30:40 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment...
Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment.
Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment
Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments...
Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection
Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection
Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments...
Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil>
Duration: 2.898031574s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X............X...................................X] duration:
679.28785ms
FAIL (2025-08-08 03:30:21 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil>
Duration: 679.320978ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.397905203s
FAIL (2025-08-08 03:30:06 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment...
Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment.
Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment
Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments...
Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection
Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection
Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments...
Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil>
Duration: 2.397951366s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1.768072082s
FAIL (2025-08-08 03:29:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
item: *pb.BatchRequestItem_ObjectBegin
Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment...
Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment.
Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece...
Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment
Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments...
Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil>
Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces.
Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF
Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection
Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection
Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments...
Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil>
Duration: 1.76811941s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........X............X...................................] duration:
1.140759367s
FAIL (2025-08-08 03:29:07 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.140790029s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [............X............X..................................] duration:
869.946297ms
FAIL (2025-08-08 03:28:06 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 869.983896ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X............X.................................] duration:
897.828549ms
FAIL (2025-08-08 03:27:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 897.90621ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X............X................................] duration:
838.563719ms
FAIL (2025-08-08 03:26:54 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 838.594154ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X............X...............................] duration:
872.099149ms
FAIL (2025-08-08 03:25:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 872.133315ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X............X..............................] duration:
986.306282ms
FAIL (2025-08-08 03:24:48 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 986.346713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X............X.............................] duration:
832.426387ms
FAIL (2025-08-08 03:24:16 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 832.459451ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X............X............................] duration:
1.007167622s
FAIL (2025-08-08 03:23:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.007195405s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X............X...........................] duration:
878.965698ms
FAIL (2025-08-08 03:22:25 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 879.001063ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X............X..........................] duration:
893.450065ms
FAIL (2025-08-08 03:21:38 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 893.485921ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X............X.........................] duration:
953.080298ms
FAIL (2025-08-08 03:20:37 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 953.109581ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......................X............X........................] duration:
823.225605ms
FAIL (2025-08-08 03:19:55 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 823.255816ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......................X............X.......................] duration:
1.092778508s
FAIL (2025-08-08 03:19:24 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.092809627s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........................X............X......................] duration:
1.347909282s
FAIL (2025-08-08 03:18:52 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.348138104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........................X............X.....................] duration:
874.45228ms
FAIL (2025-08-08 03:18:08 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 874.493502ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..........................X............X....................] duration:
857.33841ms
FAIL (2025-08-08 03:17:14 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 857.448553ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...........................X............X...................] duration:
1.223869626s
FAIL (2025-08-08 03:16:15 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.223904212s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X...........................X............X..................] duration:
1.176404207s
FAIL (2025-08-08 03:15:02 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.176462702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X...........................X............X.................] duration:
869.239604ms
FAIL (2025-08-08 03:13:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 869.269891ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.646707861s
FAIL (2025-08-08 03:13:43 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.646736767s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X...........................X............X................] duration:
846.655319ms
FAIL (2025-08-08 03:13:33 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 846.749818ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X...........................X............X...............] duration:
876.388624ms
FAIL (2025-08-08 03:12:31 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 876.42831ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.383462158s
FAIL (2025-08-08 03:12:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.383519636s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.569322482s
FAIL (2025-08-08 03:12:13 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.569358278s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X...........................X............X..............] duration:
999.386855ms
FAIL (2025-08-08 03:11:42 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 999.431306ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.395801188s
FAIL (2025-08-08 03:11:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.395878219s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X...........................X............X.............] duration:
1.795857798s
FAIL (2025-08-08 03:11:23 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.795884491s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X...........................X............X............] duration:
1.757441762s
FAIL (2025-08-08 03:10:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.7574867s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
3.850628938s
FAIL (2025-08-08 03:10:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 3.850716496s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X...........................X............X...........] duration:
853.76713ms
FAIL (2025-08-08 03:10:19 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 853.79967ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X...........................X............X..........] duration:
1.238635539s
FAIL (2025-08-08 03:09:44 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 1.238664122s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.740756067s
FAIL (2025-08-08 03:09:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.740786769s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X...........................X............X.........] duration:
904.912164ms
FAIL (2025-08-08 03:08:35 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 904.942612ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.541006339s
FAIL (2025-08-08 03:08:09 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.541074879s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.538615621s
FAIL (2025-08-08 03:07:47 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.538650198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X...........................X............X........] duration:
884.499376ms
FAIL (2025-08-08 03:07:45 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 884.559615ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.467274449s
FAIL (2025-08-08 03:07:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.467371064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.416832205s
FAIL (2025-08-08 03:07:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.416867722s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X...........................X............X.......] duration:
935.409821ms
FAIL (2025-08-08 03:06:36 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 935.439375ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.376925389s
FAIL (2025-08-08 03:06:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
PSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342501584 (16h48m2.086558453s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.342916493 (16h48m2.086973364s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343055114 (16h48m2.087111981s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343352536 (16h48m2.087409385s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343627201 (16h48m2.087684072s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343665193 (16h48m2.087722061s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.343965739 (16h48m2.088022589s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344289426 (16h48m2.088346276s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344585650 (16h48m2.0886425s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.344861548 (16h48m2.088918411s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345138068 (16h48m2.089194919s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345405593 (16h48m2.089462444s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.345690569 (16h48m2.089747438s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346133210 (16h48m2.090190077s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346539147 (16h48m2.090596019s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.346874740 (16h48m2.090931603s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.347319500 (16h48m2.091376366s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Uploading piece...
Aug 8 02:27:40.917842844 (16h48m2.661899711s) [upload=17347]: Next returned nil segment
Aug 8 02:27:40.917864410 (16h48m2.661921281s) [upload=17347]: Waiting for error group managing segments...
Aug 8 02:27:41.072049952 (16h48m2.816106798s) [noise=true , address=104.36.82.55:4201 , piece_id=LDT6KU4LGSPSK4UWTVD3RN5UWJW4W2MBRRKPU6JRT4TEDSLMKHCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.074218875 (16h48m2.818275725s) [noise=true , address=104.36.82.35:4611 , piece_id=VMWXCUNJ5LW36ZR6BHCINGRGXLJITWUXP5ZUHW23QL54YA2W2YDQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.078427916 (16h48m2.822484764s) [noise=true , address=104.36.82.13:4194 , piece_id=5M3VSGTB477V2BLEM46LDSCZIK2FUOEZDX7QP2WF74XT6HSY2UTQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.079294551 (16h48m2.823351405s) [noise=true , address=104.36.82.18:4385 , piece_id=VM4CGXP7ZISVKNFSDDXLTSJWDR6HV4FRQ22ZMIYVESTVEM4644TA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.085764577 (16h48m2.829821424s) [noise=true , address=104.36.82.23:4460 , piece_id=ZS2CNQZATQLTWID35BLPA6GPGU3O2IHVNVHXN3DEAMTZVLLWRAZA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.088013173 (16h48m2.832070027s) [noise=true , address=77.90.31.10:4548 , piece_id=TQKMQ346TTN7WNTBJKUJ2PUBTYXQMK4WVAHLVJXFKLHXT6Q3PHEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.089671297 (16h48m2.833728158s) [noise=true , address=104.36.82.46:4483 , piece_id=3SQHAF7XE6W34EWPHMRAP6T77A3YZJXAD44JZDISCFGU4NXO3MQA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.091713505 (16h48m2.835770368s) [noise=true , address=104.36.82.19:4404 , piece_id=CYI3B5I6RLJD36AXAFIAQ542ZYEFUXNQB76DH6YXOPSPTAXUUYUQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093169857 (16h48m2.837226707s) [noise=true , address=104.36.82.9:4013 , piece_id=T7DNJFTNONPLIYIIWZ5PHNHFQQ5FIREAIT7V4FGVFFBDPUMMLZCQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.093344756 (16h48m2.837401606s) [noise=true , address=104.36.82.8:4998 , piece_id=EN4MX2REDZ6ZQI3RMDAR5TDV6Y4QCM5NRQNFYPSIN2P6I4L6AXIA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.098668479 (16h48m2.842725335s) [noise=true , address=104.36.82.58:4289 , piece_id=OMAZZ7IEWSYTX2UF23WPDCFVXDNC3DAVC3C73IEU5477TPIF3G6Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.100196867 (16h48m2.844253729s) [noise=true , address=104.36.82.59:4321 , piece_id=U4KFSASP6V47BFRIDPBUJ64U5SLTC6QME4M2GZMRJY7MFXR6YE7A, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.104952669 (16h48m2.84900952s) [noise=true , address=104.36.82.60:4346 , piece_id=JFST757XRLWWPHQNIRSTJFEKHJNDK6CYM5FZMS2WRQTNVJ4JQA2Q, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111712845 (16h48m2.8557697s) [noise=true , address=104.36.82.60:4360 , piece_id=FKMFEPN7WUU7C4GV2EGQLSYWOC4XFSHVE3LFH7PCTQFS6DG7VQEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: <nil>
Aug 8 02:27:41.111737189 (16h48m2.85579404s) [seg_pos={0 0}, upload=17347]: Segment reached optimal threshold of 14 pieces.
Aug 8 02:27:41.112325189 (16h48m2.85638204s) [noise=true , address=79.127.205.233:4633 , piece_id=XBS6EIHLLBZH3NCECW34JQ5Q4PZZTSGOHYUV45GQ2NYZJ2UUUQXA, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1EEYb4mCySvZ54qzmygCQ7hLyTGYpdNJMyrvPvHJjtfGos9usk): protocol: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40112->79.127.205.233:4633: use of closed network connection
Aug 8 02:27:41.112398538 (16h48m2.856455387s) [noise=true , address=79.127.205.246:4264 , piece_id=F7GFQWTSKW552SO3NP4JTRWUJH7QVU7OR4NIH6QMORGCDI5HHOEQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12De7tBCbnbS3RQE3itkMrbuR4sAnm4UaLoXLWcMwi5uHptLq2o): protocol: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:43932->79.127.205.246:4264: use of closed network connection
Aug 8 02:27:41.112436071 (16h48m2.856492925s) [noise=true , address=79.127.205.235:4668 , piece_id=NAX2VBGZIIALURIVGX462CZHKBAPVOSUIXRAQ7QMPQIZQE52IYXQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yq5ghddgLjzQMA9wE5or1W8jtRk3i7swxiCrbwtWYLGztehHk): protocol: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:49978->79.127.205.235:4668: use of closed network connection
Aug 8 02:27:41.112503766 (16h48m2.856560613s) [noise=true , address=64.49.13.154:4934 , piece_id=3HAA4UUU2QHZG46TL2N53ZAPE2SSQP2VAXZVWCB4A2D52K65EDZQ, seg_pos={0 0}, upload=17347]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TEiTVsNxZYEYXCnfZ8h4UiEqCBRBPih3YP5cnEZEMTYoiPEqC): protocol: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52626->64.49.13.154:4934: use of closed network connection
Aug 8 02:27:41.112528234 (16h48m2.856585095s) [seg_pos={0 0}, upload=17347]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 8 02:27:41.112645070 (16h48m2.856701931s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 8 02:27:41.112650603 (16h48m2.856707452s) [upload=17347]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 8 02:27:41.345741844 (16h48m3.089798716s) [upload=17347]: Done uploading segments...
Aug 8 02:27:41.345768960 (16h48m3.089825821s) [upload=17347]: Upload finished. err: <nil>
Duration: 2.376951864s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X...........................X............X......] duration:
822.331954ms
FAIL (2025-08-08 03:06:05 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 822.427847ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X...........................X............X.....] duration:
836.607414ms
FAIL (2025-08-08 03:05:50 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 836.657571ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.............X...........................X............X....] duration:
926.391885ms
FAIL (2025-08-08 03:05:28 UTC)
orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Done uploading segments... Aug 8 02:55:43.920055876 (17h16m5.664112731s) [upload=17826]: Upload finished. err: <nil> Aug 8 02:56:09.873743258 (17h16m31.617800105s) [upload=17830]: Starting upload Aug 8 02:56:09.873795357 (17h16m31.617852217s) [upload=17830]: Done starting upload Aug 8 02:56:09.873868077 (17h16m31.617924923s) [upload=17830]: Uploading segments... Aug 8 02:56:09.873956048 (17h16m31.618012917s) [upload=17830]: Got next segment. Inline: true Aug 8 02:56:09.873961783 (17h16m31.618018629s) [upload=17830]: Waiting for error group managing segments... Aug 8 02:56:09.874020251 (17h16m31.618077111s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:56:09.874027129 (17h16m31.61808399s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:56:09.874029954 (17h16m31.618086814s) [upload=17830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:56:10.066233685 (17h16m31.810290544s) [upload=17830]: Done uploading segments... Aug 8 02:56:10.066251940 (17h16m31.81030879s) [upload=17830]: Upload finished. err: <nil> Aug 8 02:57:18.224676267 (17h17m39.968733113s) [upload=17846]: Starting upload Aug 8 02:57:18.224730383 (17h17m39.968787229s) [upload=17846]: Done starting upload Aug 8 02:57:18.224794752 (17h17m39.968851599s) [upload=17846]: Uploading segments... Aug 8 02:57:18.224835230 (17h17m39.968892096s) [upload=17846]: Got next segment. Inline: true Aug 8 02:57:18.224840192 (17h17m39.968897038s) [upload=17846]: Waiting for error group managing segments... Aug 8 02:57:18.224878657 (17h17m39.968935504s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:18.224883320 (17h17m39.968940166s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:18.224886589 (17h17m39.968943435s) [upload=17846]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:18.614278153 (17h17m40.35833502s) [upload=17846]: Done uploading segments... Aug 8 02:57:18.614302708 (17h17m40.358359569s) [upload=17846]: Upload finished. err: <nil> Aug 8 02:57:46.964450369 (17h18m8.708507219s) [upload=17855]: Starting upload Aug 8 02:57:46.964510581 (17h18m8.708567431s) [upload=17855]: Done starting upload Aug 8 02:57:46.964596863 (17h18m8.708653717s) [upload=17855]: Uploading segments... Aug 8 02:57:46.964656292 (17h18m8.708713166s) [upload=17855]: Got next segment. Inline: true Aug 8 02:57:46.964662699 (17h18m8.708719546s) [upload=17855]: Waiting for error group managing segments... Aug 8 02:57:46.964732990 (17h18m8.708789851s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:57:46.964738883 (17h18m8.708795744s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:57:46.964743701 (17h18m8.708800566s) [upload=17855]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:57:47.143620228 (17h18m8.887677089s) [upload=17855]: Done uploading segments... Aug 8 02:57:47.143651792 (17h18m8.887708643s) [upload=17855]: Upload finished. err: <nil> Aug 8 02:58:22.976633251 (17h18m44.720690112s) [upload=17867]: Starting upload Aug 8 02:58:22.976700101 (17h18m44.720756954s) [upload=17867]: Done starting upload Aug 8 02:58:22.976799593 (17h18m44.720856445s) [upload=17867]: Uploading segments... Aug 8 02:58:22.976839841 (17h18m44.72089671s) [upload=17867]: Got next segment. Inline: true Aug 8 02:58:22.976845513 (17h18m44.720902373s) [upload=17867]: Waiting for error group managing segments... Aug 8 02:58:22.976906562 (17h18m44.720963413s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:22.976915700 (17h18m44.72097255s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:22.976919404 (17h18m44.720976264s) [upload=17867]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:23.131758009 (17h18m44.875814876s) [upload=17867]: Done uploading segments... Aug 8 02:58:23.131797109 (17h18m44.875853973s) [upload=17867]: Upload finished. err: <nil> Aug 8 02:58:54.328956158 (17h19m16.073013019s) [upload=17876]: Starting upload Aug 8 02:58:54.329009994 (17h19m16.073066845s) [upload=17876]: Done starting upload Aug 8 02:58:54.329091385 (17h19m16.073148235s) [upload=17876]: Uploading segments... Aug 8 02:58:54.329140496 (17h19m16.073197365s) [upload=17876]: Got next segment. Inline: true Aug 8 02:58:54.329145485 (17h19m16.073202345s) [upload=17876]: Waiting for error group managing segments... Aug 8 02:58:54.329198569 (17h19m16.073255418s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:58:54.329203868 (17h19m16.073260728s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:58:54.329207468 (17h19m16.073264321s) [upload=17876]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 02:58:54.477718791 (17h19m16.221775644s) [upload=17876]: Done uploading segments... Aug 8 02:58:54.477737526 (17h19m16.221794378s) [upload=17876]: Upload finished. err: <nil> Aug 8 02:59:59.965879174 (17h20m21.709936035s) [upload=17896]: Starting upload Aug 8 02:59:59.965983795 (17h20m21.71004066s) [upload=17896]: Done starting upload Aug 8 02:59:59.966080218 (17h20m21.71013707s) [upload=17896]: Uploading segments... Aug 8 02:59:59.966132822 (17h20m21.710189689s) [upload=17896]: Got next segment. Inline: true Aug 8 02:59:59.966139145 (17h20m21.710196011s) [upload=17896]: Waiting for error group managing segments... Aug 8 02:59:59.966188816 (17h20m21.710245666s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 02:59:59.966194773 (17h20m21.710251626s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 02:59:59.966199000 (17h20m21.710255851s) [upload=17896]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:00.202068298 (17h20m21.946125165s) [upload=17896]: Done uploading segments... Aug 8 03:00:00.202095403 (17h20m21.946152271s) [upload=17896]: Upload finished. err: <nil> Aug 8 03:00:28.677474646 (17h20m50.421531493s) [upload=17903]: Starting upload Aug 8 03:00:28.677584941 (17h20m50.421641802s) [upload=17903]: Done starting upload Aug 8 03:00:28.677687611 (17h20m50.421744466s) [upload=17903]: Uploading segments... Aug 8 03:00:28.677761266 (17h20m50.421818133s) [upload=17903]: Got next segment. Inline: true Aug 8 03:00:28.677767374 (17h20m50.421824277s) [upload=17903]: Waiting for error group managing segments... Aug 8 03:00:28.677823371 (17h20m50.421880276s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:28.677828666 (17h20m50.421885526s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:28.677831611 (17h20m50.421888472s) [upload=17903]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:28.828675797 (17h20m50.572732657s) [upload=17903]: Done uploading segments... Aug 8 03:00:28.828697299 (17h20m50.572754149s) [upload=17903]: Upload finished. err: <nil> Aug 8 03:00:51.167024424 (17h21m12.911081284s) [upload=17911]: Starting upload Aug 8 03:00:51.167110834 (17h21m12.911167706s) [upload=17911]: Done starting upload Aug 8 03:00:51.167188384 (17h21m12.911245235s) [upload=17911]: Uploading segments... Aug 8 03:00:51.167233601 (17h21m12.911290471s) [upload=17911]: Got next segment. Inline: true Aug 8 03:00:51.167239333 (17h21m12.911296193s) [upload=17911]: Waiting for error group managing segments... Aug 8 03:00:51.167294374 (17h21m12.911351225s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:00:51.167299524 (17h21m12.911356386s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:00:51.167303028 (17h21m12.91135989s) [upload=17911]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:00:51.424771818 (17h21m13.168828669s) [upload=17911]: Done uploading segments... Aug 8 03:00:51.424794871 (17h21m13.168851733s) [upload=17911]: Upload finished. err: <nil> Aug 8 03:01:57.518450138 (17h22m19.262506998s) [upload=17928]: Starting upload Aug 8 03:01:57.518503796 (17h22m19.262560661s) [upload=17928]: Done starting upload Aug 8 03:01:57.518580914 (17h22m19.262637762s) [upload=17928]: Uploading segments... Aug 8 03:01:57.518633528 (17h22m19.262690397s) [upload=17928]: Got next segment. Inline: true Aug 8 03:01:57.518639534 (17h22m19.262696394s) [upload=17928]: Waiting for error group managing segments... Aug 8 03:01:57.518694068 (17h22m19.262750928s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:01:57.518699845 (17h22m19.262756705s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:01:57.518703523 (17h22m19.262760383s) [upload=17928]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:01:57.711808712 (17h22m19.455865565s) [upload=17928]: Done uploading segments... Aug 8 03:01:57.711827193 (17h22m19.455884042s) [upload=17928]: Upload finished. err: <nil> Aug 8 03:02:32.152230940 (17h22m53.896287792s) [upload=17941]: Starting upload Aug 8 03:02:32.152349452 (17h22m53.896406313s) [upload=17941]: Done starting upload Aug 8 03:02:32.152473681 (17h22m53.896530531s) [upload=17941]: Uploading segments... Aug 8 03:02:32.152796563 (17h22m53.896853422s) [upload=17941]: Got next segment. Inline: true Aug 8 03:02:32.152806328 (17h22m53.896863189s) [upload=17941]: Waiting for error group managing segments... Aug 8 03:02:32.152877218 (17h22m53.896934079s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 8 03:02:32.152882006 (17h22m53.896938865s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 8 03:02:32.152884826 (17h22m53.896941685s) [upload=17941]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 8 03:02:33.447784059 (17h22m55.19184092s) [upload=17941]: Done uploading segments... Aug 8 03:02:33.447821102 (17h22m55.191877964s) [upload=17941]: Upload finished. err: <nil>
Duration: 926.429998ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|