Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.................X.X..........] duration: 2.423696815s FAIL (2025-08-08 03:50:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.423781689s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 846.287431ms FAIL (2025-08-08 03:50:46 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 846.327587ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.................X.X.........] duration: 2.405989152s FAIL (2025-08-08 03:50:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.40601752s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 822.965989ms FAIL (2025-08-08 03:50:14 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 822.996243ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.................X.X........] duration: 2.34235395s FAIL (2025-08-08 03:49:26 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.342383574s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X...................................X.......................] duration: 1.034747669s FAIL (2025-08-08 03:49:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 1.034837873s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X...................................X......................] duration: 830.370491ms FAIL (2025-08-08 03:49:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 830.401184ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.................X.X.......] duration: 2.406388313s FAIL (2025-08-08 03:48:39 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.406431104s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.................X.X......] duration: 2.411235634s FAIL (2025-08-08 03:48:24 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.411268951s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.................X.X.....] duration: 2.409140322s FAIL (2025-08-08 03:47:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.409167043s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X...................................X.....................] duration: 817.744752ms FAIL (2025-08-08 03:47:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 817.761825ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X...................................X....................] duration: 871.202951ms FAIL (2025-08-08 03:47:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 871.228092ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.................X.X....] duration: 2.258890901s FAIL (2025-08-08 03:47:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.258924272s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X...................................X...................] duration: 838.553056ms FAIL (2025-08-08 03:46:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 838.581269ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.................X.X...] duration: 2.492627257s FAIL (2025-08-08 03:46:03 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.492686777s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X...................................X..................] duration: 857.035723ms FAIL (2025-08-08 03:45:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 857.065493ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.................X.X..] duration: 2.327871216s FAIL (2025-08-08 03:45:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.327901315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X...................................X.................] duration: 847.409086ms FAIL (2025-08-08 03:45:08 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 847.437764ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.................X.X.] duration: 2.578007226s FAIL (2025-08-08 03:44:48 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.57802944s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.................X.X] duration: 2.722282913s FAIL (2025-08-08 03:44:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 8079f3d1950d916703abff7c1f846054e1e9287db1ba0ad31eb1db0a5e5cef7a != before a6eae98869e8de798352c5a4e59f88b0aba85b591af8a54d580e3c9ed7d6821f ======LOGS====== 18h4m42.644341515s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:44:20.900296040 (18h4m42.644352893s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:44:21.095602131 (18h4m42.839658996s) [seg_pos={0 0}, upload=18651]: Begin upload segment... Aug 8 03:44:21.095687683 (18h4m42.83974453s) [seg_pos={0 0}, upload=18651]: Done begin upload segment. Aug 8 03:44:21.095698755 (18h4m42.839755602s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095708251 (18h4m42.839765114s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.095786576 (18h4m42.839843448s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096265256 (18h4m42.84032222s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.096853216 (18h4m42.840910082s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098199045 (18h4m42.842255905s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.098641701 (18h4m42.842698571s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099090809 (18h4m42.843147673s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.099697020 (18h4m42.843753871s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100111641 (18h4m42.844168514s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.100564049 (18h4m42.844620902s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101023019 (18h4m42.845079888s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101464577 (18h4m42.845521447s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.101954423 (18h4m42.846011301s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102426364 (18h4m42.846483234s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.102950828 (18h4m42.847007703s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103463661 (18h4m42.847520537s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.103870199 (18h4m42.847927069s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Uploading piece... Aug 8 03:44:21.664420997 (18h4m43.408477847s) [upload=18651]: Next returned nil segment Aug 8 03:44:21.664436758 (18h4m43.408493608s) [upload=18651]: Waiting for error group managing segments... Aug 8 03:44:21.806475043 (18h4m43.550531904s) [noise=true , address=45.91.116.10:4101 , piece_id=BGGNAB677CXKLPLCKJ52ZYFWAOAS6ZSZ7F7MIY2WOLIZIHZP3OSQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.817153158 (18h4m43.561210007s) [noise=true , address=104.36.82.8:4975 , piece_id=NIXSGAAQJICCRDQW6CSAT2BJAF4TQSXHGOY7XGSZBQXGMIISXYEQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.829454312 (18h4m43.573511176s) [noise=true , address=104.36.82.44:4875 , piece_id=LT5BD5CGXV7KXHCM37GF34IOU3TPRY4MDSEEXATJZJACNPEDSVDQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.830107914 (18h4m43.574164769s) [noise=true , address=104.36.82.37:4656 , piece_id=NPCKVEMBYQNR7LDVOYZJ37CNHW4ZZUM6LRAZUBYSRZ5ELZJPFGJA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.840908403 (18h4m43.584965268s) [noise=true , address=104.36.82.60:4363 , piece_id=WMZGZ4QGZERPTEJFVNBQSWYI2KPG6SB3YDQMTLN7HQ4XKF5PY6KQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.841978283 (18h4m43.586035145s) [noise=true , address=104.36.82.47:4521 , piece_id=54GNSOTKU3BMZBJ6GASUVDATYCQHU5IWZ6PIDAZUT44OASWLAKZQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.845627421 (18h4m43.589684271s) [noise=true , address=104.36.82.9:4010 , piece_id=7TYDP3IDACP3V4ARIROVCW6CJJN4EVBKDKC52DR2B5QXW453HDPA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847232419 (18h4m43.591289271s) [noise=true , address=104.36.82.43:4848 , piece_id=HEUSKKU2UYLJT6CLBFULTWSKRFUDQL66QYHF6GZCQH6AD75COUMA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.847252762 (18h4m43.591309614s) [noise=true , address=104.36.82.36:4626 , piece_id=L4XWIYOJM34SPOXP7OLAECBU5FYPJ2ZREVQVBQHSWMWSYTWQ6HHQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.860502816 (18h4m43.604559674s) [noise=true , address=104.36.82.61:4401 , piece_id=MXLFFKXWQL5ITOPQPEROWKWTVSKMPQTTHQ7CSK7RD5KBO4XHAAYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.864762662 (18h4m43.608819516s) [noise=true , address=104.36.82.62:4439 , piece_id=LTB6SQ3LAXOGRDTAE7X2DKO7Y3OLNWZLRR6DMLORXAHNPXU2Z4SQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.865356423 (18h4m43.609413284s) [noise=true , address=104.36.82.44:4880 , piece_id=VVKXRW67OMYPB2ON6KHCYS74RQGFHJV3WYIFQHH6IUI43NZESDDA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.897040452 (18h4m43.641097306s) [noise=true , address=104.36.82.23:4464 , piece_id=66KUFXOLJX4IZG4A7KLIJCXWE6PS6XUJ6CQD4MINRK42MJEGEURA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899779340 (18h4m43.64383619s) [noise=true , address=104.36.82.38:4720 , piece_id=JSV7ZU32I44LALSMSNBU7GM5L4QKMVB4O5WGWTGHDSVIPOZYUGYQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: <nil> Aug 8 03:44:21.899807261 (18h4m43.643864109s) [seg_pos={0 0}, upload=18651]: Segment reached optimal threshold of 14 pieces. Aug 8 03:44:21.900474276 (18h4m43.644531136s) [noise=true , address=104.36.82.4:4828 , piece_id=ABVOBBAMFNJ4SFGMU6C6WDJIHWBU353DXMZ52ZE425MDOLIARYYA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MV49LDqJJn8S7nLwgVSpaYiGKa3BZJYbbge8oRuiXQfbNecaJ): protocol: expected piece hash; context canceled; EOF Aug 8 03:44:21.900630880 (18h4m43.644687729s) [noise=true , address=64.49.13.140:4514 , piece_id=6L7Z6AKCTRMOI7QTDGOQQPJJKPADKTPNYGJ2IHQSUZRCC2II7OQA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WsbDX2Zy8FYnEQtUsYFHSeDHj1DkkGyWBPaxzmReWFzaTejHn): protocol: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:54948->64.49.13.140:4514: use of closed network connection Aug 8 03:44:21.900693414 (18h4m43.644750265s) [noise=true , address=64.49.13.26:4951 , piece_id=SBDDZTTXVXYADFVRNO3LWBEWGEVMSX223KO2UVXYGVQTFXURC6XA, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Dx5yKZASRxqTQW6a44Pe5zSZxvwCMHwafwJLrkwFC3aRiEjWt): protocol: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:41078->64.49.13.26:4951: use of closed network connection Aug 8 03:44:21.901097205 (18h4m43.645154086s) [noise=true , address=64.49.13.138:4486 , piece_id=ROW5ND5URCLX2GAUHZPOAN7L6C5LRLIILUMEUMAOVPMEXQMRIJLQ, seg_pos={0 0}, upload=18651]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126i47Q2ngKd79VRwsSQXZn3QTrJfmvZAQdK6yqFWXkCo5ba26g): protocol: context canceled Aug 8 03:44:21.901130702 (18h4m43.645187576s) [seg_pos={0 0}, upload=18651]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:44:21.901266322 (18h4m43.645323188s) [upload=18651]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:44:21.901273935 (18h4m43.645330824s) [upload=18651]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:44:22.229611039 (18h4m43.973667909s) [upload=18651]: Done uploading segments... Aug 8 03:44:22.229651834 (18h4m43.97370868s) [upload=18651]: Upload finished. err: <nil> Duration: 2.722342681s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X...................................X................] duration: 843.243104ms FAIL (2025-08-08 03:44:01 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 843.294595ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.................X.] duration: 2.303143444s FAIL (2025-08-08 03:43:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 209 (18h3m3.048335075s) [upload=18623]: Done starting upload Aug 8 03:42:41.304507781 (18h3m3.048564633s) [upload=18623]: Uploading segments... Aug 8 03:42:41.304579666 (18h3m3.048636526s) [upload=18623]: Got next segment. Inline: false Aug 8 03:42:41.304623635 (18h3m3.048680485s) [upload=18623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:42:41.304632740 (18h3m3.04868959s) [upload=18623]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:42:41.507019951 (18h3m3.25107682s) [seg_pos={0 0}, upload=18623]: Begin upload segment... Aug 8 03:42:41.507091731 (18h3m3.251148584s) [seg_pos={0 0}, upload=18623]: Done begin upload segment. Aug 8 03:42:41.507107178 (18h3m3.251164048s) [noise=true , address=104.36.82.46:4495 , piece_id=AX2EQ5OURSV5QOFYYCAWXWSR3PRULP27POGIRMLDUGQR72MW3C3Q, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507119070 (18h3m3.251175943s) [noise=true , address=104.36.82.36:4631 , piece_id=S6B5QAQ3BTZXW4YMTEXCXKAP4AAKQ7B7ROS5HYDA5WTRIWQVWUSA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507198878 (18h3m3.251255745s) [noise=true , address=104.36.82.47:4546 , piece_id=OL5NFYPO6T2GH2ZZ6UML5GX7I5AQ55ZPVRSTFT3UMBE3AVJNFZFQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507719698 (18h3m3.251776567s) [noise=true , address=104.36.82.44:4901 , piece_id=IY4TINB5Y7COJ5QOCHLXCSA2VLQZF6YHMMFZY73LBRI6QSSGKVIQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507727081 (18h3m3.251783954s) [noise=true , address=104.36.82.38:4704 , piece_id=GAR525D5UPCTT3LFY5VDMWAP762OUS5NICN3R5HNPAYSVOWFSVNQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508132563 (18h3m3.252189435s) [noise=true , address=104.36.82.62:4419 , piece_id=73BDCBWAREXHWDEGDXJ3VNYAL5P72QN5OMZITYKZKGO47ZKYPMWA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508510094 (18h3m3.252566968s) [noise=true , address=104.36.82.60:4340 , piece_id=MRGUGDRNR4DO2J6WJ2V5RXYHS5A43L65QGYOLKQEQHVSN3I75HGQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508852882 (18h3m3.252909751s) [noise=true , address=104.36.82.6:4902 , piece_id=KOZJWWTAQCJQD2L5IQYKNRW75CPECTODZKGDPEIHNQQV2RM3V7DA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509187019 (18h3m3.253243889s) [noise=true , address=104.36.82.14:4239 , piece_id=KT6FFVWJYK3ASS77D4EQMNALG2QGK7NLSEP3WZJ2RR3FEBDG5GRA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509606674 (18h3m3.253663546s) [noise=true , address=104.36.82.58:4287 , piece_id=BNOZGTW65DVQ6JWTQHEDSQ7M257NJBOLYZWLFD67FQTG3MCGQL3Q, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509856232 (18h3m3.253913097s) [noise=true , address=104.36.82.59:4308 , piece_id=JEQ4NE2FT7RSXMOBJO3NXQBQTUP6BVDKVEUXGOKV7S6UKWUFALTA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.510359179 (18h3m3.254416049s) [noise=true , address=104.36.82.5:4851 , piece_id=63S63JECOCZHEWWM6O4CYO7LQQWKQHE5JLYYYANP7XPPMTJGUVWQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.510865690 (18h3m3.254922557s) [noise=true , address=104.36.82.5:4858 , piece_id=LXB36EZETDT3N5NMWRFT5Q37RPVJDYLSJPCGVGR2NY4PKXVK62VA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511016747 (18h3m3.25507362s) [noise=true , address=45.91.116.6:4002 , piece_id=3XV52HQRSATOFTL562TUAYU4S7GAOWWW6V3V5XBYQTDXKGRO3TJQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511417316 (18h3m3.255474191s) [noise=true , address=104.36.82.61:4383 , piece_id=AVHIHB54JC7GENXR7LIBNAOPQB2SJZE5JZMQ4IZHVD65OVLYVSCQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511792439 (18h3m3.255849312s) [noise=true , address=64.49.13.155:4915 , piece_id=4DLYE7ZDUWTFDVB2FGORMJEUZXACIXGC4MZH6QYW7H3SE2DXIWZQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.512158360 (18h3m3.256215231s) [noise=true , address=104.36.82.12:4184 , piece_id=AVZF5WZNM2F55PYVV72ZTQSAP55LOLE6XPUCW6QTLUGOM6RHGUCA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.512532070 (18h3m3.256588941s) [noise=true , address=104.36.82.43:4850 , piece_id=GHK5ZOF32OHHS3XBIGQUTLZBD3M3HPD2K3NIVBRD42ZQVWKNT3LA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:42.042106086 (18h3m3.78616295s) [upload=18623]: Next returned nil segment Aug 8 03:42:42.042129618 (18h3m3.786186469s) [upload=18623]: Waiting for error group managing segments... Aug 8 03:42:42.214772191 (18h3m3.958829052s) [noise=true , address=45.91.116.6:4002 , piece_id=3XV52HQRSATOFTL562TUAYU4S7GAOWWW6V3V5XBYQTDXKGRO3TJQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.229045008 (18h3m3.97310187s) [noise=true , address=104.36.82.5:4851 , piece_id=63S63JECOCZHEWWM6O4CYO7LQQWKQHE5JLYYYANP7XPPMTJGUVWQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.235789734 (18h3m3.979846587s) [noise=true , address=104.36.82.61:4383 , piece_id=AVHIHB54JC7GENXR7LIBNAOPQB2SJZE5JZMQ4IZHVD65OVLYVSCQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.236799729 (18h3m3.980856583s) [noise=true , address=104.36.82.60:4340 , piece_id=MRGUGDRNR4DO2J6WJ2V5RXYHS5A43L65QGYOLKQEQHVSN3I75HGQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.237510754 (18h3m3.981567608s) [noise=true , address=104.36.82.43:4850 , piece_id=GHK5ZOF32OHHS3XBIGQUTLZBD3M3HPD2K3NIVBRD42ZQVWKNT3LA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.238987526 (18h3m3.983044379s) [noise=true , address=104.36.82.14:4239 , piece_id=KT6FFVWJYK3ASS77D4EQMNALG2QGK7NLSEP3WZJ2RR3FEBDG5GRA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.240055847 (18h3m3.984112694s) [noise=true , address=104.36.82.59:4308 , piece_id=JEQ4NE2FT7RSXMOBJO3NXQBQTUP6BVDKVEUXGOKV7S6UKWUFALTA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.248066035 (18h3m3.992122883s) [noise=true , address=104.36.82.5:4858 , piece_id=LXB36EZETDT3N5NMWRFT5Q37RPVJDYLSJPCGVGR2NY4PKXVK62VA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.248141256 (18h3m3.99219811s) [noise=true , address=104.36.82.12:4184 , piece_id=AVZF5WZNM2F55PYVV72ZTQSAP55LOLE6XPUCW6QTLUGOM6RHGUCA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.250820219 (18h3m3.994877073s) [noise=true , address=104.36.82.44:4901 , piece_id=IY4TINB5Y7COJ5QOCHLXCSA2VLQZF6YHMMFZY73LBRI6QSSGKVIQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.253626681 (18h3m3.99768353s) [noise=true , address=104.36.82.38:4704 , piece_id=GAR525D5UPCTT3LFY5VDMWAP762OUS5NICN3R5HNPAYSVOWFSVNQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.253670350 (18h3m3.997727203s) [noise=true , address=104.36.82.6:4902 , piece_id=KOZJWWTAQCJQD2L5IQYKNRW75CPECTODZKGDPEIHNQQV2RM3V7DA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.262469576 (18h3m4.006526444s) [noise=true , address=104.36.82.62:4419 , piece_id=73BDCBWAREXHWDEGDXJ3VNYAL5P72QN5OMZITYKZKGO47ZKYPMWA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.292973983 (18h3m4.037030835s) [noise=true , address=104.36.82.47:4546 , piece_id=OL5NFYPO6T2GH2ZZ6UML5GX7I5AQ55ZPVRSTFT3UMBE3AVJNFZFQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.292996210 (18h3m4.037053062s) [seg_pos={0 0}, upload=18623]: Segment reached optimal threshold of 14 pieces. Aug 8 03:42:42.293419949 (18h3m4.0374768s) [noise=true , address=104.36.82.46:4495 , piece_id=AX2EQ5OURSV5QOFYYCAWXWSR3PRULP27POGIRMLDUGQR72MW3C3Q, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293438738 (18h3m4.0374956s) [noise=true , address=104.36.82.58:4287 , piece_id=BNOZGTW65DVQ6JWTQHEDSQ7M257NJBOLYZWLFD67FQTG3MCGQL3Q, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293577029 (18h3m4.03763389s) [noise=true , address=64.49.13.155:4915 , piece_id=4DLYE7ZDUWTFDVB2FGORMJEUZXACIXGC4MZH6QYW7H3SE2DXIWZQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection Aug 8 03:42:42.293610597 (18h3m4.037667449s) [noise=true , address=104.36.82.36:4631 , piece_id=S6B5QAQ3BTZXW4YMTEXCXKAP4AAKQ7B7ROS5HYDA5WTRIWQVWUSA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T6FqqMunZ46QoxhHVWsn8NinZGWv1Yo7rNHSiK6s9hhuQtS6Y): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293633626 (18h3m4.037690486s) [seg_pos={0 0}, upload=18623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:42:42.293732635 (18h3m4.037789496s) [upload=18623]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:42:42.293740059 (18h3m4.03779692s) [upload=18623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:42:42.535914431 (18h3m4.279971285s) [upload=18623]: Done uploading segments... Aug 8 03:42:42.535945096 (18h3m4.280001945s) [upload=18623]: Upload finished. err: <nil> Duration: 2.303172934s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X...................................X...............] duration: 845.088001ms FAIL (2025-08-08 03:43:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 845.117523ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.................X] duration: 1.715336436s FAIL (2025-08-08 03:42:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== 209 (18h3m3.048335075s) [upload=18623]: Done starting upload Aug 8 03:42:41.304507781 (18h3m3.048564633s) [upload=18623]: Uploading segments... Aug 8 03:42:41.304579666 (18h3m3.048636526s) [upload=18623]: Got next segment. Inline: false Aug 8 03:42:41.304623635 (18h3m3.048680485s) [upload=18623]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:42:41.304632740 (18h3m3.04868959s) [upload=18623]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:42:41.507019951 (18h3m3.25107682s) [seg_pos={0 0}, upload=18623]: Begin upload segment... Aug 8 03:42:41.507091731 (18h3m3.251148584s) [seg_pos={0 0}, upload=18623]: Done begin upload segment. Aug 8 03:42:41.507107178 (18h3m3.251164048s) [noise=true , address=104.36.82.46:4495 , piece_id=AX2EQ5OURSV5QOFYYCAWXWSR3PRULP27POGIRMLDUGQR72MW3C3Q, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507119070 (18h3m3.251175943s) [noise=true , address=104.36.82.36:4631 , piece_id=S6B5QAQ3BTZXW4YMTEXCXKAP4AAKQ7B7ROS5HYDA5WTRIWQVWUSA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507198878 (18h3m3.251255745s) [noise=true , address=104.36.82.47:4546 , piece_id=OL5NFYPO6T2GH2ZZ6UML5GX7I5AQ55ZPVRSTFT3UMBE3AVJNFZFQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507719698 (18h3m3.251776567s) [noise=true , address=104.36.82.44:4901 , piece_id=IY4TINB5Y7COJ5QOCHLXCSA2VLQZF6YHMMFZY73LBRI6QSSGKVIQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.507727081 (18h3m3.251783954s) [noise=true , address=104.36.82.38:4704 , piece_id=GAR525D5UPCTT3LFY5VDMWAP762OUS5NICN3R5HNPAYSVOWFSVNQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508132563 (18h3m3.252189435s) [noise=true , address=104.36.82.62:4419 , piece_id=73BDCBWAREXHWDEGDXJ3VNYAL5P72QN5OMZITYKZKGO47ZKYPMWA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508510094 (18h3m3.252566968s) [noise=true , address=104.36.82.60:4340 , piece_id=MRGUGDRNR4DO2J6WJ2V5RXYHS5A43L65QGYOLKQEQHVSN3I75HGQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.508852882 (18h3m3.252909751s) [noise=true , address=104.36.82.6:4902 , piece_id=KOZJWWTAQCJQD2L5IQYKNRW75CPECTODZKGDPEIHNQQV2RM3V7DA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509187019 (18h3m3.253243889s) [noise=true , address=104.36.82.14:4239 , piece_id=KT6FFVWJYK3ASS77D4EQMNALG2QGK7NLSEP3WZJ2RR3FEBDG5GRA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509606674 (18h3m3.253663546s) [noise=true , address=104.36.82.58:4287 , piece_id=BNOZGTW65DVQ6JWTQHEDSQ7M257NJBOLYZWLFD67FQTG3MCGQL3Q, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.509856232 (18h3m3.253913097s) [noise=true , address=104.36.82.59:4308 , piece_id=JEQ4NE2FT7RSXMOBJO3NXQBQTUP6BVDKVEUXGOKV7S6UKWUFALTA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.510359179 (18h3m3.254416049s) [noise=true , address=104.36.82.5:4851 , piece_id=63S63JECOCZHEWWM6O4CYO7LQQWKQHE5JLYYYANP7XPPMTJGUVWQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.510865690 (18h3m3.254922557s) [noise=true , address=104.36.82.5:4858 , piece_id=LXB36EZETDT3N5NMWRFT5Q37RPVJDYLSJPCGVGR2NY4PKXVK62VA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511016747 (18h3m3.25507362s) [noise=true , address=45.91.116.6:4002 , piece_id=3XV52HQRSATOFTL562TUAYU4S7GAOWWW6V3V5XBYQTDXKGRO3TJQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511417316 (18h3m3.255474191s) [noise=true , address=104.36.82.61:4383 , piece_id=AVHIHB54JC7GENXR7LIBNAOPQB2SJZE5JZMQ4IZHVD65OVLYVSCQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.511792439 (18h3m3.255849312s) [noise=true , address=64.49.13.155:4915 , piece_id=4DLYE7ZDUWTFDVB2FGORMJEUZXACIXGC4MZH6QYW7H3SE2DXIWZQ, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.512158360 (18h3m3.256215231s) [noise=true , address=104.36.82.12:4184 , piece_id=AVZF5WZNM2F55PYVV72ZTQSAP55LOLE6XPUCW6QTLUGOM6RHGUCA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:41.512532070 (18h3m3.256588941s) [noise=true , address=104.36.82.43:4850 , piece_id=GHK5ZOF32OHHS3XBIGQUTLZBD3M3HPD2K3NIVBRD42ZQVWKNT3LA, seg_pos={0 0}, upload=18623]: Uploading piece... Aug 8 03:42:42.042106086 (18h3m3.78616295s) [upload=18623]: Next returned nil segment Aug 8 03:42:42.042129618 (18h3m3.786186469s) [upload=18623]: Waiting for error group managing segments... Aug 8 03:42:42.214772191 (18h3m3.958829052s) [noise=true , address=45.91.116.6:4002 , piece_id=3XV52HQRSATOFTL562TUAYU4S7GAOWWW6V3V5XBYQTDXKGRO3TJQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.229045008 (18h3m3.97310187s) [noise=true , address=104.36.82.5:4851 , piece_id=63S63JECOCZHEWWM6O4CYO7LQQWKQHE5JLYYYANP7XPPMTJGUVWQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.235789734 (18h3m3.979846587s) [noise=true , address=104.36.82.61:4383 , piece_id=AVHIHB54JC7GENXR7LIBNAOPQB2SJZE5JZMQ4IZHVD65OVLYVSCQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.236799729 (18h3m3.980856583s) [noise=true , address=104.36.82.60:4340 , piece_id=MRGUGDRNR4DO2J6WJ2V5RXYHS5A43L65QGYOLKQEQHVSN3I75HGQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.237510754 (18h3m3.981567608s) [noise=true , address=104.36.82.43:4850 , piece_id=GHK5ZOF32OHHS3XBIGQUTLZBD3M3HPD2K3NIVBRD42ZQVWKNT3LA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.238987526 (18h3m3.983044379s) [noise=true , address=104.36.82.14:4239 , piece_id=KT6FFVWJYK3ASS77D4EQMNALG2QGK7NLSEP3WZJ2RR3FEBDG5GRA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.240055847 (18h3m3.984112694s) [noise=true , address=104.36.82.59:4308 , piece_id=JEQ4NE2FT7RSXMOBJO3NXQBQTUP6BVDKVEUXGOKV7S6UKWUFALTA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.248066035 (18h3m3.992122883s) [noise=true , address=104.36.82.5:4858 , piece_id=LXB36EZETDT3N5NMWRFT5Q37RPVJDYLSJPCGVGR2NY4PKXVK62VA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.248141256 (18h3m3.99219811s) [noise=true , address=104.36.82.12:4184 , piece_id=AVZF5WZNM2F55PYVV72ZTQSAP55LOLE6XPUCW6QTLUGOM6RHGUCA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.250820219 (18h3m3.994877073s) [noise=true , address=104.36.82.44:4901 , piece_id=IY4TINB5Y7COJ5QOCHLXCSA2VLQZF6YHMMFZY73LBRI6QSSGKVIQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.253626681 (18h3m3.99768353s) [noise=true , address=104.36.82.38:4704 , piece_id=GAR525D5UPCTT3LFY5VDMWAP762OUS5NICN3R5HNPAYSVOWFSVNQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.253670350 (18h3m3.997727203s) [noise=true , address=104.36.82.6:4902 , piece_id=KOZJWWTAQCJQD2L5IQYKNRW75CPECTODZKGDPEIHNQQV2RM3V7DA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.262469576 (18h3m4.006526444s) [noise=true , address=104.36.82.62:4419 , piece_id=73BDCBWAREXHWDEGDXJ3VNYAL5P72QN5OMZITYKZKGO47ZKYPMWA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.292973983 (18h3m4.037030835s) [noise=true , address=104.36.82.47:4546 , piece_id=OL5NFYPO6T2GH2ZZ6UML5GX7I5AQ55ZPVRSTFT3UMBE3AVJNFZFQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: <nil> Aug 8 03:42:42.292996210 (18h3m4.037053062s) [seg_pos={0 0}, upload=18623]: Segment reached optimal threshold of 14 pieces. Aug 8 03:42:42.293419949 (18h3m4.0374768s) [noise=true , address=104.36.82.46:4495 , piece_id=AX2EQ5OURSV5QOFYYCAWXWSR3PRULP27POGIRMLDUGQR72MW3C3Q, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1YpHarCJ3ouMGTs59udhU7az9h68ELEHTa2aTAax2chR2Gux1x): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293438738 (18h3m4.0374956s) [noise=true , address=104.36.82.58:4287 , piece_id=BNOZGTW65DVQ6JWTQHEDSQ7M257NJBOLYZWLFD67FQTG3MCGQL3Q, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wNKharWFFSSsLMd1vZYi6zYEYBe3VT6Z3ikrY7Cjo3xPLUK62): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293577029 (18h3m4.03763389s) [noise=true , address=64.49.13.155:4915 , piece_id=4DLYE7ZDUWTFDVB2FGORMJEUZXACIXGC4MZH6QYW7H3SE2DXIWZQ, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FMmL9u1Semin3xeFS6YLwEoSDGnNDKV2u5DRpm8fyF79MPCtZ): protocol: write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection; write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55420->64.49.13.155:4915: use of closed network connection Aug 8 03:42:42.293610597 (18h3m4.037667449s) [noise=true , address=104.36.82.36:4631 , piece_id=S6B5QAQ3BTZXW4YMTEXCXKAP4AAKQ7B7ROS5HYDA5WTRIWQVWUSA, seg_pos={0 0}, upload=18623]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T6FqqMunZ46QoxhHVWsn8NinZGWv1Yo7rNHSiK6s9hhuQtS6Y): protocol: expected piece hash; context canceled; EOF Aug 8 03:42:42.293633626 (18h3m4.037690486s) [seg_pos={0 0}, upload=18623]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:42:42.293732635 (18h3m4.037789496s) [upload=18623]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:42:42.293740059 (18h3m4.03779692s) [upload=18623]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:42:42.535914431 (18h3m4.279971285s) [upload=18623]: Done uploading segments... Aug 8 03:42:42.535945096 (18h3m4.280001945s) [upload=18623]: Upload finished. err: <nil> Duration: 1.715364985s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X...................................X..............] duration: 852.008322ms FAIL (2025-08-08 03:41:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 852.045114ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.435989794s FAIL (2025-08-08 03:41:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.436020825s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X...................................X.............] duration: 1.031660339s FAIL (2025-08-08 03:41:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 1.031751611s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.305661912s FAIL (2025-08-08 03:40:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.305819744s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X...................................X............] duration: 832.30043ms FAIL (2025-08-08 03:40:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 832.379697ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.325030935s FAIL (2025-08-08 03:40:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.325141491s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X...................................X...........] duration: 834.721941ms FAIL (2025-08-08 03:39:55 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 834.751289ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.395559972s FAIL (2025-08-08 03:39:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.395593822s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X............X...................................X..........] duration: 829.877187ms FAIL (2025-08-08 03:38:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 829.910137ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.420056258s FAIL (2025-08-08 03:38:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.420094669s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.350786002s FAIL (2025-08-08 03:38:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.35081629s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X............X...................................X.........] duration: 831.50361ms FAIL (2025-08-08 03:37:41 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 831.532286ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.351982765s FAIL (2025-08-08 03:37:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.352026674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.407958312s FAIL (2025-08-08 03:36:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.407994108s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X............X...................................X........] duration: 835.339123ms FAIL (2025-08-08 03:36:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 835.379788ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X............X...................................X.......] duration: 1.047356287s FAIL (2025-08-08 03:35:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 1.04739712s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.829133794s FAIL (2025-08-08 03:35:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.829168839s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X............X...................................X......] duration: 846.467281ms FAIL (2025-08-08 03:34:53 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 846.501872ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.317754841s FAIL (2025-08-08 03:34:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.317785977s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X............X...................................X.....] duration: 822.196836ms FAIL (2025-08-08 03:34:11 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 822.242462ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.530867647s FAIL (2025-08-08 03:34:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.530903914s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X............X...................................X....] duration: 1.151665484s FAIL (2025-08-08 03:33:37 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 1.1516959s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.3887708s FAIL (2025-08-08 03:33:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.388875324s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.261588341s FAIL (2025-08-08 03:32:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.261617225s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X............X...................................X...] duration: 1.12987168s FAIL (2025-08-08 03:32:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== 266]: Done uploading segments... Aug 8 03:21:38.082709593 (17h41m59.826766463s) [upload=18266]: Upload finished. err: <nil> Aug 8 03:22:25.300540722 (17h42m47.044597586s) [upload=18279]: Starting upload Aug 8 03:22:25.300611466 (17h42m47.044668319s) [upload=18279]: Done starting upload Aug 8 03:22:25.300713882 (17h42m47.044770737s) [upload=18279]: Uploading segments... Aug 8 03:22:25.300797063 (17h42m47.044853935s) [upload=18279]: Got next segment. Inline: true Aug 8 03:22:25.300803544 (17h42m47.044860393s) [upload=18279]: Waiting for error group managing segments... Aug 8 03:22:25.300863333 (17h42m47.044920183s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:22:25.300868956 (17h42m47.044925807s) [upload=18279]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:22:25.300872185 (17h42m47.044929035s) [upload=18279]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:22:25.440567430 (17h42m47.184624289s) [upload=18279]: Done uploading segments... Aug 8 03:22:25.440608985 (17h42m47.184665848s) [upload=18279]: Upload finished. err: <nil> Aug 8 03:23:27.536243201 (17h43m49.280300062s) [upload=18296]: Starting upload Aug 8 03:23:27.536303183 (17h43m49.280360046s) [upload=18296]: Done starting upload Aug 8 03:23:27.536401405 (17h43m49.280458254s) [upload=18296]: Uploading segments... Aug 8 03:23:27.536474618 (17h43m49.280531482s) [upload=18296]: Got next segment. Inline: true Aug 8 03:23:27.536480024 (17h43m49.280536888s) [upload=18296]: Waiting for error group managing segments... Aug 8 03:23:27.536562610 (17h43m49.280619465s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:23:27.536569595 (17h43m49.280626459s) [upload=18296]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:23:27.536573681 (17h43m49.280630554s) [upload=18296]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:23:27.838111769 (17h43m49.582168616s) [upload=18296]: Done uploading segments... Aug 8 03:23:27.838131022 (17h43m49.582187869s) [upload=18296]: Upload finished. err: <nil> Aug 8 03:24:16.015360295 (17h44m37.759417145s) [upload=18310]: Starting upload Aug 8 03:24:16.015547262 (17h44m37.759604113s) [upload=18310]: Done starting upload Aug 8 03:24:16.015622654 (17h44m37.759679515s) [upload=18310]: Uploading segments... Aug 8 03:24:16.015753349 (17h44m37.75981022s) [upload=18310]: Got next segment. Inline: true Aug 8 03:24:16.015762069 (17h44m37.75981894s) [upload=18310]: Waiting for error group managing segments... Aug 8 03:24:16.015847324 (17h44m37.759904193s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:16.015854912 (17h44m37.759911784s) [upload=18310]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:16.015858807 (17h44m37.759915682s) [upload=18310]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:16.161620086 (17h44m37.905676948s) [upload=18310]: Done uploading segments... Aug 8 03:24:16.161643745 (17h44m37.905700596s) [upload=18310]: Upload finished. err: <nil> Aug 8 03:24:47.535578994 (17h45m9.279635854s) [upload=18322]: Starting upload Aug 8 03:24:47.535639310 (17h45m9.279696174s) [upload=18322]: Done starting upload Aug 8 03:24:47.535704055 (17h45m9.279760901s) [upload=18322]: Uploading segments... Aug 8 03:24:47.535744457 (17h45m9.279801329s) [upload=18322]: Got next segment. Inline: true Aug 8 03:24:47.535749816 (17h45m9.279806677s) [upload=18322]: Waiting for error group managing segments... Aug 8 03:24:47.535788330 (17h45m9.279845191s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:24:47.535792869 (17h45m9.279849732s) [upload=18322]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:24:47.535795818 (17h45m9.279852678s) [upload=18322]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:24:47.835964370 (17h45m9.580021221s) [upload=18322]: Done uploading segments... Aug 8 03:24:47.835984135 (17h45m9.580040984s) [upload=18322]: Upload finished. err: <nil> Aug 8 03:25:44.716589431 (17h46m6.460646291s) [upload=18335]: Starting upload Aug 8 03:25:44.716650466 (17h46m6.460707315s) [upload=18335]: Done starting upload Aug 8 03:25:44.716744418 (17h46m6.460801268s) [upload=18335]: Uploading segments... Aug 8 03:25:44.716794584 (17h46m6.46085145s) [upload=18335]: Got next segment. Inline: true Aug 8 03:25:44.716800091 (17h46m6.46085695s) [upload=18335]: Waiting for error group managing segments... Aug 8 03:25:44.716842974 (17h46m6.460899825s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:25:44.716848536 (17h46m6.460905396s) [upload=18335]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:25:44.716862755 (17h46m6.460919617s) [upload=18335]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:25:44.911141696 (17h46m6.655198546s) [upload=18335]: Done uploading segments... Aug 8 03:25:44.911160806 (17h46m6.655217656s) [upload=18335]: Upload finished. err: <nil> Aug 8 03:26:53.946852208 (17h47m15.690909068s) [upload=18358]: Starting upload Aug 8 03:26:53.946920058 (17h47m15.690976919s) [upload=18358]: Done starting upload Aug 8 03:26:53.946999355 (17h47m15.691056205s) [upload=18358]: Uploading segments... Aug 8 03:26:53.947054469 (17h47m15.691111335s) [upload=18358]: Got next segment. Inline: true Aug 8 03:26:53.947059736 (17h47m15.691116596s) [upload=18358]: Waiting for error group managing segments... Aug 8 03:26:53.947104678 (17h47m15.691161533s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:26:53.947109831 (17h47m15.691166681s) [upload=18358]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:26:53.947114825 (17h47m15.691171685s) [upload=18358]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:26:54.106530137 (17h47m15.850586987s) [upload=18358]: Done uploading segments... Aug 8 03:26:54.106550291 (17h47m15.850607142s) [upload=18358]: Upload finished. err: <nil> Aug 8 03:27:37.560037898 (17h47m59.304094769s) [upload=18370]: Starting upload Aug 8 03:27:37.560129957 (17h47m59.304186824s) [upload=18370]: Done starting upload Aug 8 03:27:37.560269938 (17h47m59.304326825s) [upload=18370]: Uploading segments... Aug 8 03:27:37.560340912 (17h47m59.304397851s) [upload=18370]: Got next segment. Inline: true Aug 8 03:27:37.560347462 (17h47m59.30440433s) [upload=18370]: Waiting for error group managing segments... Aug 8 03:27:37.560419868 (17h47m59.304476737s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:27:37.560426696 (17h47m59.304483569s) [upload=18370]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:27:37.560430929 (17h47m59.304487797s) [upload=18370]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:27:37.759325064 (17h47m59.503381931s) [upload=18370]: Done uploading segments... Aug 8 03:27:37.759366027 (17h47m59.503422896s) [upload=18370]: Upload finished. err: <nil> Aug 8 03:28:05.504290432 (17h48m27.248347292s) [upload=18380]: Starting upload Aug 8 03:28:05.504356724 (17h48m27.248413608s) [upload=18380]: Done starting upload Aug 8 03:28:05.504452235 (17h48m27.248509091s) [upload=18380]: Uploading segments... Aug 8 03:28:05.504520005 (17h48m27.248576875s) [upload=18380]: Got next segment. Inline: true Aug 8 03:28:05.504526810 (17h48m27.248583682s) [upload=18380]: Waiting for error group managing segments... Aug 8 03:28:05.504581092 (17h48m27.248637955s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:28:05.504589417 (17h48m27.248646286s) [upload=18380]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:28:05.504594313 (17h48m27.248651189s) [upload=18380]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:28:05.670102153 (17h48m27.414159024s) [upload=18380]: Done uploading segments... Aug 8 03:28:05.670124334 (17h48m27.414181184s) [upload=18380]: Upload finished. err: <nil> Aug 8 03:29:07.054224742 (17h49m28.798281611s) [upload=18394]: Starting upload Aug 8 03:29:07.054373432 (17h49m28.798430299s) [upload=18394]: Done starting upload Aug 8 03:29:07.054554562 (17h49m28.798611423s) [upload=18394]: Uploading segments... Aug 8 03:29:07.054678454 (17h49m28.798735319s) [upload=18394]: Got next segment. Inline: true Aug 8 03:29:07.054685944 (17h49m28.798742808s) [upload=18394]: Waiting for error group managing segments... Aug 8 03:29:07.054750524 (17h49m28.798807374s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:07.054756228 (17h49m28.798813088s) [upload=18394]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:29:07.054759634 (17h49m28.798816496s) [upload=18394]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:07.426547266 (17h49m29.170604116s) [upload=18394]: Done uploading segments... Aug 8 03:29:07.426566328 (17h49m29.170623179s) [upload=18394]: Upload finished. err: <nil> Aug 8 03:30:20.799336658 (17h50m42.543393522s) [upload=18417]: Starting upload Aug 8 03:30:20.799446157 (17h50m42.543503018s) [upload=18417]: Done starting upload Aug 8 03:30:20.799567334 (17h50m42.543624203s) [upload=18417]: Uploading segments... Aug 8 03:30:20.799667463 (17h50m42.543724334s) [upload=18417]: Got next segment. Inline: true Aug 8 03:30:20.799674881 (17h50m42.543731746s) [upload=18417]: Waiting for error group managing segments... Aug 8 03:30:20.799735298 (17h50m42.543792159s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 8 03:30:20.799741846 (17h50m42.543798713s) [upload=18417]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 8 03:30:20.799745843 (17h50m42.543802705s) [upload=18417]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:30:20.973089954 (17h50m42.717146825s) [upload=18417]: Done uploading segments... Aug 8 03:30:20.973111762 (17h50m42.717168612s) [upload=18417]: Upload finished. err: <nil> Duration: 1.129904205s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.496291579s FAIL (2025-08-08 03:32:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== item: pb.BatchRequestItem_ObjectBegin Aug 8 03:29:37.310481151 (17h49m59.054538016s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 8 03:29:37.528990647 (17h49m59.273047498s) [seg_pos={0 0}, upload=18400]: Begin upload segment... Aug 8 03:29:37.529051471 (17h49m59.273108321s) [seg_pos={0 0}, upload=18400]: Done begin upload segment. Aug 8 03:29:37.529078726 (17h49m59.273135588s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529624652 (17h49m59.273681519s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.529955045 (17h49m59.274012079s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530323387 (17h49m59.274380253s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530858665 (17h49m59.274915526s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.530969685 (17h49m59.275026545s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531605519 (17h49m59.275662379s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.531883124 (17h49m59.275939986s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532248814 (17h49m59.276305677s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532542115 (17h49m59.276598984s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.532753653 (17h49m59.276810513s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533037477 (17h49m59.27709434s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533461647 (17h49m59.277518518s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.533813665 (17h49m59.277870527s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535615774 (17h49m59.279672634s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.535977085 (17h49m59.280033954s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536328460 (17h49m59.28038533s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:37.536629521 (17h49m59.280686382s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Uploading piece... Aug 8 03:29:38.099227149 (17h49m59.843284008s) [upload=18400]: Next returned nil segment Aug 8 03:29:38.099244257 (17h49m59.84330112s) [upload=18400]: Waiting for error group managing segments... Aug 8 03:29:38.235863965 (17h49m59.979920818s) [noise=true , address=45.91.116.10:4110 , piece_id=QJP4AVXG3ZPFZ6I3ETHW7GBBQWB2EJHCFDZNRPHNCJB67LCFD4JA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.246152821 (17h49m59.990209674s) [noise=true , address=45.91.116.11:4132 , piece_id=SKF6OLSPLMMQVRYZMFBKVTD7ZFC2B2TFWAEJOZAX2CR32IMIWAOA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.260650816 (17h50m0.00470768s) [noise=true , address=104.36.82.15:4269 , piece_id=3WYWRWEX5EUPHTOZ5J42M6OEKTQJOE7AGSICDGIK6NXFVAFNLZDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.263382189 (17h50m0.007439036s) [noise=true , address=104.36.82.59:4311 , piece_id=PMPQG7PJRVDAM3XKZXTALTVDBBU2E2DU4BSZA57634GTX7FV4MJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264063560 (17h50m0.008120416s) [noise=true , address=104.36.82.60:4338 , piece_id=COCNXS5TQZUH5TRQSZZ5W2LOOYMBU53BGF577N7EMMWGYX2NHVRQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.264270249 (17h50m0.008327099s) [noise=true , address=104.36.82.46:4503 , piece_id=CIDLDCNBZX32676O7RQQP2IBOLBTCP6QPGGXAGNMYFBXMUBCZQJA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.267882296 (17h50m0.011939159s) [noise=true , address=104.36.82.45:4910 , piece_id=5SGKHMNRVURB7H5TNBUF5DNLOPGFQVII3OXPQ6YYHJ6H4IJAWPHA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.272948461 (17h50m0.017005316s) [noise=true , address=104.36.82.16:4302 , piece_id=JX5PLSDNCMYVP5T6GMEKL52DDYP3PKHXB2CQUEDTAUCDDJJDBWSQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.280292232 (17h50m0.024349083s) [noise=true , address=104.36.82.35:4602 , piece_id=WTM7K3JHW4BHF6HBQWBY6IWDWGPAVOOQ7ITS3RWTH3NDTTIJ3O7Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.281538270 (17h50m0.025595123s) [noise=true , address=104.36.82.37:4676 , piece_id=MNAKVRZ6HDXZTWDFECX5NOSTQN7GRRVYLWALRVFCCJTUHKAXN2HA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.284558590 (17h50m0.028615463s) [noise=true , address=104.36.82.39:4727 , piece_id=GRPSQI4V63TDHYGWC6AIPR4DC5HYGMARX3HKN75O6E4JUXGLSWDA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.286007754 (17h50m0.030064615s) [noise=true , address=104.36.82.43:4865 , piece_id=UJCYD2UT4BLLMQ3QSKF6JJWSFVQ5G2S5MFRLNNZRQI33R4IXUF3A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.292064258 (17h50m0.036121113s) [noise=true , address=104.36.82.12:4184 , piece_id=X2EC4ETD4TT7TNUR5BZQ6QJYCAWQNCR7Y7CXAT3DN3UPXB2R3X4Q, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297439195 (17h50m0.041496057s) [noise=true , address=104.36.82.56:4234 , piece_id=54K43FK5BARSYAJCO565TBJVAQATZSVMCVC4UAOQEFGUVNSLD4NA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: <nil> Aug 8 03:29:38.297474720 (17h50m0.04153158s) [seg_pos={0 0}, upload=18400]: Segment reached optimal threshold of 14 pieces. Aug 8 03:29:38.297616166 (17h50m0.041673027s) [noise=true , address=45.91.116.14:4221 , piece_id=OPAQ3WXCPDHHJI7R323BSGWJRXCNO5FZEJY64NHNI5XAQCBVXUEA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jZ4TRrJvrBgeWJfnpN7tskdv5rPR6LFuSYo814igtdwMDg8ZX): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297834514 (17h50m0.041891389s) [noise=true , address=104.36.82.9:4010 , piece_id=7RNMBLGKTMHRBLHZD2BEZCWGZ7SW3DB7NESQTOWOI7VBKIWKP22A, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19XkukzF8ZCLdHLTYQTYpX5iF4tvT1iM6Zxxs1ZNQ4r5X4ousp): protocol: expected piece hash; context canceled; EOF Aug 8 03:29:38.297891012 (17h50m0.041947873s) [noise=true , address=64.49.13.140:4511 , piece_id=27SOGP76ZLRW2HOBVWLXHTTDYIM3F4BNUUUOXWBQR322XBIE43TQ, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk): protocol: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59414->64.49.13.140:4511: use of closed network connection Aug 8 03:29:38.298030159 (17h50m0.042087027s) [noise=true , address=64.49.13.26:4949 , piece_id=YA7JGSEI2KZEXRQVYZFUTZQARBIKZP6G5JM2ZTTBAPXV52MGBUKA, seg_pos={0 0}, upload=18400]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Cx458PDfMNyV9cjaAX5zZ4WVy8iGZGPyxZraNdQNezK5N3uRa): protocol: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57800->64.49.13.26:4949: use of closed network connection Aug 8 03:29:38.298074279 (17h50m0.042131152s) [seg_pos={0 0}, upload=18400]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 8 03:29:38.298180255 (17h50m0.042237127s) [upload=18400]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 8 03:29:38.298187661 (17h50m0.04224453s) [upload=18400]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 8 03:29:38.493197967 (17h50m0.237254829s) [upload=18400]: Done uploading segments... Aug 8 03:29:38.493217503 (17h50m0.237274353s) [upload=18400]: Upload finished. err: <nil> Duration: 2.496392335s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)