Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.284615589s FAIL (2025-07-27 04:28:07 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.284648746s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......X...............................X....X.....X....X....] duration: 1.261549804s FAIL (2025-07-27 04:27:54 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.261579099s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.505161189s FAIL (2025-07-27 04:27:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.505192568s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.340587811s FAIL (2025-07-27 04:27:10 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.340697325s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.373459924s FAIL (2025-07-27 04:26:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.373494097s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [........X...............................X....X.....X....X...] duration: 834.397486ms FAIL (2025-07-27 04:26:56 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 834.431347ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.949596404s FAIL (2025-07-27 04:26:14 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 3.949631764s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.........X...............................X....X.....X....X..] duration: 1.062285065s FAIL (2025-07-27 04:26:04 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.062320996s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.345855558s FAIL (2025-07-27 04:25:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.345903476s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..........X...............................X....X.....X....X.] duration: 1.00493003s FAIL (2025-07-27 04:25:39 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.004993413s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.416562532s FAIL (2025-07-27 04:25:34 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.416595892s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.697991768s FAIL (2025-07-27 04:25:05 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.698051166s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [...........X...............................X....X.....X....X] duration: 1.151021339s FAIL (2025-07-27 04:24:49 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.151086277s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.270070113s FAIL (2025-07-27 04:24:32 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.270181361s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [............X...............................X....X.....X....] duration: 1.18968029s FAIL (2025-07-27 04:24:04 UTC) orbiter warning: digest mismatch: after 3c7376291f202a5466410b45e56d40f97183c274ac7fde84e9f02924c914ad33 != before 44c05ebafdcab7891c13048f16703187bb80677e3983cfcb51062767183d21b9 Duration: 1.189713133s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.382537991s FAIL (2025-07-27 04:23:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.38256997s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.288670007s FAIL (2025-07-27 04:23:36 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.288705826s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.............X...............................X....X.....X...] duration: 836.94182ms FAIL (2025-07-27 04:23:08 UTC) orbiter warning: digest mismatch: after 3c7376291f202a5466410b45e56d40f97183c274ac7fde84e9f02924c914ad33 != before 44c05ebafdcab7891c13048f16703187bb80677e3983cfcb51062767183d21b9 Duration: 837.031765ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.40329924s FAIL (2025-07-27 04:23:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.403342617s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.280124348s FAIL (2025-07-27 04:23:01 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.280177777s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.3433194s FAIL (2025-07-27 04:22:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.343394125s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..............X...............................X....X.....X..] duration: 869.660883ms FAIL (2025-07-27 04:22:42 UTC) orbiter warning: digest mismatch: after 3c7376291f202a5466410b45e56d40f97183c274ac7fde84e9f02924c914ad33 != before 44c05ebafdcab7891c13048f16703187bb80677e3983cfcb51062767183d21b9 Duration: 869.696922ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.313836795s FAIL (2025-07-27 04:22:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.313880765s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X...............................X....X.....X.] duration: 864.209919ms FAIL (2025-07-27 04:21:57 UTC) orbiter warning: digest mismatch: after 3c7376291f202a5466410b45e56d40f97183c274ac7fde84e9f02924c914ad33 != before 44c05ebafdcab7891c13048f16703187bb80677e3983cfcb51062767183d21b9 Duration: 864.262425ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.270055308s FAIL (2025-07-27 04:21:51 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.270086979s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X...............................X....X.....X] duration: 732.252519ms FAIL (2025-07-27 04:21:41 UTC) orbiter warning: digest mismatch: after 3c7376291f202a5466410b45e56d40f97183c274ac7fde84e9f02924c914ad33 != before 44c05ebafdcab7891c13048f16703187bb80677e3983cfcb51062767183d21b9 Duration: 732.288304ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................X...............................X....X.....] duration: 837.814716ms FAIL (2025-07-27 04:21:20 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 837.843627ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 2.292052573s FAIL (2025-07-27 04:21:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.292159687s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.287216324s FAIL (2025-07-27 04:21:08 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.287254771s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.330110795s FAIL (2025-07-27 04:20:50 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.330141563s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.40836487s FAIL (2025-07-27 04:20:40 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.408403189s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................X...............................X....X....] duration: 849.054909ms FAIL (2025-07-27 04:20:11 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 849.101434ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.478651232s FAIL (2025-07-27 04:20:02 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.478689079s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.500914894s FAIL (2025-07-27 04:20:02 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.50096032s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.28260012s FAIL (2025-07-27 04:19:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.282632379s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................X...............................X....X...] duration: 877.367337ms FAIL (2025-07-27 04:19:31 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 877.396711ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.268773688s FAIL (2025-07-27 04:19:17 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.268804801s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................X...............................X....X..] duration: 839.762909ms FAIL (2025-07-27 04:19:11 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 839.792482ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.456769165s FAIL (2025-07-27 04:18:56 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.456806486s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.271840114s FAIL (2025-07-27 04:18:30 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.271872715s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................X...............................X....X.] duration: 856.446599ms FAIL (2025-07-27 04:18:28 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 856.477832ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................X...............................X....X] duration: 733.535275ms FAIL (2025-07-27 04:18:13 UTC) orbiter warning: digest mismatch: after 97cfbff352eccb9f0b3496cf0b067052fe4b4218ebd5dadf8d668955d5c62ed5 != before 7f2a109fe0953172d97204c310442650d3829490d4a21330da6e5c01a52aeaff Duration: 733.563361ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.499853934s FAIL (2025-07-27 04:18:10 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.499887311s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1.672570403s FAIL (2025-07-27 04:17:59 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 1.672608478s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 3.898759977s FAIL (2025-07-27 04:17:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 3.898793893s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X...............................X....] duration: 838.382997ms FAIL (2025-07-27 04:17:28 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 838.435792ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X...............................X...] duration: 846.055409ms FAIL (2025-07-27 04:17:01 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 846.14066ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.352046257s FAIL (2025-07-27 04:16:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.352149681s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X...............................X..] duration: 850.301609ms FAIL (2025-07-27 04:16:20 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 850.333505ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X...............................X.] duration: 869.535909ms FAIL (2025-07-27 04:15:43 UTC) orbiter warning: uplink: object not found ("orbiter_us_0/1K") Duration: 869.568302ms core uplink us1 vivint

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)