Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.427593971s FAIL (2025-07-27 04:51:30 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.427627986s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [............X....X.....X....X............................X..] duration: 1.085042347s FAIL (2025-07-27 04:51:09 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 1.08507779s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.292339539s FAIL (2025-07-27 04:51:07 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.292370913s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.311811725s FAIL (2025-07-27 04:51:05 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.311856597s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.224044869s FAIL (2025-07-27 04:50:32 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.224073708s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [.............X....X.....X....X............................X.] duration: 1.046933825s FAIL (2025-07-27 04:50:14 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 1.046971508s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 4.124390564s FAIL (2025-07-27 04:50:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 4.124424816s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 5 out of 60 is failed (threshold=3) [..............X....X.....X....X............................X] duration: 636.20961ms FAIL (2025-07-27 04:49:35 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 636.242966ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.48116297s FAIL (2025-07-27 04:49:20 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.481195762s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.255516912s FAIL (2025-07-27 04:48:56 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.25554849s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.402421295s FAIL (2025-07-27 04:48:29 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.402493598s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...............X....X.....X....X............................] duration: 948.504803ms FAIL (2025-07-27 04:48:29 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 948.537873ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.293106875s FAIL (2025-07-27 04:48:16 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.293138039s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.291070308s FAIL (2025-07-27 04:47:58 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.291110656s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 2.618774435s FAIL (2025-07-27 04:47:30 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.618807081s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [................X....X.....X....X...........................] duration: 881.969834ms FAIL (2025-07-27 04:47:17 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 882.007434ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.874965608s FAIL (2025-07-27 04:47:05 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.875000554s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.................X....X.....X....X..........................] duration: 1.070990916s FAIL (2025-07-27 04:46:55 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.071025132s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................X....X.....X....X.........................] duration: 835.334542ms FAIL (2025-07-27 04:46:32 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 835.375974ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 3.073390793s FAIL (2025-07-27 04:46:22 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 3.073422118s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.363141918s FAIL (2025-07-27 04:45:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.363199676s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.314349424s FAIL (2025-07-27 04:45:37 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.314381326s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...................X....X.....X....X........................] duration: 908.128761ms FAIL (2025-07-27 04:45:37 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 908.149046ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.29494598s FAIL (2025-07-27 04:45:17 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.294980166s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.447841481s FAIL (2025-07-27 04:44:49 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.447925671s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [....................X....X.....X....X.......................] duration: 864.733736ms FAIL (2025-07-27 04:44:46 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 864.759761ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.....................X....X.....X....X......................] duration: 1.082131576s FAIL (2025-07-27 04:44:29 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.082161724s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.330908281s FAIL (2025-07-27 04:44:07 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.33094101s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.35963149s FAIL (2025-07-27 04:43:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.359666986s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................X....X.....X....X.....................] duration: 868.911834ms FAIL (2025-07-27 04:43:32 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 868.943727ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.343214196s FAIL (2025-07-27 04:43:17 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.343250951s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.264411033s FAIL (2025-07-27 04:43:12 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.264450748s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.39196514s FAIL (2025-07-27 04:42:25 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.392028132s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.264210676s FAIL (2025-07-27 04:42:23 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.264250053s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................X....X.....X....X....................] duration: 959.425318ms FAIL (2025-07-27 04:42:19 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 959.469965ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.298413456s FAIL (2025-07-27 04:41:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.298446559s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.296709661s FAIL (2025-07-27 04:41:44 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.296740343s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.329629524s FAIL (2025-07-27 04:41:32 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.329671672s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................X....X.....X....X...................] duration: 1.073613154s FAIL (2025-07-27 04:41:13 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.073652728s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.360422402s FAIL (2025-07-27 04:41:06 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.360457691s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.328165697s FAIL (2025-07-27 04:40:28 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.328195473s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.309929451s FAIL (2025-07-27 04:40:19 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.309959687s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [.........................X....X.....X....X..................] duration: 840.350654ms FAIL (2025-07-27 04:40:06 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 840.384332ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..........................X....X.....X....X.................] duration: 1.002681695s FAIL (2025-07-27 04:39:49 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 1.002710643s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.508965424s FAIL (2025-07-27 04:39:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.509152585s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.379274869s FAIL (2025-07-27 04:39:20 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.379307023s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.297320978s FAIL (2025-07-27 04:38:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.297438925s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [...........................X....X.....X....X................] duration: 968.754502ms FAIL (2025-07-27 04:38:40 UTC) orbiter warning: digest mismatch: after 62578b2f16f48849c2c7173316940ab944ce7191e347cbb9b847d5cd4bfbd82e != before a6e941883722460dfc59c444db65e43926e7c646796e25dcd74c1ae5335bf085 Duration: 968.853084ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.325294259s FAIL (2025-07-27 04:38:13 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/4M Duration: 2.325332517s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.288332799s FAIL (2025-07-27 04:38:06 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== tchRequestItem_SegmentCommit Jul 27 04:06:49.019613194 (64h31m20.209911773s) [upload=61869]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:06:49.312814006 (64h31m20.503112577s) [upload=61869]: Done uploading segments... Jul 27 04:06:49.312879732 (64h31m20.503178304s) [upload=61869]: Upload finished. err: <nil> Jul 27 04:07:41.242398205 (64h32m12.432696884s) [upload=61883]: Starting upload Jul 27 04:07:41.242528763 (64h32m12.432827346s) [upload=61883]: Done starting upload Jul 27 04:07:41.242646341 (64h32m12.432944926s) [upload=61883]: Uploading segments... Jul 27 04:07:41.243185631 (64h32m12.4334842s) [upload=61883]: Got next segment. Inline: false Jul 27 04:07:41.243245440 (64h32m12.433544011s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 27 04:07:41.243251564 (64h32m12.433550135s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 27 04:07:41.350516168 (64h32m12.540814747s) [seg_pos={0 0}, upload=61883]: Begin upload segment... Jul 27 04:07:41.350564213 (64h32m12.540862778s) [seg_pos={0 0}, upload=61883]: Done begin upload segment. Jul 27 04:07:41.350589810 (64h32m12.540888393s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350690572 (64h32m12.540989162s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.350967365 (64h32m12.541265945s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351263910 (64h32m12.541562492s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351309114 (64h32m12.541607703s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351564776 (64h32m12.541863361s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351849817 (64h32m12.542148406s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.351919444 (64h32m12.542218023s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352251018 (64h32m12.542549598s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352375417 (64h32m12.542674008s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352738202 (64h32m12.543036773s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.352982279 (64h32m12.543280872s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353236043 (64h32m12.543534624s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.353489666 (64h32m12.54378827s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354150266 (64h32m12.544448855s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.354794070 (64h32m12.545092665s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Uploading piece... Jul 27 04:07:41.955902237 (64h32m13.146200808s) [upload=61883]: Next returned nil segment Jul 27 04:07:41.956148980 (64h32m13.146447562s) [upload=61883]: Waiting for error group managing segments... Jul 27 04:07:42.096498836 (64h32m13.286797407s) [noise=true , address=77.90.31.18:4807 , piece_id=RRM33ZJII4D35CGROURSJAEQF3LMM6K3I3NO7XHLUQ2DDTOUV4DA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.098145471 (64h32m13.288444042s) [noise=true , address=45.91.116.5:4297 , piece_id=R57W47T5TJMNFGMILKTNTPEMFWQBKTFUHS3DUDUFY2OJNNB3TRKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.101011760 (64h32m13.29131033s) [noise=true , address=77.90.31.16:4735 , piece_id=H73467HVUEMTC7XLTDOB6QKCQI4AAMW6BFZ3JEMD5QTIPD4HKK2Q, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105140745 (64h32m13.295439318s) [noise=true , address=45.91.116.6:4973 , piece_id=HHY444NAB3CHQ2QM2OYE357G4X23XZMCE6XJ5SVWTNKHSYLE3XFA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.105956214 (64h32m13.296254785s) [noise=true , address=45.91.116.9:4262 , piece_id=SSPX3I3TWORTWGWDWIZQ4X33MT3POTJWMIGAFRZ2CYSC2T6A4DZQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.107763330 (64h32m13.298061899s) [noise=true , address=45.91.116.5:4299 , piece_id=VPRZVZOLSYS6T35DSLDTK7DKHIDGKL72WQFKCEB7IBSMZRLT6PMA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.111825921 (64h32m13.302124504s) [noise=true , address=45.91.116.9:4261 , piece_id=KQZEB3R7SHTZOJYSYSIUPS5XC7GWLBQKF6SEMOLBY727YE766VQQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115398743 (64h32m13.305697313s) [noise=true , address=77.90.31.21:4877 , piece_id=H3XALDLOFSRY5QOY5R3PTGH4JDQ5J4NT5SL4VMM3QRYP6Z43C52A, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.115541521 (64h32m13.305840108s) [noise=true , address=77.90.31.11:4554 , piece_id=DTILT4OVLALBGWIX33QOUL73OGOJPX2C7EFOCS2BBU4VLB3CKLZA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:42.117994155 (64h32m13.308292737s) [noise=true , address=77.90.31.14:4661 , piece_id=ODEXC462GQRD2NQQO4QD46ZI5356VCNFXITYYAAYS3YJE2QTONEA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:54.630811582 (64h32m25.821110147s) [noise=true , address=104.36.82.8:4970 , piece_id=7HPJNYTECBBLNLVHXLAK333ACDLNBKZDBHDDGOG7H6C3NKLJHYKA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:58.782118078 (64h32m29.972416651s) [noise=true , address=104.36.82.6:4875 , piece_id=RAW7XAZ2C7O6WSKRNNYNYGHSG6NRYK2G6JLWJWBN6SLZQS4XRFDA, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677793997 (64h32m30.86809257s) [noise=true , address=104.36.82.5:4837 , piece_id=LVWMXQHVUHESMMAAKRSGMYN7J6TNZ7TDFGVWZ54VSV7CAYYL7TGQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: <nil> Jul 27 04:07:59.677826028 (64h32m30.868124601s) [seg_pos={0 0}, upload=61883]: Segment reached optimal threshold of 13 pieces. Jul 27 04:07:59.678117767 (64h32m30.868416347s) [noise=true , address=104.36.82.11:4113 , piece_id=SI3ASQ4YIN4XBVAFK65YH37NP4EHXG7H6VDNEWS2C5HESKWCPYXQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SQKETWozrz4PcDC3yhy6V5d8Ryo6NNiyWWEkE5xRcmUj9B6UV): protocol: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35892->104.36.82.11:4113: use of closed network connection Jul 27 04:07:59.678216096 (64h32m30.868514667s) [noise=true , address=104.36.82.12:4149 , piece_id=NG7UW5OE7R6JBUXE5U2SDO7DTYMNMFWFGGLRUAHW57AYDANTCADQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12qexRLJM6TY935UaEWsj1X9ViyBvk2BM1XGjnq8kapnXXXmgbm): protocol: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:53962->104.36.82.12:4149: use of closed network connection Jul 27 04:07:59.678236772 (64h32m30.868535355s) [noise=true , address=104.36.82.11:4115 , piece_id=PYZYUFKR3QNJLCOVVIWELSUSGNPOOBXUOC4UIBTU74T6LPDG2YSQ, seg_pos={0 0}, upload=61883]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12DKJTyYZ5om3b3NgCn2HXBwGbN3aoi2fk6gb9H5gAbVbHFaeoR): protocol: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57248->104.36.82.11:4115: use of closed network connection Jul 27 04:07:59.678264646 (64h32m30.868563224s) [seg_pos={0 0}, upload=61883]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 27 04:07:59.678329826 (64h32m30.868628404s) [upload=61883]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 27 04:07:59.678334385 (64h32m30.868632964s) [upload=61883]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 27 04:07:59.852254465 (64h32m31.042553036s) [upload=61883]: Done uploading segments... Jul 27 04:07:59.852275791 (64h32m31.042574364s) [upload=61883]: Upload finished. err: <nil> Duration:* 2.288367471s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)