Orbiter History

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX] duration: 177.252378ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:58:02 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 177.27533ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 184.353825ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:57:50 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 184.38331ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................XX..X.................................] duration: 2.557176115s FAIL (2025-07-18 15:57:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.557208567s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX] duration: 178.152683ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:57:24 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 178.185183ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX..X................................] duration: 2.384810763s FAIL (2025-07-18 15:57:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.384845403s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 171.852438ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:57:14 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 171.954753ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX] duration: 175.714361ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:56:49 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 175.741934ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................XX..X...............................] duration: 2.407289481s FAIL (2025-07-18 15:56:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.407441488s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 175.226675ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:56:29 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 175.254333ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX] duration: 176.541224ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:56:18 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 176.567497ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................XX..X..............................] duration: 2.332517794s FAIL (2025-07-18 15:55:37 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.332553415s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 173.377478ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:55:28 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 173.403063ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX] duration: 186.888064ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:55:13 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 186.912291ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................XX..X.............................] duration: 2.48699616s FAIL (2025-07-18 15:54:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.487025759s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 176.910253ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:54:55 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 176.938368ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 6 out of 60 is failed (threshold=3) [......................................................XXXXXX] duration: 170.912196ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:54:40 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 170.935968ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX..X............................] duration: 2.498880577s FAIL (2025-07-18 15:53:48 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.498915803s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 171.949261ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:53:46 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 171.983397ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 172.587179ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:53:27 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 172.616593ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 178.631376ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:53:05 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 178.658283ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 177.902892ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:53:03 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 177.995896ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................XX..X...........................] duration: 2.368508421s FAIL (2025-07-18 15:52:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.368541451s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 204.636464ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:52:38 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 204.676272ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 196.199481ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:52:32 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 196.264669ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 173.522098ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:52:02 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 173.592755ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 176.006554ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:52:01 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 176.038079ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................XX..X..........................] duration: 2.415828516s FAIL (2025-07-18 15:51:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.415859995s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 173.049414ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 15:51:19 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 173.099817ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 174.373887ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 15:51:18 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 174.408545ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................XX..X.........................] duration: 2.406397883s FAIL (2025-07-18 15:50:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.40643323s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................XX..X........................] duration: 2.467632076s FAIL (2025-07-18 15:50:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.467671064s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................XX..X.......................] duration: 2.480984295s FAIL (2025-07-18 15:50:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.481020514s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................XX..X......................] duration: 2.367803182s FAIL (2025-07-18 15:48:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.367837931s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................XX..X.....................] duration: 2.441324208s FAIL (2025-07-18 15:48:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.441362581s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................XX..X....................] duration: 2.371857601s FAIL (2025-07-18 15:47:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.371910848s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [X...................................XX..X...................] duration: 2.370971131s FAIL (2025-07-18 15:46:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.37102724s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.X...................................XX..X..................] duration: 2.351934442s FAIL (2025-07-18 15:45:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.351958753s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..X...................................XX..X.................] duration: 2.575438958s FAIL (2025-07-18 15:45:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.575470479s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...X...................................XX..X................] duration: 2.398480288s FAIL (2025-07-18 15:44:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.398519117s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X...................................XX..X...............] duration: 2.387302577s FAIL (2025-07-18 15:43:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.387333277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X...................................XX..X..............] duration: 2.412444599s FAIL (2025-07-18 15:42:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.412494513s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X...................................XX..X.............] duration: 2.39361481s FAIL (2025-07-18 15:42:26 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.393654361s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X...................................XX..X............] duration: 2.451958009s FAIL (2025-07-18 15:41:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.45198763s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X...................................XX..X...........] duration: 2.680071566s FAIL (2025-07-18 15:40:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.680126047s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X...................................XX..X..........] duration: 2.357840113s FAIL (2025-07-18 15:40:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.357871436s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X...................................XX..X.........] duration: 2.412338716s FAIL (2025-07-18 15:39:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.412370746s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X...................................XX..X........] duration: 2.384687314s FAIL (2025-07-18 15:38:40 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.384720823s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X...................................XX..X.......] duration: 2.401951502s FAIL (2025-07-18 15:37:56 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.401982461s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.............X...................................XX..X......] duration: 2.407522896s FAIL (2025-07-18 15:37:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.407556587s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [..............X...................................XX..X.....] duration: 2.442222395s FAIL (2025-07-18 15:37:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== BUMKAHO3ZMVDNWVSRRI3GTLM4MO3MP6MNNGUUZKBLBWQ, seg_pos={0 0}, upload=484783]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a): protocol: rpc: dial tcp 77.90.31.13:4628: operation was canceled; context canceled Jul 18 15:31:52.267100372 (606h20m52.150513985s) [seg_pos={0 0}, upload=484783]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 15:31:52.267178520 (606h20m52.150592177s) [upload=484783]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 15:31:52.267184778 (606h20m52.150598408s) [upload=484783]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 15:31:52.565015623 (606h20m52.448429239s) [upload=484783]: Done uploading segments... Jul 18 15:31:52.565033307 (606h20m52.448446919s) [upload=484783]: Upload finished. err: <nil> Jul 18 15:33:00.528847457 (606h22m0.412261094s) [upload=484797]: Starting upload Jul 18 15:33:00.528934444 (606h22m0.412348056s) [upload=484797]: Done starting upload Jul 18 15:33:00.529017539 (606h22m0.412431168s) [upload=484797]: Uploading segments... Jul 18 15:33:00.529303798 (606h22m0.412717427s) [upload=484797]: Got next segment. Inline: false Jul 18 15:33:00.529348408 (606h22m0.41276202s) [upload=484797]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 15:33:00.529353973 (606h22m0.412767599s) [upload=484797]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 15:33:00.640500227 (606h22m0.523913861s) [seg_pos={0 0}, upload=484797]: Begin upload segment... Jul 18 15:33:00.640588551 (606h22m0.524002189s) [seg_pos={0 0}, upload=484797]: Done begin upload segment. Jul 18 15:33:00.640649191 (606h22m0.524062829s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.640953078 (606h22m0.524366715s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641531127 (606h22m0.524944758s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.641980147 (606h22m0.52539378s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642678070 (606h22m0.526091699s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.642961859 (606h22m0.526375491s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643490795 (606h22m0.526904425s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.643733424 (606h22m0.52714705s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644374317 (606h22m0.527787948s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644585121 (606h22m0.527998748s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.644900409 (606h22m0.528314035s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646038897 (606h22m0.529452526s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.646375740 (606h22m0.529789369s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.648944423 (606h22m0.53235805s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.650463350 (606h22m0.533876978s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:00.651369647 (606h22m0.534783267s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Uploading piece... Jul 18 15:33:01.262589342 (606h22m1.146002974s) [upload=484797]: Next returned nil segment Jul 18 15:33:01.262648256 (606h22m1.146061891s) [upload=484797]: Waiting for error group managing segments... Jul 18 15:33:01.398379699 (606h22m1.281793326s) [noise=true , address=77.90.31.14:4661 , piece_id=O3MO7X5TB4UAPQBWVBNPVSI27TUM6VCURHLJG5HEYO4DVVYACIUA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404946640 (606h22m1.288360283s) [noise=true , address=77.90.31.15:4698 , piece_id=2SIXSZXA6GTBEZPTHMVXS6YEXADFV3OH7PCREDLSUEG24POB55NQ, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.404992987 (606h22m1.28840661s) [noise=true , address=45.91.116.4:4939 , piece_id=HJ67GVSKZTLLNZKKNS6INR63O7TQE53H6J57BX5H4GBJQV4NO27Q, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.405551748 (606h22m1.288965369s) [noise=true , address=77.90.31.14:4662 , piece_id=676S3KDOVDPLEXZT5VQUTFLUCESA66V7GK4UQ4DFKIA6MGWMA2EA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.407987418 (606h22m1.291401032s) [noise=true , address=45.91.116.10:4083 , piece_id=GPIYDMSSIX2QCPORQMIJOS7J7RBX2QOZ5HEAUZ5MJ427NLB4XENA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.410553731 (606h22m1.293967362s) [noise=true , address=45.91.116.13:4154 , piece_id=IILXTHASZ3NMX2UVSZ6CXZGSU5WCRNSZVHSAKAANAGKMPK5FPVTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.416771944 (606h22m1.300185579s) [noise=true , address=104.36.82.12:4150 , piece_id=VSQZLUMKIPHBGB43MSZLTAIFXMOIBY6LKJCHFCD437GAGCNXC7OA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.425807204 (606h22m1.309220819s) [noise=true , address=104.36.82.5:4838 , piece_id=FWYXJ44GBR42MQ2EEHOMU5SQD3WDYWD46EILRDAOKA5C6WBYGU5A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.430635732 (606h22m1.314049361s) [noise=true , address=104.36.82.10:4077 , piece_id=Q3YUPZ6EHSM3RQ5MLR6EV33SJEFCCLXJBRIG7BW73K5LCEIS7CTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.433605056 (606h22m1.317018687s) [noise=true , address=104.36.82.14:4221 , piece_id=TMLB47IV22NKLLQNUWT27NG3G5P7IIU3N77AN65UNSYHPFVKWP2A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.440793839 (606h22m1.32420747s) [noise=true , address=45.91.116.12:4227 , piece_id=CJFSTMTP5S2CFJVL3LGHTM6O6CEXSJSE5TQX5EBFZMEZ3VBYMV3A, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:01.446368593 (606h22m1.329782225s) [noise=true , address=45.91.116.7:4009 , piece_id=HTL7WBDRUW7WUB5G64LYFKYSC4ZUX5IJIZK225O5MOE6ZMSH5LYA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: <nil> Jul 18 15:33:30.258196584 (606h22m30.141610202s) [noise=true , address=77.90.31.19:4841 , piece_id=7HWGFOURSOC6JLKAKVYVRJEYJW3WH6FM6NGK5TSERO4ERP5NIHPA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: rpc: dial tcp 77.90.31.19:4841: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258423161 (606h22m30.141836789s) [noise=true , address=77.90.31.19:4842 , piece_id=PFMYCQ5QFJ4YSGYY2QVD56MKIPOJG6VW7EO3QHLKTRB2QJZ7EUTA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:1YHj4FooV9PriUJCKWPDkd47nApVSUBCJwYXWADZodPLbuUZi3, address:77.90.31.19:4842): protocol: write tcp 139.59.144.22:40968->77.90.31.19:4842: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258491071 (606h22m30.1419047s) [noise=true , address=77.90.31.21:4879 , piece_id=ZQMN2UKPJ7D4PJKBVWANUUAHKGTFH4QF5RZZPPWZHDY6MDS3WDFA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: rpc: dial tcp 77.90.31.21:4879: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258527956 (606h22m30.141941579s) [noise=true , address=77.90.31.10:4519 , piece_id=Y6IRD6PE6O4IMHBLBGVVEY2H36M7DQ3RL2WCDIUMJRH2WFTCCPZA, seg_pos={0 0}, upload=484797]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 15:33:30.258553948 (606h22m30.141967578s) [seg_pos={0 0}, upload=484797]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 15:33:30.369475355 (606h22m30.252888992s) [upload=484797]: Done uploading segments... Jul 18 15:33:30.369509072 (606h22m30.252922716s) [upload=484797]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.442256117s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)