Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.......X................] duration: 2.426554387s FAIL (2025-07-18 16:42:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.426580761s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.897103ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:42:21 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 172.940874ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.912193ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:42:12 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 172.938123ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 170.513181ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:41:37 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 170.539411ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.779833ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:41:30 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 172.807229ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.......X...............] duration: 2.490985422s FAIL (2025-07-18 16:41:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.491015263s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.......X..............] duration: 2.387185444s FAIL (2025-07-18 16:40:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.387234094s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 173.353804ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:40:51 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 173.392904ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 177.842703ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:40:33 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 177.914012ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.......X.............] duration: 2.331780966s FAIL (2025-07-18 16:40:32 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.331902921s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 206.602903ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:40:12 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 206.630648ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 178.843446ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:39:37 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 178.870716ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.......X............] duration: 2.332227634s FAIL (2025-07-18 16:39:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.332259839s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 179.111443ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:39:00 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 179.140494ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 177.136503ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:38:29 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 177.169509ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.......X...........] duration: 2.357453745s FAIL (2025-07-18 16:38:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.357482517s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 169.649509ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:37:57 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 169.743243ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.......X..........] duration: 2.363032087s FAIL (2025-07-18 16:37:41 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.363165837s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 166.723001ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:37:40 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 166.743319ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.388794ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:36:48 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 172.415452ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.......X.........] duration: 2.589627493s FAIL (2025-07-18 16:36:33 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.589658634s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.340584ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:36:27 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 172.366573ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 59 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 179.257133ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:36:22 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 179.284973ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 58 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 178.939588ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:35:57 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 178.961048ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.503238ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:35:42 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 172.533621ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.......X........] duration: 2.534006438s FAIL (2025-07-18 16:35:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.53403566s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 199.792848ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:35:04 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 199.838952ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 57 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 208.799045ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:34:58 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 208.823347ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 172.227546ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:34:32 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 172.254405ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.......X.......] duration: 2.378985555s FAIL (2025-07-18 16:34:21 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.379031472s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 166.614718ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:34:08 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 166.638986ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 56 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 177.897402ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:34:05 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 177.928127ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.......X......] duration: 2.371800778s FAIL (2025-07-18 16:33:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.371856642s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 59 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 166.614608ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:33:21 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 166.639421ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 55 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 182.841745ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:32:59 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 182.856273ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.......X.....] duration: 2.401314287s FAIL (2025-07-18 16:32:55 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.401356439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X.......X....] duration: 2.359551754s FAIL (2025-07-18 16:32:30 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.359584039s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 58 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 179.310246ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:32:11 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 179.33476ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................X.......X...] duration: 2.414754138s FAIL (2025-07-18 16:32:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.414801203s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 54 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 179.36636ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:32:06 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 179.437366ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 57 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 167.290172ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:31:22 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 167.308062ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X.......X..] duration: 2.358262731s FAIL (2025-07-18 16:31:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.358286298s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 53 out of 60 is failed (threshold=3) [.......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 174.72413ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:31:11 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 174.746832ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 56 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 178.721086ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:30:54 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 178.745978ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X.......X.] duration: 2.383555306s FAIL (2025-07-18 16:30:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 2.383607713s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 52 out of 60 is failed (threshold=3) [........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 171.922252ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:30:15 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 171.945832ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 55 out of 60 is failed (threshold=3) [.....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 188.995075ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:30:02 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 189.108769ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 51 out of 60 is failed (threshold=3) [.........XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 179.037755ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:29:50 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 179.062563ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X.......X] duration: 30.11969182s FAIL (2025-07-18 16:29:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== 9]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: context canceled; context canceled Jul 18 16:28:06.573617088 (607h17m6.457030715s) [seg_pos={0 0}, upload=485529]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:28:06.573709829 (607h17m6.457123445s) [upload=485529]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:28:06.573716041 (607h17m6.457129658s) [upload=485529]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:28:06.724230331 (607h17m6.607643945s) [upload=485529]: Done uploading segments... Jul 18 16:28:06.724250141 (607h17m6.607663755s) [upload=485529]: Upload finished. err: <nil> Jul 18 16:29:19.727355583 (607h18m19.610769209s) [upload=485547]: Starting upload Jul 18 16:29:19.727427333 (607h18m19.61084097s) [upload=485547]: Done starting upload Jul 18 16:29:19.727775544 (607h18m19.611189161s) [upload=485547]: Uploading segments... Jul 18 16:29:19.727840340 (607h18m19.611253975s) [upload=485547]: Got next segment. Inline: false Jul 18 16:29:19.727875280 (607h18m19.611288906s) [upload=485547]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:29:19.727880962 (607h18m19.611294582s) [upload=485547]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:29:19.840919734 (607h18m19.724333363s) [seg_pos={0 0}, upload=485547]: Begin upload segment... Jul 18 16:29:19.840972492 (607h18m19.72438611s) [seg_pos={0 0}, upload=485547]: Done begin upload segment. Jul 18 16:29:19.841004794 (607h18m19.724418434s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841022981 (607h18m19.724436614s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841446916 (607h18m19.724860553s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841470680 (607h18m19.724884316s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841825001 (607h18m19.725238633s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.841863759 (607h18m19.725277377s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842376953 (607h18m19.725790586s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842942175 (607h18m19.726355788s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.842951799 (607h18m19.726365432s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.843362766 (607h18m19.726776393s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.844357136 (607h18m19.727770773s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.845591955 (607h18m19.729005589s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.846972534 (607h18m19.730386169s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.848301465 (607h18m19.731715101s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849163101 (607h18m19.732576738s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:19.849839742 (607h18m19.733253378s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Uploading piece... Jul 18 16:29:20.472725878 (607h18m20.356139509s) [upload=485547]: Next returned nil segment Jul 18 16:29:20.472752679 (607h18m20.35616632s) [upload=485547]: Waiting for error group managing segments... Jul 18 16:29:20.596980167 (607h18m20.480393796s) [noise=true , address=45.91.116.10:4081 , piece_id=ZP3GV7W7B2L2M45V4Y7OOWX6Z4Q4MI5PEX2MHMMY7D4L2PJWR3SQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.600142338 (607h18m20.483555961s) [noise=true , address=45.91.116.14:4189 , piece_id=EDZFMKYC63ABE7V5AE6E4FELMGIWPPPANRNSOFN3GAYE6X6UNUMQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.602409866 (607h18m20.485823483s) [noise=true , address=77.90.31.14:4661 , piece_id=SU2WXUKNOBMJ5HBPOVU44MD2T4PPMUDHTUSHFBQR6PXQNV5KCCIQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.605640089 (607h18m20.489053709s) [noise=true , address=45.91.116.9:4262 , piece_id=5MJOYGUIGLNE24MZCQ2PLX75TT4X4XSSVVVBN3WJH352MT5W64GQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.613715192 (607h18m20.497128805s) [noise=true , address=77.90.31.19:4843 , piece_id=YYCC2RDU5LFZV5HE2BCQGPOMUAPK3BPFLU4KR65D652IQEENQTFA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.653906544 (607h18m20.537320177s) [noise=true , address=104.36.82.5:4839 , piece_id=NWXJQEAAM2TZKJPIJMRB73K6OCI5A4SLHKY74XLPWXFFMW4RO3CQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654343289 (607h18m20.537756909s) [noise=true , address=104.36.82.3:4767 , piece_id=XPYEQ25OR24YS2LO7PUSHL2KFYYRAONBRJOZBYJP77HMM7ONWJ2Q, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654633188 (607h18m20.538046806s) [noise=true , address=104.36.82.14:4222 , piece_id=2TAGHXI3NADLHJQXCRIRY5CM6VMI2BHRPT7C6S7Y7TSPC2MGTXSQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.654929539 (607h18m20.538343156s) [noise=true , address=104.36.82.14:4223 , piece_id=34IMOFVRIMVWGSZ2LJE5PYORVNQD4H3BQQNL5I2QTHD6LNB2MEPQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655173635 (607h18m20.538587262s) [noise=true , address=104.36.82.7:4911 , piece_id=INO4Q54WEULMMEAEG73QKVN4A6LLN4Z7CRJZTSLRBUDZ4NR4YHZA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655659265 (607h18m20.539072881s) [noise=true , address=45.91.116.5:4297 , piece_id=XFZUDFYDRRBBVSW6SS75DZHJHT7GS2DKPXJZCLIF7IDSYZWLSYVQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:20.655717213 (607h18m20.53913084s) [noise=true , address=104.36.82.12:4151 , piece_id=4I5GEGRSL7PVJE55J5EC3MPDL2ZII74ZFO6KFOCBUZ4WS7KU3F5A, seg_pos={0 0}, upload=485547]: Done uploading piece. err: <nil> Jul 18 16:29:49.451525389 (607h18m49.334939016s) [noise=true , address=77.90.31.18:4806 , piece_id=6SFVUK4MQG27S35PSQXZHPWUVEYXQG2QHI7TIVSKVL7M4BGO5KSA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1gJNAhKazJp5TabeEkXsEUFjoBu87mfYDBdeKhfGi4gub3yaSJ, address:77.90.31.18:4806): protocol: write tcp 139.59.144.22:35536->77.90.31.18:4806: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451613960 (607h18m49.335027587s) [noise=true , address=77.90.31.11:4553 , piece_id=KYYATSWOYX5R7SKM67PJBA2QZC7PRRNJJ7GKPYLZBOTOZ2J6WFYQ, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz, address:77.90.31.11:4553): protocol: write tcp 139.59.144.22:36256->77.90.31.11:4553: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451690640 (607h18m49.335104266s) [noise=true , address=77.90.31.19:4841 , piece_id=IERSGG2GKGB5UD3QH3ETCKSJZJT5A6ELFHDLFLJFJ6VB3Y6QIFHA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 139.59.144.22:54400->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451746289 (607h18m49.335159915s) [noise=true , address=77.90.31.10:4519 , piece_id=3QM3LBGNHO5FUVQH7DNXHMVQON7DOYEABGIXWVICTTPSPUIYJQYA, seg_pos={0 0}, upload=485547]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: rpc: dial tcp 77.90.31.10:4519: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 18 16:29:49.451790375 (607h18m49.335204001s) [seg_pos={0 0}, upload=485547]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Jul 18 16:29:49.569242253 (607h18m49.452655873s) [upload=485547]: Done uploading segments... Jul 18 16:29:49.569295294 (607h18m49.45270894s) [upload=485547]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.119716521s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 54 out of 60 is failed (threshold=3) [......XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 192.357555ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:29:36 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 192.381357ms edge ipfs us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)