Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.001978995s FAIL (2025-09-19 20:12:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001997773s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....................................................X..XXXX] duration: 30.102333987s FAIL (2025-09-19 20:12:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== Sep 19 20:11:37.937805663 (510h3m58.430238097s) [upload=448693]: Starting upload Sep 19 20:11:37.937888397 (510h3m58.430320832s) [upload=448693]: Done starting upload Sep 19 20:11:37.938117102 (510h3m58.430549538s) [upload=448693]: Uploading segments... Sep 19 20:11:37.938347535 (510h3m58.430779972s) [upload=448693]: Got next segment. Inline: false Sep 19 20:11:37.938384550 (510h3m58.430816984s) [upload=448693]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 20:11:37.938390395 (510h3m58.430822838s) [upload=448693]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 20:11:38.046008493 (510h3m58.538440927s) [seg_pos={0 0}, upload=448693]: Begin upload segment... Sep 19 20:11:38.046065837 (510h3m58.53849828s) [seg_pos={0 0}, upload=448693]: Done begin upload segment. Sep 19 20:11:38.046094331 (510h3m58.538526773s) [noise=true , address=145.79.227.18:4007 , piece_id=7CLX7C4GDMIRB3TNVGJ7HYOMH7G2XOQUK65ZLXOKC4YISRY5NJRA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.046104956 (510h3m58.538537388s) [noise=true , address=145.79.227.3:4150 , piece_id=ZOCOXUAVM5PJ4FHCMS62Z6AMCRPOCNACXKCSTZ7F4W4TS45V4SUQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.046528730 (510h3m58.538961183s) [noise=true , address=45.91.116.4:4937 , piece_id=PQDCBHFK6QMZMWNIPU7CP7DJFLOPW7RET54YZSHYSQR2SODXP37A, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.046585815 (510h3m58.539018263s) [noise=true , address=45.91.116.5:4299 , piece_id=NPKE26PH2PJ2UWQ2GH533H7RZP7KJOT5YVWNFDWKEL5MNUAWK3EA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.046934504 (510h3m58.539366959s) [noise=true , address=145.79.227.2:4114 , piece_id=Z4LP5L5WBOC7ZNYD4PCBPGQCQV3DFNWQNO5HIC3PFPH6WRTHYWCQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.047274660 (510h3m58.53970711s) [noise=true , address=145.79.227.15:4876 , piece_id=TGKK56WHAQ5TVMOSGKDP43MUAFSR66BRNHSHZTCKJZHQVI4K7ATQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.047568099 (510h3m58.540000544s) [noise=true , address=145.79.227.16:4911 , piece_id=IODA2AHZMLWQYWZROJ3CFELJ635ZCHBOUC5KCSH45K73B7IDT7MQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.047919404 (510h3m58.540351856s) [noise=true , address=45.91.116.7:4009 , piece_id=YJMHBMXKEUI5S6TTDLSWYWXJEBAE33QUOQNL7XCIX6BR4GVFW6XQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.047971548 (510h3m58.540403993s) [noise=true , address=145.79.227.7:4293 , piece_id=IOE46G3OO7SSX2WUWCA6GXYCB722AUW34MITFLBWPBNLXE4G6F2A, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.048402859 (510h3m58.540835308s) [noise=true , address=45.91.116.9:4263 , piece_id=UA7GXU7BRICFGU6ILICRBWRIFKE6P2RKZVKWCMVE2WUMMADEXIDA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.048693846 (510h3m58.541126295s) [noise=true , address=77.90.31.14:4663 , piece_id=U7UC6YCXW4BGOCCAVB7ZFVXB677TNCL2TZ2Z4UCBTZPCGZKLLHPA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.049000359 (510h3m58.541432806s) [noise=true , address=145.79.227.18:4005 , piece_id=GCVUDGQR7D3TV4THM3T5M6JYFUOOT5FLBBKJ7QD3ALS7AX7KCA5A, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.049271631 (510h3m58.541704074s) [noise=true , address=145.79.227.14:4837 , piece_id=NWY32QUQ6WEF5ZF6EABMN45EMBJHOCQQZT37IKTNHGHSBSYLR7HQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.049421999 (510h3m58.541854443s) [noise=true , address=145.79.227.13:4804 , piece_id=5EW6LJBZGBXMZLE4J5PJTQAJNIFSPYTS44TQ5IKY7RFY3WIJU6PA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.049735515 (510h3m58.542167958s) [noise=true , address=145.79.227.17:4971 , piece_id=EHD4THMJBBWUSNU5WN5G2Q5FR7MAIRK4X7YT5VHRCH7D5IG2H6MA, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.050084746 (510h3m58.542517198s) [noise=true , address=45.91.116.14:4191 , piece_id=EPCEC54ZINCZPNF7BZX2RANDEEDJZ266UPF5OUO75G3J4447R4UQ, seg_pos={0 0}, upload=448693]: Uploading piece... Sep 19 20:11:38.674703975 (510h3m59.167136408s) [upload=448693]: Next returned nil segment Sep 19 20:11:38.674722459 (510h3m59.167154901s) [upload=448693]: Waiting for error group managing segments... Sep 19 20:11:38.814268366 (510h3m59.306700802s) [noise=true , address=145.79.227.13:4804 , piece_id=5EW6LJBZGBXMZLE4J5PJTQAJNIFSPYTS44TQ5IKY7RFY3WIJU6PA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.816009422 (510h3m59.308441858s) [noise=true , address=145.79.227.3:4150 , piece_id=ZOCOXUAVM5PJ4FHCMS62Z6AMCRPOCNACXKCSTZ7F4W4TS45V4SUQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.819443609 (510h3m59.31187605s) [noise=true , address=145.79.227.14:4837 , piece_id=NWY32QUQ6WEF5ZF6EABMN45EMBJHOCQQZT37IKTNHGHSBSYLR7HQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.826860283 (510h3m59.319292718s) [noise=true , address=145.79.227.17:4971 , piece_id=EHD4THMJBBWUSNU5WN5G2Q5FR7MAIRK4X7YT5VHRCH7D5IG2H6MA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.830574433 (510h3m59.323006868s) [noise=true , address=145.79.227.2:4114 , piece_id=Z4LP5L5WBOC7ZNYD4PCBPGQCQV3DFNWQNO5HIC3PFPH6WRTHYWCQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.836667517 (510h3m59.329099968s) [noise=true , address=145.79.227.16:4911 , piece_id=IODA2AHZMLWQYWZROJ3CFELJ635ZCHBOUC5KCSH45K73B7IDT7MQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.836965647 (510h3m59.329398084s) [noise=true , address=145.79.227.7:4293 , piece_id=IOE46G3OO7SSX2WUWCA6GXYCB722AUW34MITFLBWPBNLXE4G6F2A, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.837097386 (510h3m59.329529818s) [noise=true , address=145.79.227.18:4005 , piece_id=GCVUDGQR7D3TV4THM3T5M6JYFUOOT5FLBBKJ7QD3ALS7AX7KCA5A, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.841940701 (510h3m59.334373129s) [noise=true , address=145.79.227.18:4007 , piece_id=7CLX7C4GDMIRB3TNVGJ7HYOMH7G2XOQUK65ZLXOKC4YISRY5NJRA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:11:38.844319515 (510h3m59.336751945s) [noise=true , address=145.79.227.15:4876 , piece_id=TGKK56WHAQ5TVMOSGKDP43MUAFSR66BRNHSHZTCKJZHQVI4K7ATQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: <nil> Sep 19 20:12:07.668776815 (510h4m28.161209258s) [noise=true , address=45.91.116.14:4191 , piece_id=EPCEC54ZINCZPNF7BZX2RANDEEDJZ266UPF5OUO75G3J4447R4UQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: read tcp 139.59.144.22:54002->45.91.116.14:4191: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:12:07.668826360 (510h4m28.161258802s) [noise=true , address=45.91.116.5:4299 , piece_id=NPKE26PH2PJ2UWQ2GH533H7RZP7KJOT5YVWNFDWKEL5MNUAWK3EA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: read tcp 139.59.144.22:54494->45.91.116.5:4299: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:12:07.668863357 (510h4m28.161295786s) [noise=true , address=45.91.116.9:4263 , piece_id=UA7GXU7BRICFGU6ILICRBWRIFKE6P2RKZVKWCMVE2WUMMADEXIDA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: read tcp 139.59.144.22:33334->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:12:07.668895862 (510h4m28.161328291s) [noise=true , address=77.90.31.14:4663 , piece_id=U7UC6YCXW4BGOCCAVB7ZFVXB677TNCL2TZ2Z4UCBTZPCGZKLLHPA, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:54720->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:12:07.668929363 (510h4m28.161361791s) [noise=true , address=45.91.116.4:4937 , piece_id=PQDCBHFK6QMZMWNIPU7CP7DJFLOPW7RET54YZSHYSQR2SODXP37A, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: read tcp 139.59.144.22:47852->45.91.116.4:4937: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:12:07.668994806 (510h4m28.161427249s) [noise=true , address=45.91.116.7:4009 , piece_id=YJMHBMXKEUI5S6TTDLSWYWXJEBAE33QUOQNL7XCIX6BR4GVFW6XQ, seg_pos={0 0}, upload=448693]: Done uploading piece. err: ecclient: upload failed (node:1KaUBuZoi8DjagfvnxBSLBL1Mt69RdtNKn96oT7wFC8n2ppFDE, address:45.91.116.7:4009): protocol: read tcp 139.59.144.22:60652->45.91.116.7:4009: use of closed network connection; context deadline exceeded Sep 19 20:12:07.669012617 (510h4m28.16144506s) [seg_pos={0 0}, upload=448693]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 19 20:12:07.768576845 (510h4m28.261009294s) [upload=448693]: Done uploading segments... Sep 19 20:12:07.768608019 (510h4m28.261040465s) [upload=448693]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.102352786s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000953554s FAIL (2025-09-19 20:11:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00097836s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [......................................................X..XXX] duration: 30.125126685s FAIL (2025-09-19 20:11:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 4) ======LOGS====== 0378s) [noise=true , address=77.90.31.21:4879 , piece_id=NPCTRJZBHDHGLNJMKQQ5CY3U6KN7QNVPX7KCXRA5BIOGWSG3S6MQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.798928474 (510h3m28.291360919s) [noise=true , address=145.79.227.4:4185 , piece_id=7K6C3G7OYNH3KS2C33EVOCYVHDBGJKZMQMUUJRNTVV4NC4AJ4ZUA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.798947348 (510h3m28.2913798s) [noise=true , address=145.79.227.7:4293 , piece_id=5MKHKCA4MROGX4JRCPCBBBTNJR6WCO7SHAGHPB4YNQDOYZC6ETYA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.799318151 (510h3m28.291750592s) [noise=true , address=77.90.31.13:4628 , piece_id=N4ILBUH5HNZHN6DFJFJBFQGN4UAKBQQQBX633AAJ3BCQH23CM6ZA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.799377635 (510h3m28.291810088s) [noise=true , address=145.79.227.15:4876 , piece_id=KE45RXVBUG5WXQEWROZHKD5LD7RLAXUXRNHIGG3S5KQBKVWOUZNA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.799633711 (510h3m28.292066156s) [noise=true , address=45.91.116.6:4973 , piece_id=7H564RTSGTR2VTUIGZ5J6BTBFWCZD5N4KJ3S3V7YYOAPGHHL7AJQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.799779632 (510h3m28.292212085s) [noise=true , address=77.90.31.11:4555 , piece_id=NGD4SUKTTZ3A7KIKPPPWRE6LS54QD6Y5ZVAG4K3ZNLL6TW2JA2AQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.800306524 (510h3m28.292738977s) [noise=true , address=77.90.31.14:4663 , piece_id=D74JGQYTIXSQ5Q77QCXPL46O6Q7XSO4ESQ362UKX73YIRDLHHQFA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.800794399 (510h3m28.29322685s) [noise=true , address=45.91.116.8:4048 , piece_id=ZQDUMHI64F2J74XBHIRJ2Q3BBVYXKDWWHQOFMA5VG3ZGIEBJECQQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.800979773 (510h3m28.293412218s) [noise=true , address=45.91.116.11:4118 , piece_id=JX7Z3IN566OQI3U4XZ2DUIPT3HJGW2C572VFVM5W2XMDEXKMRHUA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.801186281 (510h3m28.293618837s) [noise=true , address=45.91.116.7:4010 , piece_id=SU6HASDS7ZR35LDHIJ5CZS5RRHBNDMF7JDO4XO23BTK3HXQZYOBQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.801468336 (510h3m28.293900782s) [noise=true , address=45.91.116.5:4297 , piece_id=745ZLVWRADRVVYHMT6S36G2Q5IQXX643Q7R3DOUF7OBJUZTPCY4A, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.802026833 (510h3m28.294459282s) [noise=true , address=77.90.31.15:4698 , piece_id=VIPPZ7VLZSAEM2ZEROTVXT5257JMLDIRNTQKTLTNBQZLZNYVXVXQ, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.802568034 (510h3m28.295000479s) [noise=true , address=45.91.116.12:4227 , piece_id=222DQXA25PEXSJFLKNMBWWCD4K6JHM27KLEIN2SQZHIU4CKJQHEA, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:07.802977413 (510h3m28.295409861s) [noise=true , address=77.90.31.12:4592 , piece_id=YWLLMNBBLR2YXCYOYDYKRL2MVBNVCOBC7VF47JD3TAMB4Y5OVS6A, seg_pos={0 0}, upload=448683]: Uploading piece... Sep 19 20:11:08.428698068 (510h3m28.921130511s) [upload=448683]: Next returned nil segment Sep 19 20:11:08.428716676 (510h3m28.921149122s) [upload=448683]: Waiting for error group managing segments... Sep 19 20:11:08.572030447 (510h3m29.064462893s) [noise=true , address=145.79.227.15:4876 , piece_id=KE45RXVBUG5WXQEWROZHKD5LD7RLAXUXRNHIGG3S5KQBKVWOUZNA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: <nil> Sep 19 20:11:08.578629624 (510h3m29.071062059s) [noise=true , address=145.79.227.11:4731 , piece_id=QJEIPWZPPURZVO4YWICSG6YQMFV2EXSUR6LKUEVJGWGCH7E7UQFA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: <nil> Sep 19 20:11:08.578767567 (510h3m29.071200003s) [noise=true , address=145.79.227.7:4293 , piece_id=5MKHKCA4MROGX4JRCPCBBBTNJR6WCO7SHAGHPB4YNQDOYZC6ETYA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: <nil> Sep 19 20:11:08.586420876 (510h3m29.078853309s) [noise=true , address=145.79.227.4:4185 , piece_id=7K6C3G7OYNH3KS2C33EVOCYVHDBGJKZMQMUUJRNTVV4NC4AJ4ZUA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: <nil> Sep 19 20:11:37.401820337 (510h3m57.894252772s) [noise=true , address=77.90.31.11:4555 , piece_id=NGD4SUKTTZ3A7KIKPPPWRE6LS54QD6Y5ZVAG4K3ZNLL6TW2JA2AQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: rpc: dial tcp 77.90.31.11:4555: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.401904282 (510h3m57.894336714s) [noise=true , address=77.90.31.13:4628 , piece_id=N4ILBUH5HNZHN6DFJFJBFQGN4UAKBQQQBX633AAJ3BCQH23CM6ZA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402065472 (510h3m57.894497919s) [noise=true , address=45.91.116.7:4010 , piece_id=SU6HASDS7ZR35LDHIJ5CZS5RRHBNDMF7JDO4XO23BTK3HXQZYOBQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402106631 (510h3m57.894539062s) [noise=true , address=45.91.116.8:4048 , piece_id=ZQDUMHI64F2J74XBHIRJ2Q3BBVYXKDWWHQOFMA5VG3ZGIEBJECQQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:1288A5aF4EsQG3XrDQg6fqURsqsFKfSRMeLi4kC5aBRYF6uBnFB, address:45.91.116.8:4048): protocol: rpc: dial tcp 45.91.116.8:4048: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402151096 (510h3m57.894583524s) [noise=true , address=45.91.116.12:4227 , piece_id=222DQXA25PEXSJFLKNMBWWCD4K6JHM27KLEIN2SQZHIU4CKJQHEA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: rpc: dial tcp 45.91.116.12:4227: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402195029 (510h3m57.894627457s) [noise=true , address=77.90.31.12:4592 , piece_id=YWLLMNBBLR2YXCYOYDYKRL2MVBNVCOBC7VF47JD3TAMB4Y5OVS6A, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3, address:77.90.31.12:4592): protocol: read tcp 139.59.144.22:48808->77.90.31.12:4592: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402202882 (510h3m57.894635319s) [noise=true , address=45.91.116.5:4297 , piece_id=745ZLVWRADRVVYHMT6S36G2Q5IQXX643Q7R3DOUF7OBJUZTPCY4A, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12pba8P3R4hb1xBifPDXzMKXuWgwwpPCx4MXPuBDU7Nupj2LKLW, address:45.91.116.5:4297): protocol: rpc: dial tcp 45.91.116.5:4297: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402230789 (510h3m57.894663217s) [noise=true , address=45.91.116.6:4973 , piece_id=7H564RTSGTR2VTUIGZ5J6BTBFWCZD5N4KJ3S3V7YYOAPGHHL7AJQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12Z23fYAQ6w3Wv3mXVfoqQcLR7HxW5yhrPe2xgViVeiKFsmRVcV, address:45.91.116.6:4973): protocol: read tcp 139.59.144.22:34450->45.91.116.6:4973: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402258883 (510h3m57.894691311s) [noise=true , address=77.90.31.21:4879 , piece_id=NPCTRJZBHDHGLNJMKQQ5CY3U6KN7QNVPX7KCXRA5BIOGWSG3S6MQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: read tcp 139.59.144.22:47522->77.90.31.21:4879: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402281356 (510h3m57.894713784s) [noise=true , address=77.90.31.15:4698 , piece_id=VIPPZ7VLZSAEM2ZEROTVXT5257JMLDIRNTQKTLTNBQZLZNYVXVXQ, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12XVNxzmNrzdDjyJR5e6M394ptZY4sMPdH1suN42y5WynbVp8oj, address:77.90.31.15:4698): protocol: rpc: dial tcp 77.90.31.15:4698: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402410050 (510h3m57.894842478s) [noise=true , address=45.91.116.11:4118 , piece_id=JX7Z3IN566OQI3U4XZ2DUIPT3HJGW2C572VFVM5W2XMDEXKMRHUA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: read tcp 139.59.144.22:47948->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402463464 (510h3m57.894895905s) [noise=true , address=77.90.31.14:4663 , piece_id=D74JGQYTIXSQ5Q77QCXPL46O6Q7XSO4ESQ362UKX73YIRDLHHQFA, seg_pos={0 0}, upload=448683]: Done uploading piece. err: ecclient: upload failed (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE, address:77.90.31.14:4663): protocol: read tcp 139.59.144.22:50802->77.90.31.14:4663: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:37.402527864 (510h3m57.894960307s) [seg_pos={0 0}, upload=448683]: Done waiting for segment. successful: 4 optimal: 13 errs: <nil> Sep 19 20:11:37.525032752 (510h3m58.017465183s) [upload=448683]: Done uploading segments... Sep 19 20:11:37.525061108 (510h3m58.017493537s) [upload=448683]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 4) Duration: 30.125145494s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X..XX] duration: 30.110676781s FAIL (2025-09-19 20:11:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Sep 19 20:10:37.416549211 (510h2m57.908981644s) [upload=448676]: Starting upload Sep 19 20:10:37.416656174 (510h2m57.90908863s) [upload=448676]: Done starting upload Sep 19 20:10:37.416782486 (510h2m57.909214914s) [upload=448676]: Uploading segments... Sep 19 20:10:37.417166946 (510h2m57.90959939s) [upload=448676]: Got next segment. Inline: false Sep 19 20:10:37.417214928 (510h2m57.909647376s) [upload=448676]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 20:10:37.417220387 (510h2m57.909652831s) [upload=448676]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 20:10:37.571304552 (510h2m58.063737006s) [seg_pos={0 0}, upload=448676]: Begin upload segment... Sep 19 20:10:37.571375147 (510h2m58.063807601s) [seg_pos={0 0}, upload=448676]: Done begin upload segment. Sep 19 20:10:37.571412798 (510h2m58.063845254s) [noise=true , address=77.90.31.11:4554 , piece_id=6D3AAPTSGWBIPRHBWVH33WEB3THX4FZW7FGUS3GN6GGTVWE753BA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.571419536 (510h2m58.06385198s) [noise=true , address=145.79.227.7:4295 , piece_id=EZKPGEUZZSHXZRBLPJUFTJF2IZKVCU6KHATAM2QYB4W2QQ3Q2NHQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.571494362 (510h2m58.063926801s) [noise=true , address=77.90.31.11:4555 , piece_id=ZLO3ZUTNNZSPSWEFM5UI55VYHAZC2LWLPJQSZPCTGA75LOLH24QQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.571868248 (510h2m58.064300692s) [noise=true , address=45.91.116.9:4263 , piece_id=NTZBT4NXOFMDXHTSC5DR2VPJAUXCVRDNODPEP4EXFYALWCRHTBBA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.571923789 (510h2m58.064356242s) [noise=true , address=45.91.116.4:4938 , piece_id=YLQNR3AOE2BVHRRNGAZ5LHEB5UVALAZYF7RKR3ABVMML6L357CCQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.572431503 (510h2m58.064863948s) [noise=true , address=145.79.227.17:4972 , piece_id=GRSL62ZT67H5EW2YGTYYHGCN3LOFRBITR7BCK3ELUZWJKUDAC5OQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.572770526 (510h2m58.065202975s) [noise=true , address=45.91.116.13:4155 , piece_id=75PLZJANRQBJQEVGHVTSVU4HHK77D63DRAH4RJTLCOHY4MTTBXAA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.573129620 (510h2m58.065562073s) [noise=true , address=145.79.227.4:4185 , piece_id=IPXOUUWSHXAIPLWK4ELS23YTRTISZJCVSRR6M553XMNRPCOUWNDA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.573526968 (510h2m58.06595942s) [noise=true , address=77.90.31.18:4807 , piece_id=SDT2XYZSYKZ4W7PIEVMPIVKQ4F32LTYEXVQBCVWAUP5LVGZ62TPQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.573952185 (510h2m58.066384629s) [noise=true , address=145.79.227.15:4875 , piece_id=4X4N6G5VQY7KPBBZ4FFVQJ7RDKF55GY4N2ADAZGOQNF6KZDZO3MA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.574344081 (510h2m58.066776534s) [noise=true , address=77.90.31.15:4699 , piece_id=ETLLBPZUNZZROERRSTQUEYTSODFRMH5Q3ZVXD2WRFI6FTUCX2EGA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.574734399 (510h2m58.067166851s) [noise=true , address=145.79.227.7:4293 , piece_id=GRATIVNWSGYMRMV5FWEVRCYXR3DFKPWIRTZBJMP7FE7N35G3W6LQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.575095511 (510h2m58.067527966s) [noise=true , address=145.79.227.6:4259 , piece_id=MCOZQN5LR32HVJBYLZNNP3A6G4SWIRTZDMUXNNBPH5TYH6DEZKSA, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.575465079 (510h2m58.067897534s) [noise=true , address=45.91.116.8:4045 , piece_id=IOJ7SBOEYGHOYLBN3QWCS4G5QAFOCZQWNVBP6ZAIGLVSSKCUPA5A, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.575809260 (510h2m58.068241714s) [noise=true , address=45.91.116.5:4298 , piece_id=2EFWBYACWVLKYKULS4S7XJYZRSWCGGAH4HS3YRAEV6SY5KIV267Q, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:37.576145697 (510h2m58.068578147s) [noise=true , address=77.90.31.10:4519 , piece_id=3F3E2F7K3W4A3KWBXPS3FMH5HUA2MHVIU4KSFWS2PTUPP2R7EVZQ, seg_pos={0 0}, upload=448676]: Uploading piece... Sep 19 20:10:38.211173296 (510h2m58.703605746s) [upload=448676]: Next returned nil segment Sep 19 20:10:38.211195969 (510h2m58.70362842s) [upload=448676]: Waiting for error group managing segments... Sep 19 20:10:38.349245133 (510h2m58.841677567s) [noise=true , address=145.79.227.17:4972 , piece_id=GRSL62ZT67H5EW2YGTYYHGCN3LOFRBITR7BCK3ELUZWJKUDAC5OQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:38.360697884 (510h2m58.853130321s) [noise=true , address=145.79.227.7:4295 , piece_id=EZKPGEUZZSHXZRBLPJUFTJF2IZKVCU6KHATAM2QYB4W2QQ3Q2NHQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:38.364027100 (510h2m58.856459534s) [noise=true , address=145.79.227.4:4185 , piece_id=IPXOUUWSHXAIPLWK4ELS23YTRTISZJCVSRR6M553XMNRPCOUWNDA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:38.373369388 (510h2m58.865801824s) [noise=true , address=145.79.227.7:4293 , piece_id=GRATIVNWSGYMRMV5FWEVRCYXR3DFKPWIRTZBJMP7FE7N35G3W6LQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:38.380486890 (510h2m58.872919325s) [noise=true , address=145.79.227.6:4259 , piece_id=MCOZQN5LR32HVJBYLZNNP3A6G4SWIRTZDMUXNNBPH5TYH6DEZKSA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:38.384700384 (510h2m58.877132812s) [noise=true , address=145.79.227.15:4875 , piece_id=4X4N6G5VQY7KPBBZ4FFVQJ7RDKF55GY4N2ADAZGOQNF6KZDZO3MA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.070193673 (510h3m0.562626117s) [noise=true , address=77.90.31.11:4555 , piece_id=ZLO3ZUTNNZSPSWEFM5UI55VYHAZC2LWLPJQSZPCTGA75LOLH24QQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.092690306 (510h3m0.585122738s) [noise=true , address=77.90.31.18:4807 , piece_id=SDT2XYZSYKZ4W7PIEVMPIVKQ4F32LTYEXVQBCVWAUP5LVGZ62TPQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.118344758 (510h3m0.610777194s) [noise=true , address=77.90.31.15:4699 , piece_id=ETLLBPZUNZZROERRSTQUEYTSODFRMH5Q3ZVXD2WRFI6FTUCX2EGA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.210170674 (510h3m0.702603111s) [noise=true , address=77.90.31.10:4519 , piece_id=3F3E2F7K3W4A3KWBXPS3FMH5HUA2MHVIU4KSFWS2PTUPP2R7EVZQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.317879997 (510h3m0.810312426s) [noise=true , address=45.91.116.9:4263 , piece_id=NTZBT4NXOFMDXHTSC5DR2VPJAUXCVRDNODPEP4EXFYALWCRHTBBA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:10:40.576145714 (510h3m1.068578155s) [noise=true , address=45.91.116.5:4298 , piece_id=2EFWBYACWVLKYKULS4S7XJYZRSWCGGAH4HS3YRAEV6SY5KIV267Q, seg_pos={0 0}, upload=448676]: Done uploading piece. err: <nil> Sep 19 20:11:07.133010891 (510h3m27.62544334s) [noise=true , address=77.90.31.11:4554 , piece_id=6D3AAPTSGWBIPRHBWVH33WEB3THX4FZW7FGUS3GN6GGTVWE753BA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 139.59.144.22:42626->77.90.31.11:4554: use of closed network connection; write tcp 139.59.144.22:42626->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42626->77.90.31.11:4554: use of closed network connection Sep 19 20:11:07.133113017 (510h3m27.625545452s) [noise=true , address=45.91.116.4:4938 , piece_id=YLQNR3AOE2BVHRRNGAZ5LHEB5UVALAZYF7RKR3ABVMML6L357CCQ, seg_pos={0 0}, upload=448676]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 139.59.144.22:45990->45.91.116.4:4938: use of closed network connection; write tcp 139.59.144.22:45990->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:45990->45.91.116.4:4938: use of closed network connection Sep 19 20:11:07.133267676 (510h3m27.625700108s) [noise=true , address=45.91.116.8:4045 , piece_id=IOJ7SBOEYGHOYLBN3QWCS4G5QAFOCZQWNVBP6ZAIGLVSSKCUPA5A, seg_pos={0 0}, upload=448676]: Done uploading piece. err: ecclient: upload failed (node:1VJaB7i7HKyemCadiPSoXCuTuBzvqa5MeUDQf793etkYLpxQc9, address:45.91.116.8:4045): protocol: read tcp 139.59.144.22:45704->45.91.116.8:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:07.133316428 (510h3m27.625748872s) [noise=true , address=45.91.116.13:4155 , piece_id=75PLZJANRQBJQEVGHVTSVU4HHK77D63DRAH4RJTLCOHY4MTTBXAA, seg_pos={0 0}, upload=448676]: Done uploading piece. err: ecclient: upload failed (node:12A74D73fZwkdrEvMvuHQKWjBsKEhWZcRcgix2ZNeWSZKkhWUuf, address:45.91.116.13:4155): protocol: read tcp 139.59.144.22:50744->45.91.116.13:4155: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:11:07.133335628 (510h3m27.625768074s) [seg_pos={0 0}, upload=448676]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Sep 19 20:11:07.241487430 (510h3m27.733919867s) [upload=448676]: Done uploading segments... Sep 19 20:11:07.241516059 (510h3m27.733948493s) [upload=448676]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.1107062s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000665177s FAIL (2025-09-19 20:10:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000701035s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 30.133424277s FAIL (2025-09-19 20:10:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== 2.092677268 (510h1m52.585109712s) [upload=448659]: Done starting upload Sep 19 20:09:32.092909166 (510h1m52.585341615s) [upload=448659]: Uploading segments... Sep 19 20:09:32.093284760 (510h1m52.585717214s) [upload=448659]: Got next segment. Inline: false Sep 19 20:09:32.093349374 (510h1m52.585781821s) [upload=448659]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 19 20:09:32.093357134 (510h1m52.585789587s) [upload=448659]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 19 20:09:32.211958629 (510h1m52.704391071s) [seg_pos={0 0}, upload=448659]: Begin upload segment... Sep 19 20:09:32.212006557 (510h1m52.704438992s) [seg_pos={0 0}, upload=448659]: Done begin upload segment. Sep 19 20:09:32.212048993 (510h1m52.704481426s) [noise=true , address=145.79.227.17:4972 , piece_id=LFRHG6GIHWYK7QIODVXTHQGXT4CSOXE3KZAJUYBUCOOEEYSFILZA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.212609424 (510h1m52.705041876s) [noise=true , address=145.79.227.15:4875 , piece_id=NFDYYPXEPGT4K6RRVILFQQFCLNU4WIAXQGC37GPTCDIDLXZIQ2AQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.212800497 (510h1m52.705232942s) [noise=true , address=145.79.227.11:4729 , piece_id=XHDWAZRLOCSQXJHYU4LMJNNF3BAJJ7QYNGEXGYATU2SAN5SIV7CQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.213212585 (510h1m52.705645034s) [noise=true , address=145.79.227.6:4259 , piece_id=JEIHGDPPH4E7XILPS4TDKXO36Q5AEBQSEI2M7DZVNS4GHKPCK3FQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.213553513 (510h1m52.705985955s) [noise=true , address=45.91.116.12:4226 , piece_id=NKOP7ZYCTOOYLZDN54MK6QTEOHPGAMBZSLJYY5LHRUYJ53YUW7TQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.213958917 (510h1m52.706391363s) [noise=true , address=77.90.31.10:4519 , piece_id=IXCD4N3WFPYU2JSNFDJHLKV6NLB42MGPYJUDASEBSBGVZKOFAIZA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.214296202 (510h1m52.706728644s) [noise=true , address=45.91.116.14:4191 , piece_id=3LBFAUXX5VZJ6RT3OXCQFI5ISZSTGTJSC5WTPQOMOICCK4CYQJ6Q, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.214480648 (510h1m52.706913148s) [noise=true , address=145.79.227.7:4293 , piece_id=UA2PMFPJUI22MC7XLKUX6WMSATEBRF4LH3C5PW4INS23P5HKDCEA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.214837756 (510h1m52.707270201s) [noise=true , address=145.79.227.4:4185 , piece_id=RCPK7I6E7PAQXSWOWPHWNPXXZPUQ5CQLKBXM2EY7BG7CTJ4C3X5A, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.216828559 (510h1m52.709261011s) [noise=true , address=45.91.116.5:4298 , piece_id=QP3JD5LOG2QP5SGI3IIPSAQKGFEAHYP4WOTUJYKF7VKQCWTTM5FA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.217108438 (510h1m52.709540885s) [noise=true , address=77.90.31.17:4770 , piece_id=5QNCIXZENLH2GUOSKAH3FVKXLTFJ6ZQEN7SRRTVTKYTMWM3NCGMQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.217337627 (510h1m52.709770069s) [noise=true , address=145.79.227.18:4006 , piece_id=7AIKR7OHG5SQL53NMNBKJIS7LBBX7HRSDGUDVYZXI56LJOQY4B5A, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.217555398 (510h1m52.70998784s) [noise=true , address=77.90.31.12:4592 , piece_id=H2H5KXFWGFJSFZP672U67JJG6P6TOHEMNZWPSHF5SWQYVDG4L6OA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.217779984 (510h1m52.710212426s) [noise=true , address=77.90.31.13:4627 , piece_id=7XTPCFEWPNKK7LTATCAVZUAPYDJV2BOIJGJCIWHAWA7WBBRYUARQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.218032502 (510h1m52.710464948s) [noise=true , address=45.91.116.4:4937 , piece_id=IAN7GCIK5TZVP7XND5BR35ID34M3NXQWH36NAX7NAVSATLDELHNQ, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.218272254 (510h1m52.710704699s) [noise=true , address=77.90.31.12:4589 , piece_id=KMKEFHLRQFDXHR2E2IXRC2R44H6VRBYAYRZDLHWOYV4WPIH4AJWA, seg_pos={0 0}, upload=448659]: Uploading piece... Sep 19 20:09:32.837946655 (510h1m53.330379104s) [upload=448659]: Next returned nil segment Sep 19 20:09:32.837967458 (510h1m53.330399904s) [upload=448659]: Waiting for error group managing segments... Sep 19 20:09:32.981675125 (510h1m53.474107563s) [noise=true , address=145.79.227.6:4259 , piece_id=JEIHGDPPH4E7XILPS4TDKXO36Q5AEBQSEI2M7DZVNS4GHKPCK3FQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:32.981748896 (510h1m53.47418133s) [noise=true , address=145.79.227.7:4293 , piece_id=UA2PMFPJUI22MC7XLKUX6WMSATEBRF4LH3C5PW4INS23P5HKDCEA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:32.982358386 (510h1m53.474790814s) [noise=true , address=145.79.227.17:4972 , piece_id=LFRHG6GIHWYK7QIODVXTHQGXT4CSOXE3KZAJUYBUCOOEEYSFILZA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:32.983128943 (510h1m53.475561375s) [noise=true , address=145.79.227.15:4875 , piece_id=NFDYYPXEPGT4K6RRVILFQQFCLNU4WIAXQGC37GPTCDIDLXZIQ2AQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:32.986536547 (510h1m53.478968997s) [noise=true , address=145.79.227.11:4729 , piece_id=XHDWAZRLOCSQXJHYU4LMJNNF3BAJJ7QYNGEXGYATU2SAN5SIV7CQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:33.002827591 (510h1m53.495260027s) [noise=true , address=145.79.227.18:4006 , piece_id=7AIKR7OHG5SQL53NMNBKJIS7LBBX7HRSDGUDVYZXI56LJOQY4B5A, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:33.010452086 (510h1m53.502884536s) [noise=true , address=145.79.227.4:4185 , piece_id=RCPK7I6E7PAQXSWOWPHWNPXXZPUQ5CQLKBXM2EY7BG7CTJ4C3X5A, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:39.444391449 (510h1m59.936823878s) [noise=true , address=77.90.31.12:4592 , piece_id=H2H5KXFWGFJSFZP672U67JJG6P6TOHEMNZWPSHF5SWQYVDG4L6OA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:39.703341518 (510h2m0.195773949s) [noise=true , address=77.90.31.17:4770 , piece_id=5QNCIXZENLH2GUOSKAH3FVKXLTFJ6ZQEN7SRRTVTKYTMWM3NCGMQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:09:40.026601097 (510h2m0.519033538s) [noise=true , address=45.91.116.4:4937 , piece_id=IAN7GCIK5TZVP7XND5BR35ID34M3NXQWH36NAX7NAVSATLDELHNQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: <nil> Sep 19 20:10:01.785948667 (510h2m22.278381117s) [noise=true , address=45.91.116.14:4191 , piece_id=3LBFAUXX5VZJ6RT3OXCQFI5ISZSTGTJSC5WTPQOMOICCK4CYQJ6Q, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: expected piece hash; context deadline exceeded; EOF Sep 19 20:10:01.786071085 (510h2m22.27850353s) [noise=true , address=77.90.31.10:4519 , piece_id=IXCD4N3WFPYU2JSNFDJHLKV6NLB42MGPYJUDASEBSBGVZKOFAIZA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, address:77.90.31.10:4519): protocol: expected piece hash; context deadline exceeded; EOF Sep 19 20:10:01.786160499 (510h2m22.278592947s) [noise=true , address=77.90.31.12:4589 , piece_id=KMKEFHLRQFDXHR2E2IXRC2R44H6VRBYAYRZDLHWOYV4WPIH4AJWA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 139.59.144.22:33176->77.90.31.12:4589: use of closed network connection; write tcp 139.59.144.22:33176->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:33176->77.90.31.12:4589: use of closed network connection Sep 19 20:10:01.786217349 (510h2m22.278649778s) [noise=true , address=77.90.31.13:4627 , piece_id=7XTPCFEWPNKK7LTATCAVZUAPYDJV2BOIJGJCIWHAWA7WBBRYUARQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 139.59.144.22:36496->77.90.31.13:4627: use of closed network connection; write tcp 139.59.144.22:36496->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36496->77.90.31.13:4627: use of closed network connection Sep 19 20:10:01.786255310 (510h2m22.278687757s) [noise=true , address=45.91.116.5:4298 , piece_id=QP3JD5LOG2QP5SGI3IIPSAQKGFEAHYP4WOTUJYKF7VKQCWTTM5FA, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C, address:45.91.116.5:4298): protocol: write tcp 139.59.144.22:39192->45.91.116.5:4298: use of closed network connection; write tcp 139.59.144.22:39192->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:39192->45.91.116.5:4298: use of closed network connection Sep 19 20:10:01.786312660 (510h2m22.278745104s) [noise=true , address=45.91.116.12:4226 , piece_id=NKOP7ZYCTOOYLZDN54MK6QTEOHPGAMBZSLJYY5LHRUYJ53YUW7TQ, seg_pos={0 0}, upload=448659]: Done uploading piece. err: ecclient: upload failed (node:12FS8qbYudyqYzaKkQmN2sbHGBcyBCgUoVEzMmCFB2VPHeB6YQ1, address:45.91.116.12:4226): protocol: write tcp 139.59.144.22:34722->45.91.116.12:4226: use of closed network connection; write tcp 139.59.144.22:34722->45.91.116.12:4226: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:34722->45.91.116.12:4226: use of closed network connection Sep 19 20:10:01.786356800 (510h2m22.278789254s) [seg_pos={0 0}, upload=448659]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Sep 19 20:10:01.911290902 (510h2m22.403723353s) [upload=448659]: Done uploading segments... Sep 19 20:10:01.911393164 (510h2m22.403825614s) [upload=448659]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.133467963s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 9.068254205s FAIL (2025-09-19 20:09:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== e... Sep 19 20:07:52.006138312 (510h0m12.498570756s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006429108 (510h0m12.498861551s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006489461 (510h0m12.498921904s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006804942 (510h0m12.499237395s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006852119 (510h0m12.49928456s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007128951 (510h0m12.499561393s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007160183 (510h0m12.499592626s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007515116 (510h0m12.49994758s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007905715 (510h0m12.500338159s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008358501 (510h0m12.500790949s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008690473 (510h0m12.501122923s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.668119865 (510h0m13.160552319s) [upload=448634]: Next returned nil segment Sep 19 20:07:52.668222826 (510h0m13.16065528s) [upload=448634]: Waiting for error group managing segments... Sep 19 20:07:52.777593633 (510h0m13.270026069s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.778146345 (510h0m13.270578792s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.798141039 (510h0m13.290573468s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799444590 (510h0m13.291877026s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799538174 (510h0m13.291970605s) [noise=true , address=145.79.227.2:4114 , piece_id=X5EME7CF4P7HYRZVJIFP4WKO7S5JJ7BAZQQF43MJA6LWSLSGVFOA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.802692376 (510h0m13.29512481s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:08:21.577517781 (510h0m42.069950226s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection Sep 19 20:08:21.577629479 (510h0m42.070061923s) [noise=true , address=45.91.116.4:4938 , piece_id=HRIKFMYQ4OVEWCZ63LZRYNX67VSJYB2BQE6QJVCSTIYM7FXHEKZA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection Sep 19 20:08:21.577644566 (510h0m42.070077015s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection Sep 19 20:08:21.577699357 (510h0m42.070131799s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection Sep 19 20:08:21.577750688 (510h0m42.070183118s) [noise=true , address=77.90.31.10:4520 , piece_id=PHVO6HQCHEMLTMFAL62HFEHPWHKQSN75MEXHPQ2SUKCZ27TGC22A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection Sep 19 20:08:21.577789990 (510h0m42.070222432s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:56078->77.90.31.17:4770: use of closed network connection; context deadline exceeded Sep 19 20:08:21.577878876 (510h0m42.070311317s) [noise=true , address=45.91.116.9:4261 , piece_id=LM7F4XFGYIH2JXFPPO6TSZET3V6AX26UQHIWASEO4DMYWY5WJUGQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection Sep 19 20:08:21.577902373 (510h0m42.070334802s) [noise=true , address=77.90.31.21:4879 , piece_id=S3QK6AVAMK6Z7SINEP2IHF3EM5WMDEUN32XAT7MN34NMHHY265TA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection Sep 19 20:08:21.577974266 (510h0m42.070406693s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: read tcp 139.59.144.22:47414->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:08:21.578007061 (510h0m42.070439503s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection Sep 19 20:08:21.578044074 (510h0m42.070476516s) [seg_pos={0 0}, upload=448634]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 19 20:08:21.687809896 (510h0m42.180242333s) [upload=448634]: Done uploading segments... Sep 19 20:08:21.687857554 (510h0m42.180289991s) [upload=448634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 9.068289138s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 6.874764123s FAIL (2025-09-19 20:08:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== e... Sep 19 20:07:52.006138312 (510h0m12.498570756s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006429108 (510h0m12.498861551s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006489461 (510h0m12.498921904s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006804942 (510h0m12.499237395s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006852119 (510h0m12.49928456s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007128951 (510h0m12.499561393s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007160183 (510h0m12.499592626s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007515116 (510h0m12.49994758s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007905715 (510h0m12.500338159s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008358501 (510h0m12.500790949s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008690473 (510h0m12.501122923s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.668119865 (510h0m13.160552319s) [upload=448634]: Next returned nil segment Sep 19 20:07:52.668222826 (510h0m13.16065528s) [upload=448634]: Waiting for error group managing segments... Sep 19 20:07:52.777593633 (510h0m13.270026069s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.778146345 (510h0m13.270578792s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.798141039 (510h0m13.290573468s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799444590 (510h0m13.291877026s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799538174 (510h0m13.291970605s) [noise=true , address=145.79.227.2:4114 , piece_id=X5EME7CF4P7HYRZVJIFP4WKO7S5JJ7BAZQQF43MJA6LWSLSGVFOA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.802692376 (510h0m13.29512481s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:08:21.577517781 (510h0m42.069950226s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection Sep 19 20:08:21.577629479 (510h0m42.070061923s) [noise=true , address=45.91.116.4:4938 , piece_id=HRIKFMYQ4OVEWCZ63LZRYNX67VSJYB2BQE6QJVCSTIYM7FXHEKZA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection Sep 19 20:08:21.577644566 (510h0m42.070077015s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection Sep 19 20:08:21.577699357 (510h0m42.070131799s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection Sep 19 20:08:21.577750688 (510h0m42.070183118s) [noise=true , address=77.90.31.10:4520 , piece_id=PHVO6HQCHEMLTMFAL62HFEHPWHKQSN75MEXHPQ2SUKCZ27TGC22A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection Sep 19 20:08:21.577789990 (510h0m42.070222432s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:56078->77.90.31.17:4770: use of closed network connection; context deadline exceeded Sep 19 20:08:21.577878876 (510h0m42.070311317s) [noise=true , address=45.91.116.9:4261 , piece_id=LM7F4XFGYIH2JXFPPO6TSZET3V6AX26UQHIWASEO4DMYWY5WJUGQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection Sep 19 20:08:21.577902373 (510h0m42.070334802s) [noise=true , address=77.90.31.21:4879 , piece_id=S3QK6AVAMK6Z7SINEP2IHF3EM5WMDEUN32XAT7MN34NMHHY265TA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection Sep 19 20:08:21.577974266 (510h0m42.070406693s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: read tcp 139.59.144.22:47414->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:08:21.578007061 (510h0m42.070439503s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection Sep 19 20:08:21.578044074 (510h0m42.070476516s) [seg_pos={0 0}, upload=448634]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 19 20:08:21.687809896 (510h0m42.180242333s) [upload=448634]: Done uploading segments... Sep 19 20:08:21.687857554 (510h0m42.180289991s) [upload=448634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 6.874831277s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.112664125s FAIL (2025-09-19 20:08:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 6) ======LOGS====== e... Sep 19 20:07:52.006138312 (510h0m12.498570756s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006429108 (510h0m12.498861551s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006489461 (510h0m12.498921904s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006804942 (510h0m12.499237395s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.006852119 (510h0m12.49928456s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007128951 (510h0m12.499561393s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007160183 (510h0m12.499592626s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007515116 (510h0m12.49994758s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.007905715 (510h0m12.500338159s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008358501 (510h0m12.500790949s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.008690473 (510h0m12.501122923s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Uploading piece... Sep 19 20:07:52.668119865 (510h0m13.160552319s) [upload=448634]: Next returned nil segment Sep 19 20:07:52.668222826 (510h0m13.16065528s) [upload=448634]: Waiting for error group managing segments... Sep 19 20:07:52.777593633 (510h0m13.270026069s) [noise=true , address=145.79.227.14:4838 , piece_id=P74VZJZGDNZKIQDOTAKDHO4N7ZUWGRPFRUS4V7KC22A266Y62NBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.778146345 (510h0m13.270578792s) [noise=true , address=145.79.227.5:4222 , piece_id=BEGGVC252XLWRXEWKF4TPGUNA2TVXWY4VLJM7NTS4KF5EOUEPIRA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.798141039 (510h0m13.290573468s) [noise=true , address=145.79.227.19:4077 , piece_id=O2F46SUAR6FBTOJVEKIWBLNIGB3TVUBHTWITZYEERM75XK4DTHCA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799444590 (510h0m13.291877026s) [noise=true , address=145.79.227.3:4150 , piece_id=442QNEZIPDEBZQ2CMHXQPNPJFDZS7ZYN62C3BGHR6OFLKOHMOMYA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.799538174 (510h0m13.291970605s) [noise=true , address=145.79.227.2:4114 , piece_id=X5EME7CF4P7HYRZVJIFP4WKO7S5JJ7BAZQQF43MJA6LWSLSGVFOA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:07:52.802692376 (510h0m13.29512481s) [noise=true , address=145.79.227.16:4910 , piece_id=DUCJETR2HTMVZPLKYUWYB6KFAB6QZDKXO7HCJ2A5UVMURD7BV6SA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: <nil> Sep 19 20:08:21.577517781 (510h0m42.069950226s) [noise=true , address=45.91.116.8:4047 , piece_id=BKPQ3BCQRRIYP5Q7NGBDARQF4PFSY53GLNBCUE4LX2N653FZ673Q, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36886->45.91.116.8:4047: use of closed network connection Sep 19 20:08:21.577629479 (510h0m42.070061923s) [noise=true , address=45.91.116.4:4938 , piece_id=HRIKFMYQ4OVEWCZ63LZRYNX67VSJYB2BQE6QJVCSTIYM7FXHEKZA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:37654->45.91.116.4:4938: use of closed network connection Sep 19 20:08:21.577644566 (510h0m42.070077015s) [noise=true , address=45.91.116.10:4081 , piece_id=AC2VAY6VWNR7JISIOUKXVLMAV7RLBE3S7QPNAC6T2MQTNX4YYU7A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12UqimG6nUH8jMQVyovyRz8PXqRzRGbFF2u1UjScB5RdsvHECqG, address:45.91.116.10:4081): protocol: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60818->45.91.116.10:4081: use of closed network connection Sep 19 20:08:21.577699357 (510h0m42.070131799s) [noise=true , address=45.91.116.11:4117 , piece_id=L5ZJGC4JAR5GCKQQ74JDKOFGLGF6CKJ5JN5TI4FANEUQJY67QJQA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52834->45.91.116.11:4117: use of closed network connection Sep 19 20:08:21.577750688 (510h0m42.070183118s) [noise=true , address=77.90.31.10:4520 , piece_id=PHVO6HQCHEMLTMFAL62HFEHPWHKQSN75MEXHPQ2SUKCZ27TGC22A, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:51548->77.90.31.10:4520: use of closed network connection Sep 19 20:08:21.577789990 (510h0m42.070222432s) [noise=true , address=77.90.31.17:4770 , piece_id=AL6KTW4QYWTZU7OGPFWUWDYZ645PPRQSQ35RUSEQ62VLA6I3C4YQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R, address:77.90.31.17:4770): protocol: read tcp 139.59.144.22:56078->77.90.31.17:4770: use of closed network connection; context deadline exceeded Sep 19 20:08:21.577878876 (510h0m42.070311317s) [noise=true , address=45.91.116.9:4261 , piece_id=LM7F4XFGYIH2JXFPPO6TSZET3V6AX26UQHIWASEO4DMYWY5WJUGQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi, address:45.91.116.9:4261): protocol: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36404->45.91.116.9:4261: use of closed network connection Sep 19 20:08:21.577902373 (510h0m42.070334802s) [noise=true , address=77.90.31.21:4879 , piece_id=S3QK6AVAMK6Z7SINEP2IHF3EM5WMDEUN32XAT7MN34NMHHY265TA, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12W5Bso6XAuE6qzduTxCUmuzHWnUvNrjiwvogysvBLisdHEFjQQ, address:77.90.31.21:4879): protocol: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35478->77.90.31.21:4879: use of closed network connection Sep 19 20:08:21.577974266 (510h0m42.070406693s) [noise=true , address=45.91.116.12:4227 , piece_id=MI3JFHOVCU7NFE2B7B6LABFTF76CMTY5R63WSBC6FRLLEUDZDPBQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: read tcp 139.59.144.22:47414->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 19 20:08:21.578007061 (510h0m42.070439503s) [noise=true , address=45.91.116.14:4189 , piece_id=PSGNCGONGX2JTTZWWC7TSOWWUVE3AKPINRCEM7TEHCKUFVHUFHQQ, seg_pos={0 0}, upload=448634]: Done uploading piece. err: ecclient: upload failed (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N, address:45.91.116.14:4189): protocol: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:48958->45.91.116.14:4189: use of closed network connection Sep 19 20:08:21.578044074 (510h0m42.070476516s) [seg_pos={0 0}, upload=448634]: Done waiting for segment. successful: 6 optimal: 13 errs: <nil> Sep 19 20:08:21.687809896 (510h0m42.180242333s) [upload=448634]: Done uploading segments... Sep 19 20:08:21.687857554 (510h0m42.180289991s) [upload=448634]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 6) Duration: 30.112694137s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.371279479s FAIL (2025-09-19 06:20:44 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.371311442s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.421518702s FAIL (2025-09-19 06:20:27 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.421547008s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.431176096s FAIL (2025-09-19 06:19:55 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.431214326s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.484340992s FAIL (2025-09-19 06:18:57 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.484446345s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.707626825s FAIL (2025-09-19 06:18:14 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.707655673s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.214457571s FAIL (2025-09-19 06:17:13 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.214497861s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.493488937s FAIL (2025-09-19 06:16:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.493518921s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.316235158s FAIL (2025-09-19 06:15:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.316271397s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.430062148s FAIL (2025-09-19 06:14:38 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.4300906s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.515183344s FAIL (2025-09-19 06:14:20 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.515273948s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.237938915s FAIL (2025-09-19 06:13:05 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.237977855s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.280419271s FAIL (2025-09-19 06:12:33 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.280451825s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.628249793s FAIL (2025-09-19 06:11:22 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.628281967s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.497494099s FAIL (2025-09-19 06:10:13 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.497526721s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.381489912s FAIL (2025-09-19 06:09:52 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.381523795s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.601871618s FAIL (2025-09-19 06:09:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.601902729s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.581654538s FAIL (2025-09-19 06:08:35 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.581693619s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.444123807s FAIL (2025-09-19 06:08:12 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.444166985s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.292680932s FAIL (2025-09-19 06:07:36 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.292712323s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 2.137800881s FAIL (2025-09-19 06:06:55 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.137830787s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.397347505s FAIL (2025-09-19 06:06:32 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.397388939s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 2.576968207s FAIL (2025-09-19 06:06:01 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.577006501s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 2.648457097s FAIL (2025-09-19 06:05:03 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.648532453s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 3.000333913s FAIL (2025-09-19 06:04:40 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 3.000406278s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 2.563995112s FAIL (2025-09-19 06:04:21 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.564031612s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 2.512640906s FAIL (2025-09-19 06:03:59 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.512678988s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.291034118s FAIL (2025-09-19 06:03:13 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.291068859s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.553909284s FAIL (2025-09-19 06:02:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.553945759s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.875325353s FAIL (2025-09-19 06:01:50 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.875359542s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.559270782s FAIL (2025-09-19 06:01:32 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.559303873s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.704674003s FAIL (2025-09-19 06:00:19 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.70469801s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.520485117s FAIL (2025-09-19 06:00:00 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.520520382s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.113423716s FAIL (2025-09-19 05:58:58 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.113464589s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 3.098632299s FAIL (2025-09-19 05:57:54 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 3.098666649s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.204285687s FAIL (2025-09-19 05:57:17 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.204323831s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.524421981s FAIL (2025-09-19 05:56:24 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.524455512s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 2.392347774s FAIL (2025-09-19 05:56:02 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.392388589s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 2.362947785s FAIL (2025-09-19 05:55:15 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.362985253s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 2.37084688s FAIL (2025-09-19 05:54:40 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.370894403s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 2.290908867s FAIL (2025-09-19 05:53:56 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 2.290937551s core uplink us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)